-- Logs begin at Tue 2022-08-30 03:38:06 UTC, end at Tue 2022-08-30 04:44:23 UTC. -- Aug 30 04:12:41.686532 dv-cinder-854265-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 30 04:12:41.694156 dv-cinder-854265-2-smb devstack@keystone.service[81532]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 30 04:12:41.703424 dv-cinder-854265-2-smb devstack@keystone.service[81532]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 30 04:12:41 2022] *** Aug 30 04:12:41.703424 dv-cinder-854265-2-smb devstack@keystone.service[81532]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 30 04:12:41.703424 dv-cinder-854265-2-smb devstack@keystone.service[81532]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 30 04:12:41.703424 dv-cinder-854265-2-smb devstack@keystone.service[81532]: nodename: dv-cinder-854265-2-smb Aug 30 04:12:41.703424 dv-cinder-854265-2-smb devstack@keystone.service[81532]: machine: x86_64 Aug 30 04:12:41.703424 dv-cinder-854265-2-smb devstack@keystone.service[81532]: clock source: unix Aug 30 04:12:41.703424 dv-cinder-854265-2-smb devstack@keystone.service[81532]: pcre jit disabled Aug 30 04:12:41.703424 dv-cinder-854265-2-smb devstack@keystone.service[81532]: detected number of CPU cores: 4 Aug 30 04:12:41.703424 dv-cinder-854265-2-smb devstack@keystone.service[81532]: current working directory: / Aug 30 04:12:41.703424 dv-cinder-854265-2-smb devstack@keystone.service[81532]: detected binary path: /usr/bin/uwsgi-core Aug 30 04:12:41.703424 dv-cinder-854265-2-smb devstack@keystone.service[81532]: your processes number limit is 47680 Aug 30 04:12:41.703424 dv-cinder-854265-2-smb devstack@keystone.service[81532]: your memory page size is 4096 bytes Aug 30 04:12:41.703424 dv-cinder-854265-2-smb devstack@keystone.service[81532]: detected max file descriptor number: 2048 Aug 30 04:12:41.703424 dv-cinder-854265-2-smb devstack@keystone.service[81532]: lock engine: pthread robust mutexes Aug 30 04:12:41.703424 dv-cinder-854265-2-smb devstack@keystone.service[81532]: thunder lock: enabled Aug 30 04:12:41.703424 dv-cinder-854265-2-smb devstack@keystone.service[81532]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 30 04:12:41.703424 dv-cinder-854265-2-smb devstack@keystone.service[81532]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 30 04:12:41.741160 dv-cinder-854265-2-smb devstack@keystone.service[81532]: Python main interpreter initialized at 0x561ac57619c0 Aug 30 04:12:41.741160 dv-cinder-854265-2-smb devstack@keystone.service[81532]: python threads support enabled Aug 30 04:12:41.741160 dv-cinder-854265-2-smb devstack@keystone.service[81532]: your server socket listen backlog is limited to 100 connections Aug 30 04:12:41.741160 dv-cinder-854265-2-smb devstack@keystone.service[81532]: your mercy for graceful operations on workers is 90 seconds Aug 30 04:12:41.741579 dv-cinder-854265-2-smb devstack@keystone.service[81532]: mapped 403077 bytes (393 KB) for 2 cores Aug 30 04:12:41.741579 dv-cinder-854265-2-smb devstack@keystone.service[81532]: *** Operational MODE: preforking *** Aug 30 04:12:41.741915 dv-cinder-854265-2-smb devstack@keystone.service[81532]: *** uWSGI is running in multiple interpreter mode *** Aug 30 04:12:41.741915 dv-cinder-854265-2-smb devstack@keystone.service[81532]: spawned uWSGI master process (pid: 81532) Aug 30 04:12:41.742204 dv-cinder-854265-2-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 30 04:12:41.743065 dv-cinder-854265-2-smb devstack@keystone.service[81532]: spawned uWSGI worker 1 (pid: 81546, cores: 1) Aug 30 04:12:41.743976 dv-cinder-854265-2-smb devstack@keystone.service[81532]: spawned uWSGI worker 2 (pid: 81547, cores: 1) Aug 30 04:12:41.745362 dv-cinder-854265-2-smb devstack@keystone.service[81532]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 30 04:12:46.086269 dv-cinder-854265-2-smb devstack@keystone.service[81546]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 04:12:46.086269 dv-cinder-854265-2-smb devstack@keystone.service[81546]: from cryptography.utils import int_from_bytes Aug 30 04:12:46.087335 dv-cinder-854265-2-smb devstack@keystone.service[81546]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 04:12:46.087335 dv-cinder-854265-2-smb devstack@keystone.service[81546]: from cryptography.utils import int_from_bytes Aug 30 04:12:46.137479 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 04:12:46.137702 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 04:12:46.137782 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] command line args: [] {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 04:12:46.138083 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 04:12:46.138235 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ================================================================================ {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 04:12:46.138516 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] admin_token = **** {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.138752 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] config_dir = [] {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.138891 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.139105 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] config_source = [] {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.139267 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] debug = True {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.139424 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.140652 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.140652 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.140652 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.140652 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.140652 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] list_limit = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.140960 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] log_config_append = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.141023 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.141146 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] log_dir = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.141352 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] log_file = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.141585 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.141831 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.142074 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.142313 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.142494 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.142617 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.142883 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.143124 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.143335 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.143562 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.143791 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.144038 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.144284 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.144521 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.144788 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.145281 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.91/identity {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.145458 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] publish_errors = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.145683 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.145910 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.146064 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.146302 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.146532 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.146762 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] standard_threads = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.146988 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.147223 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.147395 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.147565 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] use_journal = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.147736 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] use_json = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.147917 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] use_stderr = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.148104 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] use_syslog = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.148330 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.148581 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.148813 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.149067 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.149300 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.149541 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.149773 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.150013 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.150244 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.150485 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.150726 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.150972 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.151204 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.151445 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.151680 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.151938 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.152452 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.152588 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.152838 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.153086 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.153329 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.153563 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.153811 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.154068 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.154322 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.154563 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.154830 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.155017 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.155243 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.155395 dv-cinder-854265-2-smb devstack@keystone.service[81547]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 04:12:46.155395 dv-cinder-854265-2-smb devstack@keystone.service[81547]: from cryptography.utils import int_from_bytes Aug 30 04:12:46.155956 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.155956 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.156116 dv-cinder-854265-2-smb devstack@keystone.service[81547]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 04:12:46.156116 dv-cinder-854265-2-smb devstack@keystone.service[81547]: from cryptography.utils import int_from_bytes Aug 30 04:12:46.156259 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.156259 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.156388 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.156649 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.156890 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.157123 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.157364 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.157593 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.157824 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.158054 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.158280 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.158507 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.158732 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.158960 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.159189 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.159430 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.159655 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.159886 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.160136 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.160400 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.160629 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.160872 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.161096 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.161339 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.161564 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.161801 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.162032 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.162265 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.162542 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.162824 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.162994 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.163237 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.163362 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.163646 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.163880 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.164117 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.164350 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.164713 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.164933 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.165054 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.165304 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.165565 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.165778 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.166009 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.166238 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.166472 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.166715 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.166948 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.167184 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.167420 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.167661 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.168134 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.168134 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.168434 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.168632 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.168860 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.169120 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.169358 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.169599 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.169839 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.170429 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.170668 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.170903 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.171135 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.171367 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.171591 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.171822 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.172072 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.172306 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.172534 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.172774 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.173005 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.173247 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.173481 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.173731 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.173986 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.174225 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.174485 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] auth.external = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.174685 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.174978 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.175206 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.175435 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] auth.password = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.175661 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] auth.token = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.175898 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.176152 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.176396 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.176626 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.176866 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.177111 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.177340 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.177574 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] credential.caching = True {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.177817 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.178060 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.178303 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.178543 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.178783 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.179013 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.179252 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.179499 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.179732 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.180003 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.180288 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.180531 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.180788 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.181025 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.181275 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.181507 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] federation.caching = True {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.181744 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.181982 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.182223 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.182448 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.182690 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.182923 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.183169 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.183435 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.183798 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.184059 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.184309 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.184553 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] identity.caching = True {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.184793 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.185157 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.185422 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.185660 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.185904 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.186135 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.186372 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.186617 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.186867 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.187097 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.187335 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.187562 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.187801 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.188074 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.188318 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.188588 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.188811 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.189078 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.189490 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.189611 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.189766 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.189997 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.190225 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.190452 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.190710 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.190929 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.191176 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.191404 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.191647 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.191889 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.192144 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.192387 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.192628 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.192862 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.193097 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.193320 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.193562 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.193788 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.194027 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.194260 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.194493 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.194737 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.194982 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.195215 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.195439 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.195682 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.195995 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.196179 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.196410 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.196644 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.196874 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.user = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.197110 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.197364 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.197592 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.197842 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.198078 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.198319 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.198551 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.198777 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.199009 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.199547 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.199713 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.200229 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.200487 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.200733 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.200976 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.201218 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.201462 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.201692 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.201940 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.202175 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.202408 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.202640 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.202871 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.203115 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.203375 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.203610 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.203861 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.204234 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.204495 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.204732 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.204965 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.205199 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.205751 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.206077 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.206363 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.206604 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.206720 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 04:12:46.206848 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] resource.caching = True {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.207011 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 04:12:46.207094 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.207168 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] command line args: [] {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 04:12:46.207331 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.207415 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 04:12:46.207523 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] ================================================================================ {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 04:12:46.207609 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.207789 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] admin_token = **** {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.207868 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.208064 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] config_dir = [] {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.208143 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.208256 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.208346 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.208448 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] config_source = [] {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.208536 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.208622 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] debug = True {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.208756 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.208844 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.208995 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.209075 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.209205 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.209294 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] role.caching = True {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.209458 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] role.driver = sql {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.209544 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.209689 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.209768 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.209925 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] list_limit = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.210012 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.210109 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] log_config_append = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.210235 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.210317 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.210399 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.210473 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] log_dir = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.210616 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] log_file = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.210695 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.210854 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.210943 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.211093 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.211186 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.211338 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.211424 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.211578 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.211659 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.211754 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.211823 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.211952 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.212072 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.212204 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.212319 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.212444 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.212559 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.212683 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.212800 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.212919 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.213123 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.213257 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.213388 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.213484 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.213587 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.213667 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.213836 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.213946 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.214112 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.214218 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.214361 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.214591 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.214707 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.91/identity {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.215069 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] publish_errors = False {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.215146 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.215293 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.215537 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.215755 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.215843 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.216005 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.216085 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.216172 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.216247 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.216428 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.216498 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.216670 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.216748 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.216912 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] standard_threads = False {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.217010 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.217138 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.217215 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.217377 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.217457 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.217538 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.217617 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.217768 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] use_journal = False {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.217858 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] token.caching = True {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.217936 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] use_json = False {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.218044 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.218133 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] use_stderr = False {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.218207 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] use_syslog = False {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.218277 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.218436 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:12:46.218515 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.218699 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.218786 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.218939 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.219018 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.219196 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.219273 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.219437 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.219524 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.219678 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.219806 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.219960 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.220087 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.220225 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.220352 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.220419 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.220479 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.220606 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.220757 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.220852 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.221072 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.221180 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.221292 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.221381 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.221494 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.221583 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.221717 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.221809 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.221956 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.222035 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] database.connection = **** {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.222208 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.222286 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.222458 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.222547 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.222698 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.222778 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.222947 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.223031 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.223186 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.223323 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.223426 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.223502 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.223638 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.223758 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.223879 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.224065 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.224164 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.224286 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.224402 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.224512 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.224623 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.224747 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.224928 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.225065 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.225171 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.225253 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.225315 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.225399 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.225505 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.225641 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.225765 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.225891 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.226006 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.226096 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.226170 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.226232 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.226291 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 04:12:46.226460 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.226715 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.226960 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.227204 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.227453 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.227687 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.227941 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.228185 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.228419 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.228654 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.228888 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.229121 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.229360 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.229611 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.229847 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.230089 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.230465 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.231413 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.231674 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.231956 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.232312 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.232561 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.232806 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.233050 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.233293 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.233534 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.233771 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.234026 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.234267 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.234517 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.234753 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.235021 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.235261 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.235497 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.237378 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.237632 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.237918 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.238166 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.238422 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.238675 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.238918 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.239159 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.239400 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.239653 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.239897 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.240160 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.240407 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.240647 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.240896 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.241140 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.241380 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.241621 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.241860 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.242099 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.242370 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.242615 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.242865 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.243116 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.243359 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.243605 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.243846 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.244105 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.244337 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.244567 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.244802 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.245068 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.245275 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.245510 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.245756 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.246199 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.246612 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.246861 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.247121 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.247388 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.247756 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.248030 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] auth.external = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.248266 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.248563 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.248799 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.249033 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] auth.password = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.249268 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] auth.token = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.249513 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.249758 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.250000 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.250240 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.250487 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.250742 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.250976 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.251219 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] credential.caching = True {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.251467 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.251719 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.252000 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.252260 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.252508 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.252745 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.252996 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.253250 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.253489 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.253744 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.254036 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.254287 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.254555 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.254800 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.255063 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.255306 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] federation.caching = True {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.255548 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.255795 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.256073 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.256294 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81546) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:12:46.256453 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.256574 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81546) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:12:46.256699 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.256817 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81546) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:12:46.256936 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.257043 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.257239 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.257498 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.257744 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.258022 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.258233 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] identity.caching = True {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.258508 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.258733 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.258971 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.259211 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.259461 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.259699 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.259979 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.260220 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.260476 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.260713 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.260953 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.261181 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.261427 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.261881 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.262851 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.263124 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.263383 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.263699 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.263930 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.264325 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.264580 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.264792 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.265057 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.265285 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.265560 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.265805 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.266056 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.266180 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81546) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:12:46.266252 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.266530 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.266778 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.267000 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.267250 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.267502 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.267725 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.268000 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.268253 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.268494 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.268731 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.268981 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.269220 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.269611 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.269873 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.270132 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.270372 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.270610 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.270864 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.271117 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.271358 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.271596 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.271839 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.272102 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] ldap.user = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.272351 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.272614 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.272851 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.273105 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.273356 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.273604 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.273842 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.274076 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.274317 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.274556 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.274802 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.275030 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.275287 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.275538 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.275785 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.276057 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.276306 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.276542 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.276792 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.277033 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.277366 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.278288 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.278546 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.278792 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.279048 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.279294 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.279553 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.279788 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.280062 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.280307 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.280547 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.280787 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.281038 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.281284 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.281521 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.281766 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.282011 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] resource.caching = True {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.282260 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.282512 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.282751 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.283001 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.283257 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.283497 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.283745 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.284011 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.284257 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.284495 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] role.caching = True {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.284744 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] role.driver = sql {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.284979 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.285230 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.285487 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.285751 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.285984 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.286235 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.286484 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.286731 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.286982 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.287219 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.287518 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.287830 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.288109 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.288364 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.288797 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.289044 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.289291 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.289546 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.289821 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.290054 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.290293 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.290559 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.290811 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.291055 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.291299 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.291532 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.291768 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.292048 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.292308 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.292559 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.292969 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.293813 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.294062 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.294310 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] token.caching = True {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.294547 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81546) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:12:46.294683 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.294819 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81546) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:12:46.294943 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.295417 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.295638 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.295893 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.296297 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.296548 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.296797 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.297050 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.297292 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.297538 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.297775 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.298027 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.298311 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.298545 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.298794 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.299089 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.299331 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] database.connection = **** {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.299608 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.299855 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.300122 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.300374 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.300608 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.300850 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.301088 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.301333 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.301579 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.301801 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.302049 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.302291 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.302524 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.302771 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.303020 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.303251 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.303495 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.303735 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:12:46.303952 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 04:12:46.330993 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81547) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:12:46.331201 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81547) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:12:46.331428 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81547) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:12:46.344352 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81547) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:12:46.349441 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81546) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:12:46.365916 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81547) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:12:46.366125 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81547) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:12:46.398760 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81546) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:12:46.398989 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81546) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:12:46.407618 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81547) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:12:46.445234 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81547) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:12:46.445488 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81547) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:12:46.563245 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81546) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:12:46.563521 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81546) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:12:46.563708 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81546) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:12:46.563867 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81546) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:12:46.564129 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81546) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:12:46.564332 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81546) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:12:46.590491 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81546) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:12:46.590724 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81546) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:12:46.590928 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81546) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:12:46.591148 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81546) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:12:46.591354 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81546) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:12:46.591579 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81546) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:12:46.591789 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81546) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:12:46.600945 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81547) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:12:46.601085 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81547) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:12:46.601318 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81547) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:12:46.601542 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81547) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:12:46.601761 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81547) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:12:46.601981 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81547) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:12:46.603331 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81546) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:12:46.615507 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81547) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:12:46.615746 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81547) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:12:46.616010 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81547) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:12:46.616207 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81547) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:12:46.616430 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81547) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:12:46.616578 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81546) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:12:46.616738 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81547) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:12:46.616846 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81546) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:12:46.616940 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81547) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:12:46.617032 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81546) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:12:46.617131 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81546) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:12:46.617289 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81546) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:12:46.617508 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81546) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:12:46.617712 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81546) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:12:46.625833 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81547) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:12:46.628999 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81547) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:12:46.629232 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81547) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:12:46.629457 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81547) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:12:46.629681 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81547) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:12:46.629899 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81547) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:12:46.630115 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81547) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:12:46.630331 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81547) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:12:46.634757 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.634965 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 30 04:12:46.635315 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.635643 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 30 04:12:46.636114 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.636571 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.637022 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.637476 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.641425 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.641637 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 30 04:12:46.641985 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.642203 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 30 04:12:46.642482 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.642744 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.643013 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.643265 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.649227 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.649519 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.649787 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.650067 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.653878 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.654182 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.654436 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.654732 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.657278 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81546) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:12:46.660252 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81546) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:12:46.660535 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.660821 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.661125 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.661374 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.661630 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.661895 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.662167 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.662434 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.662702 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.662841 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81547) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:12:46.662978 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.666148 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81547) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:12:46.666434 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.666721 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.667009 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.667293 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.667610 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.668260 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.668621 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.669093 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.669535 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.669961 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.685915 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.687387 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81546) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:12:46.687695 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.692196 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81546) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:12:46.692479 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.692753 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.699191 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81546) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:12:46.699481 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.703499 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81546) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:12:46.703788 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.704111 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.704535 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.704723 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.706956 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.707241 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.707389 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.707524 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.708960 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81547) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:12:46.709311 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.717164 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81547) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:12:46.717471 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.717754 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.723318 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.723614 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.726513 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81547) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:12:46.726934 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.727463 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81546) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:12:46.730635 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.730955 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.732771 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81547) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:12:46.733069 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.733454 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.733865 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.734412 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.734830 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.735228 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.735384 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81546) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:12:46.735651 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.738424 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81546) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:12:46.741506 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.741802 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.742083 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.742363 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.742649 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.743031 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.759051 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81546) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:12:46.759341 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.759469 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.759632 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.759758 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.759859 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.764834 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81547) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:12:46.766953 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.768242 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.768543 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.768766 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.770427 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.770717 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.773283 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81547) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:12:46.773562 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81546) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:12:46.773863 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.774150 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.774435 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.774733 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.776922 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81547) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:12:46.781353 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.781723 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.781978 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.782418 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.782715 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.783008 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.786846 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81546) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:12:46.787137 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.787427 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.787717 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.788029 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.788319 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.788616 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.800527 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81547) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:12:46.800828 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.801104 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.801382 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.805126 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81546) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:12:46.808588 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81546) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:12:46.808800 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.811348 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.812126 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.813344 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.813563 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.813658 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.815140 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81546) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:12:46.815445 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.815729 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.816492 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81547) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:12:46.816798 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.817082 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.817380 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.817665 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.822724 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.824609 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81546) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:12:46.827700 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.828044 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.828328 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.828603 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.831467 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81547) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:12:46.831807 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.832127 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.832417 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.832705 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.832991 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.833361 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.836879 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81546) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:12:46.837196 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.837476 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.844808 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81546) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:12:46.845119 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.845405 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.845697 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.845948 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.846224 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.846498 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.846790 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.847068 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.847352 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.847609 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.847881 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.848168 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.848451 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.850314 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81547) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:12:46.853764 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81547) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:12:46.857800 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.859332 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.860910 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81547) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:12:46.861209 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.861499 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.868362 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.869923 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81547) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:12:46.873386 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.873700 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.873979 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.874274 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.882463 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81547) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:12:46.882783 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.883070 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.883241 dv-cinder-854265-2-smb devstack@keystone.service[81546]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561ac57619c0 pid: 81546 (default app) Aug 30 04:12:46.887343 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400fbe81-ffe3-4f33-9039-7a49ce160b64 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:12:46.887674 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400fbe81-ffe3-4f33-9039-7a49ce160b64 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:12:46.888022 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400fbe81-ffe3-4f33-9039-7a49ce160b64 None None] PATH_INFO: `/v3` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:12:46.891124 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81547) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:12:46.891424 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.891710 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.892019 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.892278 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.892412 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1/1] 10.222.0.91 () {50 vars in 791 bytes} [Tue Aug 30 04:12:46 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:12:46.892537 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.894688 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.894688 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.894688 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.894688 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.894688 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.894688 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.895227 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.895227 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:12:46.931273 dv-cinder-854265-2-smb devstack@keystone.service[81547]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561ac57619c0 pid: 81547 (default app) Aug 30 04:12:53.647315 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97d8d7-1b9a-41db-a931-5c6e224e8bc3 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:12:53.647839 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97d8d7-1b9a-41db-a931-5c6e224e8bc3 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:12:53.647839 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97d8d7-1b9a-41db-a931-5c6e224e8bc3 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:12:53.649179 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 2/2] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:12:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:12:53.657165 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e716c06-a194-4ddc-8ebd-6246f7c3871f None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:12:53.657866 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e716c06-a194-4ddc-8ebd-6246f7c3871f None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:12:53.657866 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e716c06-a194-4ddc-8ebd-6246f7c3871f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:12:53.728547 dv-cinder-854265-2-smb devstack@keystone.service[81547]: INFO dbcounter [None req-8e716c06-a194-4ddc-8ebd-6246f7c3871f None None] Registered counter for database keystone Aug 30 04:12:53.749136 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG oslo_db.sqlalchemy.engines [None req-8e716c06-a194-4ddc-8ebd-6246f7c3871f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81547) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 04:12:53.758152 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writer thread running {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 04:12:53.942509 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG passlib.handlers.bcrypt [None req-8e716c06-a194-4ddc-8ebd-6246f7c3871f None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81547) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 30 04:12:53.942798 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG passlib.handlers.bcrypt [None req-8e716c06-a194-4ddc-8ebd-6246f7c3871f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81547) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 30 04:12:54.004946 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-8e716c06-a194-4ddc-8ebd-6246f7c3871f None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:12:54.006579 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-8e716c06-a194-4ddc-8ebd-6246f7c3871f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:12:54.141166 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1/3] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:12:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 487 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 30 04:12:54.656505 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97d8d7-1b9a-41db-a931-5c6e224e8bc3 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:12:54.728833 dv-cinder-854265-2-smb devstack@keystone.service[81546]: INFO dbcounter [None req-1b97d8d7-1b9a-41db-a931-5c6e224e8bc3 None None] Registered counter for database keystone Aug 30 04:12:54.753990 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG oslo_db.sqlalchemy.engines [None req-1b97d8d7-1b9a-41db-a931-5c6e224e8bc3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81546) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 04:12:54.765914 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writer thread running {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 04:12:54.899364 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97d8d7-1b9a-41db-a931-5c6e224e8bc3 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:12:54.904375 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097815b4-f6ee-4db6-a739-576db8040487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:12:54.904998 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097815b4-f6ee-4db6-a739-576db8040487 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:12:54.905279 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097815b4-f6ee-4db6-a739-576db8040487 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:12:54.905531 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097815b4-f6ee-4db6-a739-576db8040487 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:12:54.914452 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097815b4-f6ee-4db6-a739-576db8040487 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:12:54.966543 dv-cinder-854265-2-smb devstack@keystone.service[81546]: WARNING keystone.common.rbac_enforcer.enforcer [None req-097815b4-f6ee-4db6-a739-576db8040487 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 30 04:12:54.966885 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097815b4-f6ee-4db6-a739-576db8040487 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:12:54.977424 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 3/4] 10.222.0.91 () {58 vars in 1324 bytes} [Tue Aug 30 04:12:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:12:54.984433 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e716c06-a194-4ddc-8ebd-6246f7c3871f None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:12:55.000533 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e716c06-a194-4ddc-8ebd-6246f7c3871f None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:12:55.006221 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e388d46-645c-4755-bdee-71b874a2acb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:12:55.007672 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e388d46-645c-4755-bdee-71b874a2acb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:12:55.007946 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e388d46-645c-4755-bdee-71b874a2acb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:12:55.008273 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e388d46-645c-4755-bdee-71b874a2acb3 admin admin] PATH_INFO: `/v3/projects/d17736c99d5e4774b6a5a802cbcd44ca` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:12:55.009798 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e388d46-645c-4755-bdee-71b874a2acb3 admin admin] RBAC: Authorizing `identity:get_project(project_id=d17736c99d5e4774b6a5a802cbcd44ca)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:12:55.062905 dv-cinder-854265-2-smb devstack@keystone.service[81547]: WARNING keystone.common.rbac_enforcer.enforcer [None req-0e388d46-645c-4755-bdee-71b874a2acb3 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 30 04:12:55.063246 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e388d46-645c-4755-bdee-71b874a2acb3 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:12:55.068807 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 2/5] 10.222.0.91 () {56 vars in 1207 bytes} [Tue Aug 30 04:12:54 2022] GET /identity/v3/projects/d17736c99d5e4774b6a5a802cbcd44ca => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:12:56.962487 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572fecd0-422a-4472-9e06-3c6b0bb540d2 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:12:56.963013 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572fecd0-422a-4472-9e06-3c6b0bb540d2 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:12:56.963013 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572fecd0-422a-4472-9e06-3c6b0bb540d2 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:12:56.967890 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 4/6] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:12:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:12:56.973579 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93109192-1810-4424-9caa-92f61035bd35 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:12:56.974029 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93109192-1810-4424-9caa-92f61035bd35 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:12:56.974134 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93109192-1810-4424-9caa-92f61035bd35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:12:56.995180 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-93109192-1810-4424-9caa-92f61035bd35 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:12:56.997078 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-93109192-1810-4424-9caa-92f61035bd35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:12:57.005535 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 3/7] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:12:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 30 04:12:57.269784 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572fecd0-422a-4472-9e06-3c6b0bb540d2 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:12:57.287689 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572fecd0-422a-4472-9e06-3c6b0bb540d2 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:12:57.292267 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3945ea86-7ca9-4a5a-ac39-2814493e9ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:12:57.292881 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945ea86-7ca9-4a5a-ac39-2814493e9ec0 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:12:57.293301 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945ea86-7ca9-4a5a-ac39-2814493e9ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:12:57.293730 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945ea86-7ca9-4a5a-ac39-2814493e9ec0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:12:57.302679 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3945ea86-7ca9-4a5a-ac39-2814493e9ec0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:12:57.304502 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3945ea86-7ca9-4a5a-ac39-2814493e9ec0 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:12:57.313555 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 5/8] 10.222.0.91 () {58 vars in 1324 bytes} [Tue Aug 30 04:12:57 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:12:57.319433 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93109192-1810-4424-9caa-92f61035bd35 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:12:57.329055 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93109192-1810-4424-9caa-92f61035bd35 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:12:57.334788 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2e0aa2-d479-4cc3-8f49-1efa0633384a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:12:57.335421 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e0aa2-d479-4cc3-8f49-1efa0633384a admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:12:57.335699 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e0aa2-d479-4cc3-8f49-1efa0633384a admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:12:57.335977 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e0aa2-d479-4cc3-8f49-1efa0633384a admin admin] PATH_INFO: `/v3/users/7a4a4a4d468841a8acfbd6ef778ab3bd` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:12:57.337662 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2e0aa2-d479-4cc3-8f49-1efa0633384a admin admin] RBAC: Authorizing `identity:get_user(user_id=7a4a4a4d468841a8acfbd6ef778ab3bd)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:12:57.339794 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2e0aa2-d479-4cc3-8f49-1efa0633384a admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:12:57.341634 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 4/9] 10.222.0.91 () {56 vars in 1198 bytes} [Tue Aug 30 04:12:57 2022] GET /identity/v3/users/7a4a4a4d468841a8acfbd6ef778ab3bd => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:12:59.334676 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652907b7-a03c-4e77-8850-13019835ce91 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:12:59.335301 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652907b7-a03c-4e77-8850-13019835ce91 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:12:59.335301 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652907b7-a03c-4e77-8850-13019835ce91 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:12:59.336580 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 6/10] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:12:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:12:59.342476 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c64411-9d22-4d96-aa9a-7713d4768415 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:12:59.342977 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c64411-9d22-4d96-aa9a-7713d4768415 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:12:59.343068 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c64411-9d22-4d96-aa9a-7713d4768415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:12:59.359836 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686ac18-1fa0-4e4f-8762-7fb22c58e324 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:12:59.360156 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686ac18-1fa0-4e4f-8762-7fb22c58e324 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:12:59.360445 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686ac18-1fa0-4e4f-8762-7fb22c58e324 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:12:59.361752 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 7/11] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:12:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:12:59.362280 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-73c64411-9d22-4d96-aa9a-7713d4768415 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:12:59.363501 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-73c64411-9d22-4d96-aa9a-7713d4768415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:12:59.367069 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba2701-46bc-4485-a364-9ccc9c01ee82 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:12:59.367381 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba2701-46bc-4485-a364-9ccc9c01ee82 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:12:59.367660 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba2701-46bc-4485-a364-9ccc9c01ee82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:12:59.410738 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG passlib.handlers.bcrypt [None req-70ba2701-46bc-4485-a364-9ccc9c01ee82 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81546) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 30 04:12:59.411222 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG passlib.handlers.bcrypt [None req-70ba2701-46bc-4485-a364-9ccc9c01ee82 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81546) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 30 04:12:59.447321 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 5/12] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:12:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:12:59.460219 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-70ba2701-46bc-4485-a364-9ccc9c01ee82 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:12:59.461863 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-70ba2701-46bc-4485-a364-9ccc9c01ee82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:12:59.568766 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 8/13] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:12:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 04:12:59.750359 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c64411-9d22-4d96-aa9a-7713d4768415 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:12:59.776104 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:12:59.837097 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ba2701-46bc-4485-a364-9ccc9c01ee82 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:12:59.863585 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c64411-9d22-4d96-aa9a-7713d4768415 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:12:59.900692 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc4db13-507b-4a50-b06f-886b35ec06b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:12:59.901223 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4db13-507b-4a50-b06f-886b35ec06b7 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:12:59.901497 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4db13-507b-4a50-b06f-886b35ec06b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:12:59.901800 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4db13-507b-4a50-b06f-886b35ec06b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:12:59.919870 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc4db13-507b-4a50-b06f-886b35ec06b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:12:59.930108 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-0bc4db13-507b-4a50-b06f-886b35ec06b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:12:59.930108 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:12:59.930108 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:12:59.930108 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:12:59.930108 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:12:59.930108 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:12:59.930108 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:12:59.930108 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:12:59.930108 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:12:59.930108 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:12:59.930108 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:12:59.930108 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:12:59.930108 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:12:59.930108 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:12:59.930108 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:12:59.930108 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:12:59.931229 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:12:59.931229 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:12:59.931229 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:12:59.931229 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:12:59.931229 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:12:59.931229 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:12:59.931229 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:12:59.931229 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:12:59.931229 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:12:59.931229 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:12:59.931229 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:12:59.931229 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:12:59.931229 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:12:59.931229 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:12:59.931229 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:12:59.931229 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:12:59.932133 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:12:59.932133 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:12:59.932133 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:12:59.932133 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:12:59.932133 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:12:59.932133 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:12:59.932133 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:12:59.932133 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:12:59.932133 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:12:59.932133 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:12:59.932133 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:12:59.932133 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:12:59.932133 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 6/14] 10.222.0.91 () {56 vars in 1096 bytes} [Tue Aug 30 04:12:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:12:59.937525 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc4db13-507b-4a50-b06f-886b35ec06b7 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:12:59.948404 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ba2701-46bc-4485-a364-9ccc9c01ee82 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:12:59.951349 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:12:59.990969 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d0c5fe-c322-4b7a-ae07-c6adb1b06044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:12:59.991866 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0c5fe-c322-4b7a-ae07-c6adb1b06044 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:12:59.992182 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0c5fe-c322-4b7a-ae07-c6adb1b06044 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:12:59.992450 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0c5fe-c322-4b7a-ae07-c6adb1b06044 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:00.031764 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:00.056636 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc4db13-507b-4a50-b06f-886b35ec06b7 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:00.077625 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d0c5fe-c322-4b7a-ae07-c6adb1b06044 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:00.079165 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d0c5fe-c322-4b7a-ae07-c6adb1b06044 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:00.102992 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb71e7f5-82e8-4cd3-b2c2-4717da7a4815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:00.103965 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb71e7f5-82e8-4cd3-b2c2-4717da7a4815 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:00.104391 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb71e7f5-82e8-4cd3-b2c2-4717da7a4815 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:00.104837 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb71e7f5-82e8-4cd3-b2c2-4717da7a4815 None admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:00.105895 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb71e7f5-82e8-4cd3-b2c2-4717da7a4815 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:00.106198 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb71e7f5-82e8-4cd3-b2c2-4717da7a4815 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:00.107971 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb71e7f5-82e8-4cd3-b2c2-4717da7a4815 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:00.124561 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 7/15] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 30 04:12:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:13:00.130410 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb71e7f5-82e8-4cd3-b2c2-4717da7a4815 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:00.192651 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 9/16] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 30 04:12:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 04:13:00.198413 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d0c5fe-c322-4b7a-ae07-c6adb1b06044 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:00.201481 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:00.239233 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb71e7f5-82e8-4cd3-b2c2-4717da7a4815 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:00.276073 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d15be-f7ca-42c4-92fc-863b387a152a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:00.276741 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d15be-f7ca-42c4-92fc-863b387a152a None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:00.277016 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d15be-f7ca-42c4-92fc-863b387a152a None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:00.277361 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d15be-f7ca-42c4-92fc-863b387a152a None admin] PATH_INFO: `/v3/users/7a4a4a4d468841a8acfbd6ef778ab3bd` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:00.279154 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778d15be-f7ca-42c4-92fc-863b387a152a None admin] RBAC: Authorizing `identity:get_user(user_id=7a4a4a4d468841a8acfbd6ef778ab3bd)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:00.280673 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778d15be-f7ca-42c4-92fc-863b387a152a None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:00.282279 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 8/17] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 30 04:13:00 2022] GET /identity/v3/users/7a4a4a4d468841a8acfbd6ef778ab3bd => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:00.288002 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d15be-f7ca-42c4-92fc-863b387a152a None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:00.303513 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d0c5fe-c322-4b7a-ae07-c6adb1b06044 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:00.304272 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:00.340722 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dbc219-5169-4878-a7c5-fcd8764d330c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:00.341579 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dbc219-5169-4878-a7c5-fcd8764d330c None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:00.341579 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dbc219-5169-4878-a7c5-fcd8764d330c None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:00.341827 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dbc219-5169-4878-a7c5-fcd8764d330c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:00.361478 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dbc219-5169-4878-a7c5-fcd8764d330c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:00.363020 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dbc219-5169-4878-a7c5-fcd8764d330c None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:00.384776 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-a6dbc219-5169-4878-a7c5-fcd8764d330c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:13:00.384776 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:13:00.384776 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:13:00.384776 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:13:00.384776 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:13:00.384776 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:13:00.384776 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:13:00.384776 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:13:00.384776 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:13:00.384776 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:13:00.384776 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:13:00.384776 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:13:00.384776 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:13:00.384776 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:13:00.384776 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:13:00.384776 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:13:00.385969 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:13:00.385969 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:13:00.385969 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:13:00.385969 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:13:00.385969 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:13:00.385969 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:13:00.385969 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:13:00.385969 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:13:00.385969 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:13:00.385969 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:13:00.385969 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:13:00.385969 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:13:00.385969 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:13:00.385969 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:13:00.385969 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:13:00.385969 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:13:00.385969 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:13:00.386930 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:13:00.386930 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:13:00.386930 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:13:00.386930 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 10/18] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:13:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:13:00.392638 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dbc219-5169-4878-a7c5-fcd8764d330c None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:00.420986 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d15be-f7ca-42c4-92fc-863b387a152a None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:00.455530 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:00.456680 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91746951-d99e-435c-9ca5-fcc1c6474a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:00.457430 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91746951-d99e-435c-9ca5-fcc1c6474a7d None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:00.457767 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91746951-d99e-435c-9ca5-fcc1c6474a7d None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:00.457932 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91746951-d99e-435c-9ca5-fcc1c6474a7d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:00.459076 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91746951-d99e-435c-9ca5-fcc1c6474a7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:00.460598 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91746951-d99e-435c-9ca5-fcc1c6474a7d None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:00.462172 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 9/19] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:13:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:13:00.468371 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91746951-d99e-435c-9ca5-fcc1c6474a7d None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:00.505025 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dbc219-5169-4878-a7c5-fcd8764d330c None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:00.542774 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95bc516-abc7-4f4e-a4b0-a97985c081c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:00.544181 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95bc516-abc7-4f4e-a4b0-a97985c081c2 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:00.544463 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95bc516-abc7-4f4e-a4b0-a97985c081c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:00.545086 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95bc516-abc7-4f4e-a4b0-a97985c081c2 None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:00.545748 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95bc516-abc7-4f4e-a4b0-a97985c081c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:00.546042 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95bc516-abc7-4f4e-a4b0-a97985c081c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:00.547463 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95bc516-abc7-4f4e-a4b0-a97985c081c2 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:00.553446 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:00.571373 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 11/20] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:13:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:00.574937 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91746951-d99e-435c-9ca5-fcc1c6474a7d None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:00.615480 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f38c6-eeff-4fcf-9f5f-0dccdaad05d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:00.616142 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f38c6-eeff-4fcf-9f5f-0dccdaad05d9 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:00.616408 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f38c6-eeff-4fcf-9f5f-0dccdaad05d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:00.616710 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f38c6-eeff-4fcf-9f5f-0dccdaad05d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:00.617460 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f38c6-eeff-4fcf-9f5f-0dccdaad05d9 None admin] RBAC: Adding query filter params (role.id=d8f440a82947486ebb20a633ebee736b, scope.domain.id=default, user.id=7a4a4a4d468841a8acfbd6ef778ab3bd) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:00.617764 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f38c6-eeff-4fcf-9f5f-0dccdaad05d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:00.619270 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f38c6-eeff-4fcf-9f5f-0dccdaad05d9 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:00.627776 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 10/21] 10.222.0.91 () {56 vars in 1322 bytes} [Tue Aug 30 04:13:00 2022] GET /identity/v3/role_assignments?user.id=7a4a4a4d468841a8acfbd6ef778ab3bd&scope.domain.id=default&role.id=d8f440a82947486ebb20a633ebee736b => generated 233 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:13:03.113845 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224b065-5066-44f0-a104-f1ef093d37a1 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:03.114369 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224b065-5066-44f0-a104-f1ef093d37a1 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:03.114369 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224b065-5066-44f0-a104-f1ef093d37a1 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:03.116017 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 12/22] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:13:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:13:03.121624 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918bc495-c8e0-4921-bdea-df80a831f2ab None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:03.122097 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918bc495-c8e0-4921-bdea-df80a831f2ab None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:03.122179 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918bc495-c8e0-4921-bdea-df80a831f2ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:03.145501 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-918bc495-c8e0-4921-bdea-df80a831f2ab None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:03.146716 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-918bc495-c8e0-4921-bdea-df80a831f2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:03.230791 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 11/23] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:13:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:13:03.274405 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b5915-9ec6-4c72-8606-034afe6ee8d8 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:03.274715 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b5915-9ec6-4c72-8606-034afe6ee8d8 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:03.274949 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b5915-9ec6-4c72-8606-034afe6ee8d8 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:03.276583 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 13/24] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:13:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:13:03.282324 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec358da-df57-45e7-8b86-9b4565b6f846 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:03.282872 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec358da-df57-45e7-8b86-9b4565b6f846 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:03.283308 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec358da-df57-45e7-8b86-9b4565b6f846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:03.316778 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-7ec358da-df57-45e7-8b86-9b4565b6f846 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:03.318230 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-7ec358da-df57-45e7-8b86-9b4565b6f846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:03.344702 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294e4e7-e134-44d5-8b23-33e0fc69deab None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:03.345241 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294e4e7-e134-44d5-8b23-33e0fc69deab None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:03.345655 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294e4e7-e134-44d5-8b23-33e0fc69deab None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:03.347135 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 14/25] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:13:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:13:03.355848 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb784b9-f76c-4304-b926-a4e4ef69fdf2 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:03.356459 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb784b9-f76c-4304-b926-a4e4ef69fdf2 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:03.356965 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb784b9-f76c-4304-b926-a4e4ef69fdf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:03.386164 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-8bb784b9-f76c-4304-b926-a4e4ef69fdf2 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:03.387896 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-8bb784b9-f76c-4304-b926-a4e4ef69fdf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:03.400441 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 12/26] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:13:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:13:03.401714 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad9e08-8f27-4b3b-b9a1-8727bb9a555a None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:03.401993 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad9e08-8f27-4b3b-b9a1-8727bb9a555a None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:03.402318 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad9e08-8f27-4b3b-b9a1-8727bb9a555a None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:03.407944 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 13/27] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:13:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:13:03.429711 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768588be-2b61-4bae-9dc3-3a7ffa927de1 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:03.430013 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768588be-2b61-4bae-9dc3-3a7ffa927de1 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:03.430300 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768588be-2b61-4bae-9dc3-3a7ffa927de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:03.446288 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:03.473101 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-768588be-2b61-4bae-9dc3-3a7ffa927de1 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:03.474336 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-768588be-2b61-4bae-9dc3-3a7ffa927de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:03.552503 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 15/28] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:13:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:13:03.605572 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb784b9-f76c-4304-b926-a4e4ef69fdf2 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:03.617427 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 14/29] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:13:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 04:13:03.697737 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:03.782549 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb784b9-f76c-4304-b926-a4e4ef69fdf2 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:03.819578 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314465b9-8165-4235-a5c8-9166fb50d341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:03.820251 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314465b9-8165-4235-a5c8-9166fb50d341 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:03.820532 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314465b9-8165-4235-a5c8-9166fb50d341 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:03.820803 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314465b9-8165-4235-a5c8-9166fb50d341 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:03.830158 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768588be-2b61-4bae-9dc3-3a7ffa927de1 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:03.835681 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314465b9-8165-4235-a5c8-9166fb50d341 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:03.837219 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314465b9-8165-4235-a5c8-9166fb50d341 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:03.854089 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-314465b9-8165-4235-a5c8-9166fb50d341 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:13:03.854089 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:13:03.854089 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:13:03.854089 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:13:03.854089 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:13:03.854089 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:13:03.854089 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:13:03.854089 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:13:03.854089 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:13:03.854089 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:13:03.854089 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:13:03.854089 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:13:03.854089 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:13:03.854089 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:13:03.854089 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:13:03.854089 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:13:03.855041 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:13:03.855041 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:13:03.855041 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:13:03.855041 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:13:03.855041 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:13:03.855041 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:13:03.855041 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:13:03.855041 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:13:03.855041 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:13:03.855041 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:13:03.855041 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:13:03.855041 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:13:03.855041 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:13:03.855041 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:13:03.855041 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:13:03.855041 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:13:03.855041 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:13:03.856674 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:13:03.856674 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:13:03.856674 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:13:03.856674 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 16/30] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:13:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:13:03.865417 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314465b9-8165-4235-a5c8-9166fb50d341 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:04.004243 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768588be-2b61-4bae-9dc3-3a7ffa927de1 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:04.016746 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:04.028343 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314465b9-8165-4235-a5c8-9166fb50d341 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:04.040809 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32998885-1992-4883-89f4-ea6da8cc79c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:04.041480 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32998885-1992-4883-89f4-ea6da8cc79c3 None admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:04.041767 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32998885-1992-4883-89f4-ea6da8cc79c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:04.042042 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32998885-1992-4883-89f4-ea6da8cc79c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:04.042819 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32998885-1992-4883-89f4-ea6da8cc79c3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:04.044252 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32998885-1992-4883-89f4-ea6da8cc79c3 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:04.048857 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:04.073861 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb374938-3cbd-404d-aa37-2fa3ae98e9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:04.074579 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb374938-3cbd-404d-aa37-2fa3ae98e9d2 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:04.074867 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb374938-3cbd-404d-aa37-2fa3ae98e9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:04.075141 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb374938-3cbd-404d-aa37-2fa3ae98e9d2 None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:04.075874 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb374938-3cbd-404d-aa37-2fa3ae98e9d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:04.076208 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb374938-3cbd-404d-aa37-2fa3ae98e9d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:04.077995 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb374938-3cbd-404d-aa37-2fa3ae98e9d2 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:04.091136 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 17/31] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:13:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:04.092237 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb374938-3cbd-404d-aa37-2fa3ae98e9d2 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:04.199578 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb374938-3cbd-404d-aa37-2fa3ae98e9d2 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:04.225248 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 15/32] 10.222.0.91 () {60 vars in 1131 bytes} [Tue Aug 30 04:13:03 2022] POST /identity/v3/roles => generated 225 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:13:04.226883 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32998885-1992-4883-89f4-ea6da8cc79c3 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:04.255930 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b607dd-6f67-486c-a3bb-c7201504ba99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:04.256812 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b607dd-6f67-486c-a3bb-c7201504ba99 None admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:04.257250 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b607dd-6f67-486c-a3bb-c7201504ba99 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:04.257684 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b607dd-6f67-486c-a3bb-c7201504ba99 None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:04.258547 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b607dd-6f67-486c-a3bb-c7201504ba99 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:04.260203 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b607dd-6f67-486c-a3bb-c7201504ba99 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:04.382716 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32998885-1992-4883-89f4-ea6da8cc79c3 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:04.413438 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 18/33] 10.222.0.91 () {60 vars in 1131 bytes} [Tue Aug 30 04:13:04 2022] POST /identity/v3/roles => generated 219 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:13:04.414481 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b607dd-6f67-486c-a3bb-c7201504ba99 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:04.431858 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e08417e-f584-4f8c-a538-a89947374915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:04.432831 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08417e-f584-4f8c-a538-a89947374915 None admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:04.432948 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08417e-f584-4f8c-a538-a89947374915 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:04.433277 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08417e-f584-4f8c-a538-a89947374915 None admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:04.434099 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e08417e-f584-4f8c-a538-a89947374915 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:04.435823 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e08417e-f584-4f8c-a538-a89947374915 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:04.443292 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:04.475869 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 16/34] 10.222.0.91 () {60 vars in 1141 bytes} [Tue Aug 30 04:13:04 2022] POST /identity/v3/projects => generated 301 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:13:04.477595 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e12b0-9be2-42d9-bad8-ec847d5191e5 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:04.478000 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e12b0-9be2-42d9-bad8-ec847d5191e5 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:04.478341 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e12b0-9be2-42d9-bad8-ec847d5191e5 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:04.483396 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 17/35] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:13:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:13:04.487045 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed013e22-7699-4d80-ab2d-384d634aa22c None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:04.487527 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed013e22-7699-4d80-ab2d-384d634aa22c None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:04.487980 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed013e22-7699-4d80-ab2d-384d634aa22c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:04.510334 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-ed013e22-7699-4d80-ab2d-384d634aa22c None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:04.512204 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-ed013e22-7699-4d80-ab2d-384d634aa22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:04.567138 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b607dd-6f67-486c-a3bb-c7201504ba99 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:04.569391 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:04.615959 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 18/36] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:13:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:13:04.644843 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cddf5cb-4ea6-4f17-944e-a672eeaa9c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:04.645543 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cddf5cb-4ea6-4f17-944e-a672eeaa9c6a None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:04.645825 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cddf5cb-4ea6-4f17-944e-a672eeaa9c6a None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:04.646103 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cddf5cb-4ea6-4f17-944e-a672eeaa9c6a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:04.666532 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cddf5cb-4ea6-4f17-944e-a672eeaa9c6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:13:04.678743 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-9cddf5cb-4ea6-4f17-944e-a672eeaa9c6a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:13:04.678743 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:13:04.678743 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:13:04.678743 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:13:04.678743 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:13:04.678743 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:13:04.678743 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:13:04.678743 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:13:04.678743 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:13:04.678743 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:13:04.678743 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:13:04.678743 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:13:04.678743 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:13:04.678743 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:13:04.678743 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:13:04.678743 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:13:04.679676 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:13:04.679676 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:13:04.679676 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:13:04.679676 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:13:04.679676 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:13:04.679676 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:13:04.679676 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:13:04.679676 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:13:04.679676 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:13:04.679676 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:13:04.679676 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:13:04.679676 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:13:04.679676 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:13:04.679676 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:13:04.679676 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:13:04.679676 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:13:04.680468 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:13:04.680468 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:13:04.680468 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:13:04.680468 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:13:04.680468 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:13:04.680468 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:13:04.680468 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:13:04.680468 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:13:04.680468 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:13:04.680468 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:13:04.680468 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:13:04.680468 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:13:04.680468 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 19/37] 10.222.0.91 () {56 vars in 1096 bytes} [Tue Aug 30 04:13:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:13:04.686788 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed013e22-7699-4d80-ab2d-384d634aa22c None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:04.808243 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed013e22-7699-4d80-ab2d-384d634aa22c None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:04.846799 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7eb4e7-6ced-4a95-9f7f-0fa2ea90f8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:04.847465 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7eb4e7-6ced-4a95-9f7f-0fa2ea90f8ce None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:04.847748 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7eb4e7-6ced-4a95-9f7f-0fa2ea90f8ce None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:04.848048 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7eb4e7-6ced-4a95-9f7f-0fa2ea90f8ce None admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:04.848715 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7eb4e7-6ced-4a95-9f7f-0fa2ea90f8ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:04.849015 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7eb4e7-6ced-4a95-9f7f-0fa2ea90f8ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:04.850432 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7eb4e7-6ced-4a95-9f7f-0fa2ea90f8ce None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:04.859813 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 19/38] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 30 04:13:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:04.865517 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cddf5cb-4ea6-4f17-944e-a672eeaa9c6a None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:04.874290 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6fadd8-76c6-4da8-b951-3685c1aa2760 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:04.874579 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6fadd8-76c6-4da8-b951-3685c1aa2760 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:04.874858 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6fadd8-76c6-4da8-b951-3685c1aa2760 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:04.876275 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 20/39] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:13:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:13:04.881581 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235b6df-c0bf-4df8-8a46-d4f92a88e81d None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:04.881964 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235b6df-c0bf-4df8-8a46-d4f92a88e81d None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:04.882148 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235b6df-c0bf-4df8-8a46-d4f92a88e81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:04.900804 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-2235b6df-c0bf-4df8-8a46-d4f92a88e81d None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:04.902036 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-2235b6df-c0bf-4df8-8a46-d4f92a88e81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:04.933799 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:04.950733 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:04.973924 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 21/40] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:13:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 04:13:04.975007 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2235b6df-c0bf-4df8-8a46-d4f92a88e81d None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:04.975646 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cddf5cb-4ea6-4f17-944e-a672eeaa9c6a None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:05.015026 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e30264-8e3a-47d9-a835-8e708ab0af6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:05.015684 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e30264-8e3a-47d9-a835-8e708ab0af6d None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:05.015992 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e30264-8e3a-47d9-a835-8e708ab0af6d None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:05.016271 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e30264-8e3a-47d9-a835-8e708ab0af6d None admin] PATH_INFO: `/v3/users/7a4a4a4d468841a8acfbd6ef778ab3bd` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:05.017973 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e30264-8e3a-47d9-a835-8e708ab0af6d None admin] RBAC: Authorizing `identity:get_user(user_id=7a4a4a4d468841a8acfbd6ef778ab3bd)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:05.019554 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e30264-8e3a-47d9-a835-8e708ab0af6d None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:05.021401 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 20/41] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 30 04:13:04 2022] GET /identity/v3/users/7a4a4a4d468841a8acfbd6ef778ab3bd => generated 247 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:05.026653 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e30264-8e3a-47d9-a835-8e708ab0af6d None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:05.087379 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2235b6df-c0bf-4df8-8a46-d4f92a88e81d None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:05.124560 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1665c3-35b3-4e64-9a72-a601e09ea3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:05.125192 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1665c3-35b3-4e64-9a72-a601e09ea3ba None admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:05.125471 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1665c3-35b3-4e64-9a72-a601e09ea3ba None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:05.125745 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1665c3-35b3-4e64-9a72-a601e09ea3ba None admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:05.126452 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1665c3-35b3-4e64-9a72-a601e09ea3ba None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:05.128071 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1665c3-35b3-4e64-9a72-a601e09ea3ba None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:05.138808 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e30264-8e3a-47d9-a835-8e708ab0af6d None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:05.145671 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 22/42] 10.222.0.91 () {60 vars in 1131 bytes} [Tue Aug 30 04:13:04 2022] POST /identity/v3/roles => generated 223 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:13:05.180847 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9711764e-0ee5-4f4c-866f-04c778631088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:05.181537 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711764e-0ee5-4f4c-866f-04c778631088 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:05.181830 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711764e-0ee5-4f4c-866f-04c778631088 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:05.182068 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711764e-0ee5-4f4c-866f-04c778631088 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:05.183579 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9711764e-0ee5-4f4c-866f-04c778631088 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:05.185336 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9711764e-0ee5-4f4c-866f-04c778631088 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:05.187194 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 21/43] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:13:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:13:05.192964 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1665c3-35b3-4e64-9a72-a601e09ea3ba None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:05.228437 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:05.243064 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9711764e-0ee5-4f4c-866f-04c778631088 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:05.264692 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:05.319969 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1665c3-35b3-4e64-9a72-a601e09ea3ba None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:05.376462 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9711764e-0ee5-4f4c-866f-04c778631088 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:05.415336 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a06664-73c2-4d94-abce-539aa59eb2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:05.416044 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a06664-73c2-4d94-abce-539aa59eb2c6 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:05.416348 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a06664-73c2-4d94-abce-539aa59eb2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:05.416559 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a06664-73c2-4d94-abce-539aa59eb2c6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:05.417838 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a06664-73c2-4d94-abce-539aa59eb2c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:05.420324 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a06664-73c2-4d94-abce-539aa59eb2c6 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:05.421991 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 22/44] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:13:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:05.427824 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a06664-73c2-4d94-abce-539aa59eb2c6 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:05.468410 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ee50b-12a1-4b2d-b09e-309d08ff9c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:05.469096 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ee50b-12a1-4b2d-b09e-309d08ff9c5d None admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:05.469380 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ee50b-12a1-4b2d-b09e-309d08ff9c5d None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:05.469657 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ee50b-12a1-4b2d-b09e-309d08ff9c5d None admin] PATH_INFO: `/v3/domains/default/users/7a4a4a4d468841a8acfbd6ef778ab3bd/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:05.471625 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ee50b-12a1-4b2d-b09e-309d08ff9c5d None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=7a4a4a4d468841a8acfbd6ef778ab3bd, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:05.473153 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ee50b-12a1-4b2d-b09e-309d08ff9c5d None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:05.488576 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 23/45] 10.222.0.91 () {58 vars in 1361 bytes} [Tue Aug 30 04:13:05 2022] PUT /identity/v3/domains/default/users/7a4a4a4d468841a8acfbd6ef778ab3bd/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:13:05.524864 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:05.546083 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a06664-73c2-4d94-abce-539aa59eb2c6 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:05.585574 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817e286-3596-4b84-ae0b-5984fcbe01c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:05.586210 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817e286-3596-4b84-ae0b-5984fcbe01c9 None admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:05.586491 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817e286-3596-4b84-ae0b-5984fcbe01c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:05.586768 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817e286-3596-4b84-ae0b-5984fcbe01c9 None admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:05.587439 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9817e286-3596-4b84-ae0b-5984fcbe01c9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:05.588975 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9817e286-3596-4b84-ae0b-5984fcbe01c9 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:05.626848 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 23/46] 10.222.0.91 () {60 vars in 1141 bytes} [Tue Aug 30 04:13:05 2022] POST /identity/v3/projects => generated 312 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:13:07.504276 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583296b-278e-4a6c-a713-487a97664e54 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:07.504871 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583296b-278e-4a6c-a713-487a97664e54 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:07.504871 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583296b-278e-4a6c-a713-487a97664e54 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:07.506194 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 24/47] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:13:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:13:07.511803 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621bb141-9685-4685-9bea-14727ab7856f None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:07.512341 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621bb141-9685-4685-9bea-14727ab7856f None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:07.512341 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621bb141-9685-4685-9bea-14727ab7856f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:07.532243 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-621bb141-9685-4685-9bea-14727ab7856f None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:07.533780 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-621bb141-9685-4685-9bea-14727ab7856f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:07.548572 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3e9d2-7802-4e4f-924c-4fda528b0512 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:07.548974 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3e9d2-7802-4e4f-924c-4fda528b0512 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:07.549313 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3e9d2-7802-4e4f-924c-4fda528b0512 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:07.550731 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 25/48] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:13:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:13:07.555740 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98de36-cf34-42d4-8765-07d449987a70 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:07.556058 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98de36-cf34-42d4-8765-07d449987a70 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:07.556336 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98de36-cf34-42d4-8765-07d449987a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:07.576524 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-ff98de36-cf34-42d4-8765-07d449987a70 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:07.577757 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-ff98de36-cf34-42d4-8765-07d449987a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:07.612768 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 24/49] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:13:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:13:07.650788 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 26/50] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:13:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:13:07.878255 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621bb141-9685-4685-9bea-14727ab7856f None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:07.914388 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff98de36-cf34-42d4-8765-07d449987a70 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:07.935403 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:07.956228 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:08.001419 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621bb141-9685-4685-9bea-14727ab7856f None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:08.030319 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff98de36-cf34-42d4-8765-07d449987a70 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:08.037290 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae02f6a6-ddbf-472b-b166-8a5af2203353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:08.037937 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02f6a6-ddbf-472b-b166-8a5af2203353 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:08.038202 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02f6a6-ddbf-472b-b166-8a5af2203353 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:08.038478 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02f6a6-ddbf-472b-b166-8a5af2203353 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:08.049437 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae02f6a6-ddbf-472b-b166-8a5af2203353 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:13:08.054417 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-ae02f6a6-ddbf-472b-b166-8a5af2203353 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:13:08.054417 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:13:08.054417 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:13:08.054417 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:13:08.054417 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:13:08.054417 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:13:08.054417 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:13:08.054417 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:13:08.054417 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:13:08.054417 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:13:08.054417 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:13:08.054417 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:13:08.054417 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:13:08.054417 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:13:08.054417 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:13:08.054417 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:13:08.055281 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:13:08.055281 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:13:08.055281 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:13:08.055281 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:13:08.055281 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:13:08.055281 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:13:08.055281 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:13:08.055281 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:13:08.055281 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:13:08.055281 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:13:08.055281 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:13:08.055281 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:13:08.055281 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:13:08.055281 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:13:08.055281 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:13:08.055281 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:13:08.056099 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:13:08.056099 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:13:08.056099 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:13:08.056099 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:13:08.056099 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:13:08.056099 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:13:08.056099 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:13:08.056099 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:13:08.056099 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:13:08.056099 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:13:08.056099 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:13:08.056099 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:13:08.056099 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 25/51] 10.222.0.91 () {56 vars in 1096 bytes} [Tue Aug 30 04:13:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:13:08.061691 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae02f6a6-ddbf-472b-b166-8a5af2203353 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:08.071169 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ac79d-d916-42cb-96f6-8cbcb66542dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:08.072287 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ac79d-d916-42cb-96f6-8cbcb66542dd None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:08.072775 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ac79d-d916-42cb-96f6-8cbcb66542dd None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:08.073259 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ac79d-d916-42cb-96f6-8cbcb66542dd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:08.075199 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60ac79d-d916-42cb-96f6-8cbcb66542dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:08.077974 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60ac79d-d916-42cb-96f6-8cbcb66542dd None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:08.080941 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 27/52] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:13:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:13:08.086542 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ac79d-d916-42cb-96f6-8cbcb66542dd None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:08.164827 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae02f6a6-ddbf-472b-b166-8a5af2203353 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:08.177465 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:08.191060 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:08.194924 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ac79d-d916-42cb-96f6-8cbcb66542dd None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:08.203165 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99583fd9-71ad-40ae-a0b4-36c73161eb30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:08.203781 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99583fd9-71ad-40ae-a0b4-36c73161eb30 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:08.204095 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99583fd9-71ad-40ae-a0b4-36c73161eb30 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:08.204368 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99583fd9-71ad-40ae-a0b4-36c73161eb30 None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:08.205040 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99583fd9-71ad-40ae-a0b4-36c73161eb30 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:08.205342 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99583fd9-71ad-40ae-a0b4-36c73161eb30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:08.206788 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99583fd9-71ad-40ae-a0b4-36c73161eb30 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:08.219928 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 26/53] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 30 04:13:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:13:08.225541 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99583fd9-71ad-40ae-a0b4-36c73161eb30 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:08.234985 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e7c1d-218e-4f67-97bb-5a92dde6ddf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:08.235622 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e7c1d-218e-4f67-97bb-5a92dde6ddf6 None admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:08.235926 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e7c1d-218e-4f67-97bb-5a92dde6ddf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:08.236475 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e7c1d-218e-4f67-97bb-5a92dde6ddf6 None admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:08.237160 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e7c1d-218e-4f67-97bb-5a92dde6ddf6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:08.238677 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e7c1d-218e-4f67-97bb-5a92dde6ddf6 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:08.271987 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 28/54] 10.222.0.91 () {60 vars in 1140 bytes} [Tue Aug 30 04:13:08 2022] POST /identity/v3/projects => generated 298 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:13:08.449731 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99583fd9-71ad-40ae-a0b4-36c73161eb30 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:08.485541 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc54b1-a46b-4177-8ed2-aec4a7ef22b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:08.486187 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc54b1-a46b-4177-8ed2-aec4a7ef22b0 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:08.486473 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc54b1-a46b-4177-8ed2-aec4a7ef22b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:08.486753 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc54b1-a46b-4177-8ed2-aec4a7ef22b0 None admin] PATH_INFO: `/v3/users/7a4a4a4d468841a8acfbd6ef778ab3bd` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:08.487975 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbc54b1-a46b-4177-8ed2-aec4a7ef22b0 None admin] RBAC: Authorizing `identity:get_user(user_id=7a4a4a4d468841a8acfbd6ef778ab3bd)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:08.489457 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbc54b1-a46b-4177-8ed2-aec4a7ef22b0 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:08.491070 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 27/55] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 30 04:13:08 2022] GET /identity/v3/users/7a4a4a4d468841a8acfbd6ef778ab3bd => generated 247 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:13:08.496995 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e7c1d-218e-4f67-97bb-5a92dde6ddf6 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:08.599326 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e7c1d-218e-4f67-97bb-5a92dde6ddf6 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:08.634337 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee6792e-f371-44fa-9ab2-26256ac316f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:08.634996 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6792e-f371-44fa-9ab2-26256ac316f6 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:08.635303 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6792e-f371-44fa-9ab2-26256ac316f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:08.635559 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6792e-f371-44fa-9ab2-26256ac316f6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:08.636775 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee6792e-f371-44fa-9ab2-26256ac316f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:08.638377 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee6792e-f371-44fa-9ab2-26256ac316f6 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:08.640167 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 29/56] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:13:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:08.646038 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc54b1-a46b-4177-8ed2-aec4a7ef22b0 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:08.703208 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:08.755711 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc54b1-a46b-4177-8ed2-aec4a7ef22b0 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:08.790646 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4365116f-aca0-425b-bc1e-e2526224216f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:08.791287 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4365116f-aca0-425b-bc1e-e2526224216f None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:08.791565 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4365116f-aca0-425b-bc1e-e2526224216f None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:08.791830 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4365116f-aca0-425b-bc1e-e2526224216f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:08.792693 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4365116f-aca0-425b-bc1e-e2526224216f None admin] RBAC: Adding query filter params (role.id=d8f440a82947486ebb20a633ebee736b, scope.domain.id=default, user.id=7a4a4a4d468841a8acfbd6ef778ab3bd) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:08.793049 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4365116f-aca0-425b-bc1e-e2526224216f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:08.794851 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4365116f-aca0-425b-bc1e-e2526224216f None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:08.804510 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 28/57] 10.222.0.91 () {56 vars in 1322 bytes} [Tue Aug 30 04:13:08 2022] GET /identity/v3/role_assignments?user.id=7a4a4a4d468841a8acfbd6ef778ab3bd&scope.domain.id=default&role.id=d8f440a82947486ebb20a633ebee736b => generated 530 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:10.220168 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6239e-308f-4067-814b-cb3c8c2d545a None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:10.220730 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6239e-308f-4067-814b-cb3c8c2d545a None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:10.220730 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6239e-308f-4067-814b-cb3c8c2d545a None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:10.222040 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 30/58] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:13:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:13:10.227233 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf59f0-60a1-474d-ac2e-bd4870fc82d4 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:10.227668 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf59f0-60a1-474d-ac2e-bd4870fc82d4 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:10.227898 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf59f0-60a1-474d-ac2e-bd4870fc82d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:10.247205 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-57cf59f0-60a1-474d-ac2e-bd4870fc82d4 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:10.248464 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-57cf59f0-60a1-474d-ac2e-bd4870fc82d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:10.322365 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 29/59] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:13:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:13:10.591292 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf6239e-308f-4067-814b-cb3c8c2d545a None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:10.601295 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:10.700614 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf6239e-308f-4067-814b-cb3c8c2d545a None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:10.744359 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077926d0-c51d-4eae-ba19-8ba3c1bac6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:10.745005 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077926d0-c51d-4eae-ba19-8ba3c1bac6cc None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:10.745289 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077926d0-c51d-4eae-ba19-8ba3c1bac6cc None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:10.745560 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077926d0-c51d-4eae-ba19-8ba3c1bac6cc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:10.746795 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077926d0-c51d-4eae-ba19-8ba3c1bac6cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:10.748420 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077926d0-c51d-4eae-ba19-8ba3c1bac6cc None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:10.750128 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 31/60] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:13:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:10.756192 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cf59f0-60a1-474d-ac2e-bd4870fc82d4 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:10.809380 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:10.861519 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cf59f0-60a1-474d-ac2e-bd4870fc82d4 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:10.898652 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a64dd7-3ea5-4630-a211-56e2a820475b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:10.899261 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a64dd7-3ea5-4630-a211-56e2a820475b None admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:10.899568 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a64dd7-3ea5-4630-a211-56e2a820475b None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:10.899837 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a64dd7-3ea5-4630-a211-56e2a820475b None admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:10.900534 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a64dd7-3ea5-4630-a211-56e2a820475b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:10.902056 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a64dd7-3ea5-4630-a211-56e2a820475b None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:10.931799 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 30/61] 10.222.0.91 () {60 vars in 1132 bytes} [Tue Aug 30 04:13:10 2022] POST /identity/v3/users => generated 275 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:13:14.066085 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e8b90-1c1f-4694-b8fd-11033622587d None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:14.066925 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e8b90-1c1f-4694-b8fd-11033622587d None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:14.067342 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e8b90-1c1f-4694-b8fd-11033622587d None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:14.068898 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 32/62] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:13:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:13:14.075361 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94bc59e-50df-489c-b575-e6906df48546 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:14.076346 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94bc59e-50df-489c-b575-e6906df48546 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:14.076637 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94bc59e-50df-489c-b575-e6906df48546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:14.110342 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-a94bc59e-50df-489c-b575-e6906df48546 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:14.110972 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-a94bc59e-50df-489c-b575-e6906df48546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:14.210458 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7411e33-5a45-45b3-82de-233f9d078969 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:14.211098 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7411e33-5a45-45b3-82de-233f9d078969 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:14.211570 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7411e33-5a45-45b3-82de-233f9d078969 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:14.213446 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 33/63] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:13:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:13:14.215178 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 31/64] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:13:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:13:14.219819 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b195f4b-28b5-46db-a7bd-a171fee42c48 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:14.220452 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b195f4b-28b5-46db-a7bd-a171fee42c48 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:14.220920 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b195f4b-28b5-46db-a7bd-a171fee42c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:14.260664 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-0b195f4b-28b5-46db-a7bd-a171fee42c48 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:14.262730 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-0b195f4b-28b5-46db-a7bd-a171fee42c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:14.381633 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 34/65] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:13:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:13:14.472163 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a22ca-1268-433e-9573-a1bc1b6baf09 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:14.472826 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a22ca-1268-433e-9573-a1bc1b6baf09 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:14.473291 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a22ca-1268-433e-9573-a1bc1b6baf09 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:14.474922 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 32/66] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:13:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:13:14.483176 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e26897-4ba7-45f5-883c-c95191bf4b53 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:14.483460 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e26897-4ba7-45f5-883c-c95191bf4b53 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:14.483898 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e26897-4ba7-45f5-883c-c95191bf4b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:14.497226 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:14.516320 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-75e26897-4ba7-45f5-883c-c95191bf4b53 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:14.516320 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-75e26897-4ba7-45f5-883c-c95191bf4b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:14.640915 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 35/67] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:13:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:13:14.642230 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a22ca-1268-433e-9573-a1bc1b6baf09 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:14.712771 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:14.752663 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e26897-4ba7-45f5-883c-c95191bf4b53 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:14.813866 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a22ca-1268-433e-9573-a1bc1b6baf09 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:14.873078 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dc3bc9-5e38-4589-8495-652ff1cd29ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:14.874026 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc3bc9-5e38-4589-8495-652ff1cd29ad None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:14.874449 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc3bc9-5e38-4589-8495-652ff1cd29ad None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:14.874972 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc3bc9-5e38-4589-8495-652ff1cd29ad None admin] PATH_INFO: `/v3/roles/member` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:14.888216 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dc3bc9-5e38-4589-8495-652ff1cd29ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:13:14.889539 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e26897-4ba7-45f5-883c-c95191bf4b53 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:14.895163 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-21dc3bc9-5e38-4589-8495-652ff1cd29ad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:13:14.895163 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:13:14.895163 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:13:14.895163 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:13:14.895163 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:13:14.895163 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:13:14.895163 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:13:14.895163 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:13:14.895163 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:13:14.895163 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:13:14.895163 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:13:14.895163 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:13:14.895163 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:13:14.895163 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:13:14.895163 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:13:14.895163 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:13:14.896266 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:13:14.896266 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:13:14.896266 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:13:14.896266 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:13:14.896266 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:13:14.896266 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:13:14.896266 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:13:14.896266 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:13:14.896266 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:13:14.896266 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:13:14.896266 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:13:14.896266 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:13:14.896266 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:13:14.896266 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:13:14.896266 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:13:14.896266 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:13:14.897146 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:13:14.897146 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:13:14.897146 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:13:14.897146 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:13:14.897146 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:13:14.897146 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:13:14.897146 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:13:14.897146 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:13:14.897146 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:13:14.897146 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:13:14.897146 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:13:14.897146 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:13:14.897146 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 33/68] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 30 04:13:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:13:14.901515 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a8aaa-ab9f-4315-9dd1-7d4a7f1ad630 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:14.902271 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a8aaa-ab9f-4315-9dd1-7d4a7f1ad630 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:14.902781 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a8aaa-ab9f-4315-9dd1-7d4a7f1ad630 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:14.905454 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 34/69] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:13:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:13:14.906279 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a8aaa-ab9f-4315-9dd1-7d4a7f1ad630 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:14.947155 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece64177-efe3-4fb2-8ed0-5f940aea0677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:14.948307 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece64177-efe3-4fb2-8ed0-5f940aea0677 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:14.948799 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece64177-efe3-4fb2-8ed0-5f940aea0677 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:14.949213 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece64177-efe3-4fb2-8ed0-5f940aea0677 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:14.951486 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:14.962861 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece64177-efe3-4fb2-8ed0-5f940aea0677 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:13:14.968106 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-ece64177-efe3-4fb2-8ed0-5f940aea0677 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:13:14.968106 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:13:14.968106 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:13:14.968106 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:13:14.968106 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:13:14.968106 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:13:14.968106 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:13:14.968106 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:13:14.968106 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:13:14.968106 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:13:14.968106 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:13:14.968106 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:13:14.968106 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:13:14.968106 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:13:14.968106 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:13:14.968106 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:13:14.969172 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:13:14.969172 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:13:14.969172 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:13:14.969172 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:13:14.969172 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:13:14.969172 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:13:14.969172 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:13:14.969172 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:13:14.969172 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:13:14.969172 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:13:14.969172 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:13:14.969172 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:13:14.969172 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:13:14.969172 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:13:14.969172 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:13:14.969172 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:13:14.970022 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:13:14.970022 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:13:14.970022 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:13:14.970022 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:13:14.970022 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:13:14.970022 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:13:14.970022 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:13:14.970022 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:13:14.970022 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:13:14.970022 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:13:14.970022 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:13:14.970022 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:13:14.971890 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 36/70] 10.222.0.91 () {56 vars in 1096 bytes} [Tue Aug 30 04:13:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:13:14.973909 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962f10f-763a-4e20-b1fb-55fa3114d79a None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:14.974375 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962f10f-763a-4e20-b1fb-55fa3114d79a None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:14.974794 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962f10f-763a-4e20-b1fb-55fa3114d79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:14.996364 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-a962f10f-763a-4e20-b1fb-55fa3114d79a None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:14.997900 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-a962f10f-763a-4e20-b1fb-55fa3114d79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:15.030777 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:15.040459 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a8aaa-ab9f-4315-9dd1-7d4a7f1ad630 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:15.083228 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 37/71] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:13:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:13:15.084142 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962f10f-763a-4e20-b1fb-55fa3114d79a None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:15.094384 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aca6fe-aa4e-491e-9137-99e83ee497e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:15.095124 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aca6fe-aa4e-491e-9137-99e83ee497e3 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:15.095396 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aca6fe-aa4e-491e-9137-99e83ee497e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:15.095672 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aca6fe-aa4e-491e-9137-99e83ee497e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:15.097093 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aca6fe-aa4e-491e-9137-99e83ee497e3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:15.097262 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aca6fe-aa4e-491e-9137-99e83ee497e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:15.098892 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aca6fe-aa4e-491e-9137-99e83ee497e3 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:15.109572 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 35/72] 10.222.0.91 () {56 vars in 1101 bytes} [Tue Aug 30 04:13:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:15.110920 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f10d3-b295-4a6e-b491-945c60c8cce5 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:15.111381 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f10d3-b295-4a6e-b491-945c60c8cce5 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:15.111708 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f10d3-b295-4a6e-b491-945c60c8cce5 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:15.113013 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 36/73] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:13:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:13:15.113731 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f10d3-b295-4a6e-b491-945c60c8cce5 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:15.205754 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962f10f-763a-4e20-b1fb-55fa3114d79a None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:15.231954 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f10d3-b295-4a6e-b491-945c60c8cce5 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:15.243369 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:15.256945 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c787495-7a90-4b47-8560-84595ddbe9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:15.257651 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c787495-7a90-4b47-8560-84595ddbe9d0 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:15.257938 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c787495-7a90-4b47-8560-84595ddbe9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:15.258270 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c787495-7a90-4b47-8560-84595ddbe9d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:15.258978 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c787495-7a90-4b47-8560-84595ddbe9d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:15.259363 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c787495-7a90-4b47-8560-84595ddbe9d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:15.260979 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c787495-7a90-4b47-8560-84595ddbe9d0 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:15.273266 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e71eb09-e660-4631-bc38-fd4b15ebf78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:15.278658 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 38/74] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 30 04:13:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:15.278658 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c787495-7a90-4b47-8560-84595ddbe9d0 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:15.280018 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71eb09-e660-4631-bc38-fd4b15ebf78d None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:15.280464 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71eb09-e660-4631-bc38-fd4b15ebf78d None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:15.280747 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71eb09-e660-4631-bc38-fd4b15ebf78d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:15.295521 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e71eb09-e660-4631-bc38-fd4b15ebf78d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:13:15.301539 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-6e71eb09-e660-4631-bc38-fd4b15ebf78d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:13:15.301539 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:13:15.301539 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:13:15.301539 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:13:15.301539 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:13:15.301539 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:13:15.301539 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:13:15.301539 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:13:15.301539 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:13:15.301539 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:13:15.301539 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:13:15.301539 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:13:15.301539 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:13:15.301539 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:13:15.301539 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:13:15.301539 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:13:15.302705 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:13:15.302705 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:13:15.302705 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:13:15.302705 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:13:15.302705 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:13:15.302705 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:13:15.302705 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:13:15.302705 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:13:15.302705 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:13:15.302705 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:13:15.302705 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:13:15.302705 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:13:15.302705 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:13:15.302705 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:13:15.302705 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:13:15.302705 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:13:15.303650 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:13:15.303650 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:13:15.303650 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:13:15.303650 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:13:15.303650 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:13:15.303650 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:13:15.303650 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:13:15.303650 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:13:15.303650 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:13:15.303650 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:13:15.303650 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:13:15.303650 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:13:15.303650 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 37/75] 10.222.0.91 () {56 vars in 1114 bytes} [Tue Aug 30 04:13:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:13:15.304325 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd95ad0-847d-46ce-bd48-8d829f466ea0 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:15.304390 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd95ad0-847d-46ce-bd48-8d829f466ea0 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:15.305154 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd95ad0-847d-46ce-bd48-8d829f466ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:15.325104 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-5dd95ad0-847d-46ce-bd48-8d829f466ea0 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:15.326291 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-5dd95ad0-847d-46ce-bd48-8d829f466ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:15.339069 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:15.402162 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 38/76] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:13:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:13:15.404561 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd95ad0-847d-46ce-bd48-8d829f466ea0 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:15.405209 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c787495-7a90-4b47-8560-84595ddbe9d0 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:15.448297 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e075cfc7-6543-4a68-b6cd-6c8e4485e5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:15.449906 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075cfc7-6543-4a68-b6cd-6c8e4485e5d3 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:15.450420 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075cfc7-6543-4a68-b6cd-6c8e4485e5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:15.450867 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075cfc7-6543-4a68-b6cd-6c8e4485e5d3 None admin] PATH_INFO: `/v3/users/9852d8eb74a94618897a59fe50939721` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:15.470521 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e075cfc7-6543-4a68-b6cd-6c8e4485e5d3 None admin] RBAC: Authorizing `identity:get_user(user_id=9852d8eb74a94618897a59fe50939721)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:15.472723 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e075cfc7-6543-4a68-b6cd-6c8e4485e5d3 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:15.480072 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 39/77] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 30 04:13:15 2022] GET /identity/v3/users/9852d8eb74a94618897a59fe50939721 => generated 275 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:15.480072 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e075cfc7-6543-4a68-b6cd-6c8e4485e5d3 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:15.535407 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd95ad0-847d-46ce-bd48-8d829f466ea0 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:15.535839 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:15.585255 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a3a72-ef90-4c2a-aa5b-b1618695325e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:15.585900 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a3a72-ef90-4c2a-aa5b-b1618695325e None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:15.586181 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a3a72-ef90-4c2a-aa5b-b1618695325e None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:15.586450 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a3a72-ef90-4c2a-aa5b-b1618695325e None admin] PATH_INFO: `/v3/users/7a4a4a4d468841a8acfbd6ef778ab3bd` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:15.587610 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08a3a72-ef90-4c2a-aa5b-b1618695325e None admin] RBAC: Authorizing `identity:get_user(user_id=7a4a4a4d468841a8acfbd6ef778ab3bd)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:15.589129 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08a3a72-ef90-4c2a-aa5b-b1618695325e None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:15.591146 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 39/78] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 30 04:13:15 2022] GET /identity/v3/users/7a4a4a4d468841a8acfbd6ef778ab3bd => generated 247 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:15.596314 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a3a72-ef90-4c2a-aa5b-b1618695325e None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:15.604745 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e075cfc7-6543-4a68-b6cd-6c8e4485e5d3 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:15.613259 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:15.651903 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad14b63a-7191-4d2e-acb9-289df13ac33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:15.652689 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14b63a-7191-4d2e-acb9-289df13ac33f None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:15.652967 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14b63a-7191-4d2e-acb9-289df13ac33f None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:15.653240 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14b63a-7191-4d2e-acb9-289df13ac33f None admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:15.653927 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad14b63a-7191-4d2e-acb9-289df13ac33f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:15.654228 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad14b63a-7191-4d2e-acb9-289df13ac33f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:15.655645 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad14b63a-7191-4d2e-acb9-289df13ac33f None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:15.665499 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 40/79] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 30 04:13:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:15.666459 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad14b63a-7191-4d2e-acb9-289df13ac33f None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:15.712232 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a3a72-ef90-4c2a-aa5b-b1618695325e None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:15.748102 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3509d1-5d0a-4c4d-9753-48c857bec1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:15.748649 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3509d1-5d0a-4c4d-9753-48c857bec1b1 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:15.748921 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3509d1-5d0a-4c4d-9753-48c857bec1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:15.749186 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3509d1-5d0a-4c4d-9753-48c857bec1b1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:15.759603 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3509d1-5d0a-4c4d-9753-48c857bec1b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:13:15.764511 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-fa3509d1-5d0a-4c4d-9753-48c857bec1b1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:13:15.764511 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:13:15.764511 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:13:15.764511 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:13:15.764511 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:13:15.764511 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:13:15.764511 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:13:15.764511 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:13:15.764511 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:13:15.764511 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:13:15.764511 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:13:15.764511 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:13:15.764511 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:13:15.764511 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:13:15.764511 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:13:15.764511 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:13:15.765411 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:13:15.765411 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:13:15.765411 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:13:15.765411 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:13:15.765411 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:13:15.765411 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:13:15.765411 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:13:15.765411 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:13:15.765411 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:13:15.765411 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:13:15.765411 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:13:15.765411 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:13:15.765411 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:13:15.765411 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:13:15.765411 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:13:15.765411 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:13:15.766206 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:13:15.766206 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:13:15.766206 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:13:15.766206 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:13:15.766206 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:13:15.766206 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:13:15.766206 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:13:15.766206 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:13:15.766206 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:13:15.766206 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:13:15.766206 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:13:15.766206 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:13:15.766206 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 40/80] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 30 04:13:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:13:15.766846 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3509d1-5d0a-4c4d-9753-48c857bec1b1 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:15.781790 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad14b63a-7191-4d2e-acb9-289df13ac33f None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:15.789491 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:15.820035 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad73d0b-a479-4638-9535-52fa0abff34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:15.821028 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad73d0b-a479-4638-9535-52fa0abff34f None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:15.821305 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad73d0b-a479-4638-9535-52fa0abff34f None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:15.821574 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad73d0b-a479-4638-9535-52fa0abff34f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:15.851811 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:15.879442 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3509d1-5d0a-4c4d-9753-48c857bec1b1 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:15.898311 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad73d0b-a479-4638-9535-52fa0abff34f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:15.899810 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad73d0b-a479-4638-9535-52fa0abff34f None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:15.927328 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0462ec-a1a8-4f83-ab09-3efb2e38560e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:15.928044 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0462ec-a1a8-4f83-ab09-3efb2e38560e None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:15.928640 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0462ec-a1a8-4f83-ab09-3efb2e38560e None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:15.929065 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0462ec-a1a8-4f83-ab09-3efb2e38560e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:16.001995 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0462ec-a1a8-4f83-ab09-3efb2e38560e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:16.003383 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0462ec-a1a8-4f83-ab09-3efb2e38560e None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:16.007762 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 41/81] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 30 04:13:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:16.008663 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad73d0b-a479-4638-9535-52fa0abff34f None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:16.020765 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:16.085656 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:16.112433 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 41/82] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 30 04:13:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:16.113445 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0462ec-a1a8-4f83-ab09-3efb2e38560e None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:16.118978 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad73d0b-a479-4638-9535-52fa0abff34f None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:16.157544 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c167047c-108c-4fb6-8c1e-3d7646cda4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:16.158186 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167047c-108c-4fb6-8c1e-3d7646cda4b2 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:16.158473 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167047c-108c-4fb6-8c1e-3d7646cda4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:16.158775 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167047c-108c-4fb6-8c1e-3d7646cda4b2 None admin] PATH_INFO: `/v3/users/9852d8eb74a94618897a59fe50939721` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:16.160019 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c167047c-108c-4fb6-8c1e-3d7646cda4b2 None admin] RBAC: Authorizing `identity:get_user(user_id=9852d8eb74a94618897a59fe50939721)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:16.161511 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c167047c-108c-4fb6-8c1e-3d7646cda4b2 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:16.163117 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 42/83] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 30 04:13:16 2022] GET /identity/v3/users/9852d8eb74a94618897a59fe50939721 => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:16.163883 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c167047c-108c-4fb6-8c1e-3d7646cda4b2 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:16.226907 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0462ec-a1a8-4f83-ab09-3efb2e38560e None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:16.242466 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:16.270422 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dfec23-418d-4469-ae1c-ee4c711876dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:16.270629 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c167047c-108c-4fb6-8c1e-3d7646cda4b2 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:16.270971 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dfec23-418d-4469-ae1c-ee4c711876dc None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:16.271252 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dfec23-418d-4469-ae1c-ee4c711876dc None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:16.271528 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dfec23-418d-4469-ae1c-ee4c711876dc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:16.272692 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dfec23-418d-4469-ae1c-ee4c711876dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:16.274179 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dfec23-418d-4469-ae1c-ee4c711876dc None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:16.275769 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 42/84] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:13:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:16.276694 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dfec23-418d-4469-ae1c-ee4c711876dc None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:16.305358 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbac425-a5e0-4c41-87fb-7a2070ed7f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:16.305963 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbac425-a5e0-4c41-87fb-7a2070ed7f80 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:16.306244 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbac425-a5e0-4c41-87fb-7a2070ed7f80 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:16.306525 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbac425-a5e0-4c41-87fb-7a2070ed7f80 None admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:16.307182 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbac425-a5e0-4c41-87fb-7a2070ed7f80 None admin] RBAC: Adding query filter params (name=member) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:16.307493 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbac425-a5e0-4c41-87fb-7a2070ed7f80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:16.309836 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbac425-a5e0-4c41-87fb-7a2070ed7f80 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:16.318736 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 43/85] 10.222.0.91 () {56 vars in 1101 bytes} [Tue Aug 30 04:13:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:16.319590 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbac425-a5e0-4c41-87fb-7a2070ed7f80 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:16.325402 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:16.387301 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dfec23-418d-4469-ae1c-ee4c711876dc None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:16.423575 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc748d-dcf2-47a4-bf8b-dc16b8b6580d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:16.424238 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc748d-dcf2-47a4-bf8b-dc16b8b6580d None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:16.424514 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc748d-dcf2-47a4-bf8b-dc16b8b6580d None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:16.424802 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc748d-dcf2-47a4-bf8b-dc16b8b6580d None admin] PATH_INFO: `/v3/projects/dd52e349f605416891993a08a2251fcc` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:16.425983 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc748d-dcf2-47a4-bf8b-dc16b8b6580d None admin] RBAC: Authorizing `identity:get_project(project_id=dd52e349f605416891993a08a2251fcc)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:16.427461 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc748d-dcf2-47a4-bf8b-dc16b8b6580d None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:16.429323 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 43/86] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 30 04:13:16 2022] GET /identity/v3/projects/dd52e349f605416891993a08a2251fcc => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:16.429863 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc748d-dcf2-47a4-bf8b-dc16b8b6580d None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:16.440921 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbac425-a5e0-4c41-87fb-7a2070ed7f80 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:16.475175 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427aa28b-c4bb-480d-b77b-b26f9302e7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:16.476670 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427aa28b-c4bb-480d-b77b-b26f9302e7d8 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:16.478091 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427aa28b-c4bb-480d-b77b-b26f9302e7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:16.478373 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427aa28b-c4bb-480d-b77b-b26f9302e7d8 None admin] PATH_INFO: `/v3/projects/dd52e349f605416891993a08a2251fcc` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:16.479599 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427aa28b-c4bb-480d-b77b-b26f9302e7d8 None admin] RBAC: Authorizing `identity:get_project(project_id=dd52e349f605416891993a08a2251fcc)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:16.481678 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427aa28b-c4bb-480d-b77b-b26f9302e7d8 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:16.483478 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 44/87] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 30 04:13:16 2022] GET /identity/v3/projects/dd52e349f605416891993a08a2251fcc => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:16.484282 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427aa28b-c4bb-480d-b77b-b26f9302e7d8 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:16.488446 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:16.536487 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc748d-dcf2-47a4-bf8b-dc16b8b6580d None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:16.548289 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:16.574524 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f057c-001f-43c2-ab86-8b6dd863cab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:16.575138 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f057c-001f-43c2-ab86-8b6dd863cab5 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:16.575418 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f057c-001f-43c2-ab86-8b6dd863cab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:16.575688 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f057c-001f-43c2-ab86-8b6dd863cab5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:16.593248 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427aa28b-c4bb-480d-b77b-b26f9302e7d8 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:16.628255 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db080d-58f1-4266-9cc8-c88e353e9fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:16.628914 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db080d-58f1-4266-9cc8-c88e353e9fbc None admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:16.629193 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db080d-58f1-4266-9cc8-c88e353e9fbc None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:16.629466 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db080d-58f1-4266-9cc8-c88e353e9fbc None admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:16.630117 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db080d-58f1-4266-9cc8-c88e353e9fbc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:16.631535 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db080d-58f1-4266-9cc8-c88e353e9fbc None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:16.648431 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278f057c-001f-43c2-ab86-8b6dd863cab5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:16.650077 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278f057c-001f-43c2-ab86-8b6dd863cab5 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:16.660278 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 45/88] 10.222.0.91 () {60 vars in 1132 bytes} [Tue Aug 30 04:13:16 2022] POST /identity/v3/users => generated 289 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:13:16.660278 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db080d-58f1-4266-9cc8-c88e353e9fbc None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:16.734624 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:16.786099 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 44/89] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 30 04:13:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:16.787108 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f057c-001f-43c2-ab86-8b6dd863cab5 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:16.792467 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db080d-58f1-4266-9cc8-c88e353e9fbc None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:16.800808 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:16.843363 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef825c36-ee47-42ce-a49b-5f4a285ccbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:16.844048 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef825c36-ee47-42ce-a49b-5f4a285ccbcd None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:16.844325 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef825c36-ee47-42ce-a49b-5f4a285ccbcd None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:16.844598 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef825c36-ee47-42ce-a49b-5f4a285ccbcd None admin] PATH_INFO: `/v3/users/9852d8eb74a94618897a59fe50939721` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:16.845943 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef825c36-ee47-42ce-a49b-5f4a285ccbcd None admin] RBAC: Authorizing `identity:get_user(user_id=9852d8eb74a94618897a59fe50939721)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:16.847683 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef825c36-ee47-42ce-a49b-5f4a285ccbcd None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:16.849356 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 46/90] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 30 04:13:16 2022] GET /identity/v3/users/9852d8eb74a94618897a59fe50939721 => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:16.849943 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef825c36-ee47-42ce-a49b-5f4a285ccbcd None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:16.901587 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f057c-001f-43c2-ab86-8b6dd863cab5 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:16.945407 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1850361c-4fd5-448e-b1d2-b71e19e71cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:16.946456 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850361c-4fd5-448e-b1d2-b71e19e71cb0 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:16.946980 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850361c-4fd5-448e-b1d2-b71e19e71cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:16.948184 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850361c-4fd5-448e-b1d2-b71e19e71cb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:16.949404 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1850361c-4fd5-448e-b1d2-b71e19e71cb0 None admin] RBAC: Adding query filter params (role.id=1aaf128d062240b28b37771b36f6b38b, scope.project.id=dd52e349f605416891993a08a2251fcc, user.id=9852d8eb74a94618897a59fe50939721) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:16.949725 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1850361c-4fd5-448e-b1d2-b71e19e71cb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:16.951350 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1850361c-4fd5-448e-b1d2-b71e19e71cb0 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:16.961347 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 45/91] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 30 04:13:16 2022] GET /identity/v3/role_assignments?user.id=9852d8eb74a94618897a59fe50939721&scope.project.id=dd52e349f605416891993a08a2251fcc&role.id=1aaf128d062240b28b37771b36f6b38b => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:16.962264 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1850361c-4fd5-448e-b1d2-b71e19e71cb0 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:17.004170 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef825c36-ee47-42ce-a49b-5f4a285ccbcd None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:17.051837 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:17.068138 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f0936-48ec-4960-b157-056f1bb0d3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:17.069066 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f0936-48ec-4960-b157-056f1bb0d3fe None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:17.069534 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f0936-48ec-4960-b157-056f1bb0d3fe None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:17.070218 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f0936-48ec-4960-b157-056f1bb0d3fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:17.071158 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242f0936-48ec-4960-b157-056f1bb0d3fe None admin] RBAC: Adding query filter params (role.id=d8f440a82947486ebb20a633ebee736b, scope.project.id=dd52e349f605416891993a08a2251fcc, user.id=7a4a4a4d468841a8acfbd6ef778ab3bd) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:17.072381 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242f0936-48ec-4960-b157-056f1bb0d3fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:17.074944 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242f0936-48ec-4960-b157-056f1bb0d3fe None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:17.083198 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 47/92] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 30 04:13:16 2022] GET /identity/v3/role_assignments?user.id=7a4a4a4d468841a8acfbd6ef778ab3bd&scope.project.id=dd52e349f605416891993a08a2251fcc&role.id=d8f440a82947486ebb20a633ebee736b => generated 259 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:17.084801 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:17.085888 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f0936-48ec-4960-b157-056f1bb0d3fe None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:17.155459 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1850361c-4fd5-448e-b1d2-b71e19e71cb0 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:17.231210 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d7fd1c-e99a-4ead-aac8-92dbd74d028f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:17.231898 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7fd1c-e99a-4ead-aac8-92dbd74d028f None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:17.232230 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7fd1c-e99a-4ead-aac8-92dbd74d028f None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:17.232511 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7fd1c-e99a-4ead-aac8-92dbd74d028f None admin] PATH_INFO: `/v3/projects/dd52e349f605416891993a08a2251fcc` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:17.233817 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d7fd1c-e99a-4ead-aac8-92dbd74d028f None admin] RBAC: Authorizing `identity:get_project(project_id=dd52e349f605416891993a08a2251fcc)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:17.235404 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d7fd1c-e99a-4ead-aac8-92dbd74d028f None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:17.237694 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 46/93] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 30 04:13:16 2022] GET /identity/v3/projects/dd52e349f605416891993a08a2251fcc => generated 298 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:17.243959 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d7fd1c-e99a-4ead-aac8-92dbd74d028f None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:17.273780 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f0936-48ec-4960-b157-056f1bb0d3fe None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:17.370082 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d0bb39-d584-41ba-8612-9d0d6f7963f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:17.371304 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0bb39-d584-41ba-8612-9d0d6f7963f1 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:17.371829 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0bb39-d584-41ba-8612-9d0d6f7963f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:17.372321 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0bb39-d584-41ba-8612-9d0d6f7963f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:17.491344 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d7fd1c-e99a-4ead-aac8-92dbd74d028f None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:17.493744 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:17.514947 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d0bb39-d584-41ba-8612-9d0d6f7963f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:17.516901 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d0bb39-d584-41ba-8612-9d0d6f7963f1 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:17.566888 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1244f7fd-6639-49b8-9f6e-4babcc717032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:17.567928 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244f7fd-6639-49b8-9f6e-4babcc717032 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:17.568404 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244f7fd-6639-49b8-9f6e-4babcc717032 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:17.568892 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244f7fd-6639-49b8-9f6e-4babcc717032 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:17.569823 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1244f7fd-6639-49b8-9f6e-4babcc717032 None admin] RBAC: Adding query filter params (role.id=147a152caf8346259b191a633bb4aee0, scope.project.id=dd52e349f605416891993a08a2251fcc, user.id=9852d8eb74a94618897a59fe50939721) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:17.570326 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1244f7fd-6639-49b8-9f6e-4babcc717032 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:17.572252 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1244f7fd-6639-49b8-9f6e-4babcc717032 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:17.586715 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 47/94] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 30 04:13:17 2022] GET /identity/v3/role_assignments?user.id=9852d8eb74a94618897a59fe50939721&scope.project.id=dd52e349f605416891993a08a2251fcc&role.id=147a152caf8346259b191a633bb4aee0 => generated 259 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:13:17.706025 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 48/95] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 30 04:13:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 622 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:17.712156 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1244f7fd-6639-49b8-9f6e-4babcc717032 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:17.724295 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:17.849671 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1244f7fd-6639-49b8-9f6e-4babcc717032 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:17.896932 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b7bcc8-f7ed-4a8f-b5ff-deef1910bf18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:17.897502 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b7bcc8-f7ed-4a8f-b5ff-deef1910bf18 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:17.897786 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b7bcc8-f7ed-4a8f-b5ff-deef1910bf18 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:17.898058 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b7bcc8-f7ed-4a8f-b5ff-deef1910bf18 None admin] PATH_INFO: `/v3/projects/2b413b73a56049a6b808775c7f6ac09d` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:17.899234 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b7bcc8-f7ed-4a8f-b5ff-deef1910bf18 None admin] RBAC: Authorizing `identity:get_project(project_id=2b413b73a56049a6b808775c7f6ac09d)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:17.900764 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b7bcc8-f7ed-4a8f-b5ff-deef1910bf18 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:17.902909 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 48/96] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 30 04:13:17 2022] GET /identity/v3/projects/2b413b73a56049a6b808775c7f6ac09d => generated 312 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:17.908807 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d0bb39-d584-41ba-8612-9d0d6f7963f1 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:18.040320 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:18.052530 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d0bb39-d584-41ba-8612-9d0d6f7963f1 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:18.101761 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51b454a-e9c0-40aa-9a8e-1ddccdcda8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:18.102385 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b454a-e9c0-40aa-9a8e-1ddccdcda8d7 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:18.102664 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b454a-e9c0-40aa-9a8e-1ddccdcda8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:18.102935 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b454a-e9c0-40aa-9a8e-1ddccdcda8d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:18.103759 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51b454a-e9c0-40aa-9a8e-1ddccdcda8d7 None admin] RBAC: Adding query filter params (role.id=1aaf128d062240b28b37771b36f6b38b, scope.project.id=2b413b73a56049a6b808775c7f6ac09d, user.id=9852d8eb74a94618897a59fe50939721) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:18.104092 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51b454a-e9c0-40aa-9a8e-1ddccdcda8d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:18.105834 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51b454a-e9c0-40aa-9a8e-1ddccdcda8d7 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:18.117175 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 49/97] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 30 04:13:17 2022] GET /identity/v3/role_assignments?user.id=9852d8eb74a94618897a59fe50939721&scope.project.id=2b413b73a56049a6b808775c7f6ac09d&role.id=1aaf128d062240b28b37771b36f6b38b => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:19.238819 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b49be-3a5b-4ed1-8f4d-0b55ac35773a None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:19.239377 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b49be-3a5b-4ed1-8f4d-0b55ac35773a None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:19.239377 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b49be-3a5b-4ed1-8f4d-0b55ac35773a None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:19.241021 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 49/98] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:13:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:13:19.246217 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9f48a-70e0-4b8a-b133-2c9ab76d420b None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:19.246835 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9f48a-70e0-4b8a-b133-2c9ab76d420b None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:19.246835 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9f48a-70e0-4b8a-b133-2c9ab76d420b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:19.273050 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-bfb9f48a-70e0-4b8a-b133-2c9ab76d420b None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:19.274287 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-bfb9f48a-70e0-4b8a-b133-2c9ab76d420b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:19.352631 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 50/99] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:13:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:13:19.695354 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599db564-fd12-4874-aff0-b1b872a03222 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:19.695638 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599db564-fd12-4874-aff0-b1b872a03222 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:19.695903 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599db564-fd12-4874-aff0-b1b872a03222 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:19.697282 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 50/100] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:13:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:13:19.703997 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd2b4a-0029-438d-afd7-6882cb6ff2a9 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:19.704351 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd2b4a-0029-438d-afd7-6882cb6ff2a9 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:19.704581 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd2b4a-0029-438d-afd7-6882cb6ff2a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:19.730987 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-1afd2b4a-0029-438d-afd7-6882cb6ff2a9 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:19.732745 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-1afd2b4a-0029-438d-afd7-6882cb6ff2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:19.826925 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 51/101] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:13:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:13:19.909330 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599db564-fd12-4874-aff0-b1b872a03222 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:20.002857 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:20.039070 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599db564-fd12-4874-aff0-b1b872a03222 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:20.084299 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288423c1-1f02-4aba-9940-b6e630a5856f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:20.084986 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288423c1-1f02-4aba-9940-b6e630a5856f None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:20.085277 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288423c1-1f02-4aba-9940-b6e630a5856f None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:20.085557 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288423c1-1f02-4aba-9940-b6e630a5856f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:20.103874 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288423c1-1f02-4aba-9940-b6e630a5856f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:13:20.109224 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-288423c1-1f02-4aba-9940-b6e630a5856f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 04:13:20.109224 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:13:20.109224 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:13:20.109224 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:13:20.109224 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:13:20.109224 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:13:20.109224 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:13:20.109224 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:13:20.109224 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:13:20.109224 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:13:20.109224 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:13:20.109224 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:13:20.109224 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:13:20.109224 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:13:20.109224 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:13:20.109224 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:13:20.110133 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:13:20.110133 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:13:20.110133 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:13:20.110133 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:13:20.110133 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:13:20.110133 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:13:20.110133 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:13:20.110133 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:13:20.110133 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:13:20.110133 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:13:20.110133 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:13:20.110133 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:13:20.110133 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:13:20.110133 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:13:20.110133 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:13:20.110133 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:13:20.110905 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:13:20.110905 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:13:20.110905 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:13:20.110905 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:13:20.110905 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:13:20.110905 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:13:20.110905 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:13:20.110905 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:13:20.110905 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:13:20.110905 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:13:20.110905 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 04:13:20.110905 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:13:20.110905 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 51/102] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 30 04:13:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:13:20.116827 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afd2b4a-0029-438d-afd7-6882cb6ff2a9 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:20.152604 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:20.197695 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa57b5-2d10-4ef2-bcf1-bf9da9c49804 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:20.197974 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa57b5-2d10-4ef2-bcf1-bf9da9c49804 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:20.198162 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa57b5-2d10-4ef2-bcf1-bf9da9c49804 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:20.200755 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 52/103] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:13:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:13:20.206033 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdafa774-14d9-4073-9956-c3a07c4e5897 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:20.206324 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdafa774-14d9-4073-9956-c3a07c4e5897 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:20.206607 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdafa774-14d9-4073-9956-c3a07c4e5897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:20.231881 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-cdafa774-14d9-4073-9956-c3a07c4e5897 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:20.233161 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-cdafa774-14d9-4073-9956-c3a07c4e5897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:20.296153 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afd2b4a-0029-438d-afd7-6882cb6ff2a9 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:20.338778 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7edfdc2-95a2-4f15-ab88-69af44c29c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:20.339456 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7edfdc2-95a2-4f15-ab88-69af44c29c99 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:20.339837 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7edfdc2-95a2-4f15-ab88-69af44c29c99 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:20.340133 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7edfdc2-95a2-4f15-ab88-69af44c29c99 None admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:20.340813 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7edfdc2-95a2-4f15-ab88-69af44c29c99 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:20.341114 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7edfdc2-95a2-4f15-ab88-69af44c29c99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:20.342633 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7edfdc2-95a2-4f15-ab88-69af44c29c99 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:20.347564 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 53/104] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:13:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:13:20.352734 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 52/105] 10.222.0.91 () {56 vars in 1101 bytes} [Tue Aug 30 04:13:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:20.353350 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0afbe9-49b8-4912-a01a-6b95c3cf4009 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:20.353559 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7edfdc2-95a2-4f15-ab88-69af44c29c99 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:20.353719 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0afbe9-49b8-4912-a01a-6b95c3cf4009 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:20.353911 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0afbe9-49b8-4912-a01a-6b95c3cf4009 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:20.355724 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 54/106] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:13:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:13:20.361098 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0afbe9-49b8-4912-a01a-6b95c3cf4009 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:20.454484 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:20.465056 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:20.481635 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7edfdc2-95a2-4f15-ab88-69af44c29c99 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:20.528061 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0afbe9-49b8-4912-a01a-6b95c3cf4009 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:20.528896 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d389786-af55-4173-b8d0-276a56d5032d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:20.529640 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d389786-af55-4173-b8d0-276a56d5032d None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:20.529923 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d389786-af55-4173-b8d0-276a56d5032d None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:20.530195 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d389786-af55-4173-b8d0-276a56d5032d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:20.535138 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d389786-af55-4173-b8d0-276a56d5032d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:20.536842 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d389786-af55-4173-b8d0-276a56d5032d None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:20.538568 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 53/107] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:13:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:20.539756 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c77b73-fbcf-4712-b82a-6a04efe69887 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:20.540059 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c77b73-fbcf-4712-b82a-6a04efe69887 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:20.540330 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c77b73-fbcf-4712-b82a-6a04efe69887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:20.570124 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43d4aae-2428-4c25-a7be-3f92daf44931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:20.570778 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d4aae-2428-4c25-a7be-3f92daf44931 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:20.571059 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d4aae-2428-4c25-a7be-3f92daf44931 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:20.571334 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d4aae-2428-4c25-a7be-3f92daf44931 None admin] PATH_INFO: `/v3/users/5545aa38d0ac4ac0a124d28360b089fc` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:20.578097 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-b2c77b73-fbcf-4712-b82a-6a04efe69887 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:20.579517 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-b2c77b73-fbcf-4712-b82a-6a04efe69887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:20.593356 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43d4aae-2428-4c25-a7be-3f92daf44931 None admin] RBAC: Authorizing `identity:get_user(user_id=5545aa38d0ac4ac0a124d28360b089fc)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:20.594886 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43d4aae-2428-4c25-a7be-3f92daf44931 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:20.599890 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 55/108] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 30 04:13:20 2022] GET /identity/v3/users/5545aa38d0ac4ac0a124d28360b089fc => generated 289 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:13:20.600814 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43d4aae-2428-4c25-a7be-3f92daf44931 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:20.717013 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 54/109] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:13:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:13:20.717910 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c77b73-fbcf-4712-b82a-6a04efe69887 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:20.776141 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43d4aae-2428-4c25-a7be-3f92daf44931 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:20.805224 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:20.819354 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f936a5d-d846-47e0-94f8-51403daad6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:20.820006 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f936a5d-d846-47e0-94f8-51403daad6b7 None admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:20.820294 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f936a5d-d846-47e0-94f8-51403daad6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:20.820572 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f936a5d-d846-47e0-94f8-51403daad6b7 None admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:20.821238 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f936a5d-d846-47e0-94f8-51403daad6b7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:20.822834 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f936a5d-d846-47e0-94f8-51403daad6b7 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:20.824151 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:20.849713 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c77b73-fbcf-4712-b82a-6a04efe69887 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:20.872171 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 56/110] 10.222.0.91 () {60 vars in 1141 bytes} [Tue Aug 30 04:13:20 2022] POST /identity/v3/projects => generated 302 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:13:20.873502 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f936a5d-d846-47e0-94f8-51403daad6b7 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:20.902573 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1b584-617b-4e34-bb76-dde967d48541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:20.903501 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1b584-617b-4e34-bb76-dde967d48541 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:20.903799 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1b584-617b-4e34-bb76-dde967d48541 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:20.904099 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1b584-617b-4e34-bb76-dde967d48541 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:20.993229 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db1b584-617b-4e34-bb76-dde967d48541 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:20.994794 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db1b584-617b-4e34-bb76-dde967d48541 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:21.026447 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f936a5d-d846-47e0-94f8-51403daad6b7 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:21.067032 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b3c20-b01b-4d7f-8b86-b53635be5af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:21.068125 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b3c20-b01b-4d7f-8b86-b53635be5af6 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:21.068613 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b3c20-b01b-4d7f-8b86-b53635be5af6 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:21.068895 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b3c20-b01b-4d7f-8b86-b53635be5af6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:21.081831 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7b3c20-b01b-4d7f-8b86-b53635be5af6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:13:21.087807 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-1e7b3c20-b01b-4d7f-8b86-b53635be5af6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:13:21.087807 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:13:21.087807 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:13:21.087807 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:13:21.087807 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:13:21.087807 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:13:21.087807 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:13:21.087807 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:13:21.087807 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:13:21.087807 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:13:21.087807 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:13:21.087807 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:13:21.087807 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:13:21.087807 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:13:21.087807 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:13:21.087807 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:13:21.088731 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:13:21.088731 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:13:21.088731 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:13:21.088731 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:13:21.088731 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:13:21.088731 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:13:21.088731 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:13:21.088731 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:13:21.088731 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:13:21.088731 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:13:21.088731 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:13:21.088731 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:13:21.088731 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:13:21.088731 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:13:21.088731 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:13:21.088731 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:13:21.089812 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:13:21.089812 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:13:21.089812 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:13:21.089812 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:13:21.089812 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:13:21.089812 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:13:21.089812 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:13:21.089812 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:13:21.089812 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:13:21.089812 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:13:21.089812 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:13:21.089812 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:13:21.091865 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 57/111] 10.222.0.91 () {56 vars in 1096 bytes} [Tue Aug 30 04:13:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:13:21.093525 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032f6a1-49bd-4d96-b24c-fff548856d72 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:21.093967 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032f6a1-49bd-4d96-b24c-fff548856d72 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:21.094408 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032f6a1-49bd-4d96-b24c-fff548856d72 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:21.095868 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 58/112] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:13:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:13:21.097208 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a82d27-65f8-4a6e-96ff-ef56ed9de961 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:21.097630 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a82d27-65f8-4a6e-96ff-ef56ed9de961 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:21.098040 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a82d27-65f8-4a6e-96ff-ef56ed9de961 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:21.099745 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 59/113] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:13:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:13:21.100920 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a82d27-65f8-4a6e-96ff-ef56ed9de961 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:21.122627 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:21.149846 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:21.161963 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 55/114] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 30 04:13:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:21.163722 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b67970-8c5c-40b2-aadc-a7456bff262f None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:21.164090 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b67970-8c5c-40b2-aadc-a7456bff262f None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:21.164370 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b67970-8c5c-40b2-aadc-a7456bff262f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:21.186644 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-95b67970-8c5c-40b2-aadc-a7456bff262f None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:21.187863 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-95b67970-8c5c-40b2-aadc-a7456bff262f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:21.233482 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a82d27-65f8-4a6e-96ff-ef56ed9de961 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:21.272719 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 56/115] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:13:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:13:21.274389 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9c2f2-7985-4a79-9e98-25163bf8782d None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:21.274683 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9c2f2-7985-4a79-9e98-25163bf8782d None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:21.274960 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9c2f2-7985-4a79-9e98-25163bf8782d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:21.291496 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5aaaea-e3a3-4c63-b951-53f2b07d332a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:21.292159 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5aaaea-e3a3-4c63-b951-53f2b07d332a None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:21.292662 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5aaaea-e3a3-4c63-b951-53f2b07d332a None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:21.292662 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5aaaea-e3a3-4c63-b951-53f2b07d332a None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:21.293767 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5aaaea-e3a3-4c63-b951-53f2b07d332a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:21.294439 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5aaaea-e3a3-4c63-b951-53f2b07d332a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:21.295927 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5aaaea-e3a3-4c63-b951-53f2b07d332a None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:21.304811 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-cda9c2f2-7985-4a79-9e98-25163bf8782d None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:21.311623 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 60/116] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 30 04:13:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:21.311623 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5aaaea-e3a3-4c63-b951-53f2b07d332a None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:21.312914 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-cda9c2f2-7985-4a79-9e98-25163bf8782d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:21.421567 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 57/117] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:13:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:13:21.423073 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda9c2f2-7985-4a79-9e98-25163bf8782d None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:21.431805 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:21.440233 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5aaaea-e3a3-4c63-b951-53f2b07d332a None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:21.477897 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:21.518178 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b58840-d989-43c5-873b-3fb82467471b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:21.518841 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b58840-d989-43c5-873b-3fb82467471b None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:21.519124 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b58840-d989-43c5-873b-3fb82467471b None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:21.519398 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b58840-d989-43c5-873b-3fb82467471b None admin] PATH_INFO: `/v3/projects/dd52e349f605416891993a08a2251fcc` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:21.521748 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b58840-d989-43c5-873b-3fb82467471b None admin] RBAC: Authorizing `identity:get_project(project_id=dd52e349f605416891993a08a2251fcc)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:21.524943 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b58840-d989-43c5-873b-3fb82467471b None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:21.527077 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 61/118] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 30 04:13:21 2022] GET /identity/v3/projects/dd52e349f605416891993a08a2251fcc => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:21.528118 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b58840-d989-43c5-873b-3fb82467471b None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:21.578142 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda9c2f2-7985-4a79-9e98-25163bf8782d None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:21.637507 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe4f245-0fe5-4e89-8380-404022845d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:21.638191 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe4f245-0fe5-4e89-8380-404022845d16 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:21.638456 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe4f245-0fe5-4e89-8380-404022845d16 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:21.638728 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe4f245-0fe5-4e89-8380-404022845d16 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:21.664304 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe4f245-0fe5-4e89-8380-404022845d16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:13:21.669548 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-ffe4f245-0fe5-4e89-8380-404022845d16 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:13:21.669548 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:13:21.669548 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:13:21.669548 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:13:21.669548 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:13:21.669548 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:13:21.669548 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:13:21.669548 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:13:21.669548 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:13:21.669548 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:13:21.669548 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:13:21.669548 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:13:21.669548 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:13:21.669548 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:13:21.669548 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:13:21.669548 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:13:21.671058 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:13:21.671058 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:13:21.671058 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:13:21.671058 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:13:21.671058 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:13:21.671058 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:13:21.671058 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:13:21.671058 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:13:21.671058 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:13:21.671058 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:13:21.671058 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:13:21.671058 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:13:21.671058 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:13:21.671058 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:13:21.671058 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:13:21.671058 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:13:21.678813 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:13:21.678813 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:13:21.678813 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:13:21.678813 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:13:21.678813 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:13:21.678813 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:13:21.678813 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:13:21.678813 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:13:21.678813 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:13:21.678813 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:13:21.678813 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:13:21.678813 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:13:21.678813 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 58/119] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 30 04:13:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:13:21.678813 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe4f245-0fe5-4e89-8380-404022845d16 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:21.710665 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b58840-d989-43c5-873b-3fb82467471b None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:21.754701 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427164b7-50c3-4109-bcc1-e3263018ae85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:21.755861 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427164b7-50c3-4109-bcc1-e3263018ae85 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:21.756398 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427164b7-50c3-4109-bcc1-e3263018ae85 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:21.756873 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427164b7-50c3-4109-bcc1-e3263018ae85 None admin] PATH_INFO: `/v3/users/7a4a4a4d468841a8acfbd6ef778ab3bd` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:21.758389 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427164b7-50c3-4109-bcc1-e3263018ae85 None admin] RBAC: Authorizing `identity:get_user(user_id=7a4a4a4d468841a8acfbd6ef778ab3bd)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:21.760162 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427164b7-50c3-4109-bcc1-e3263018ae85 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:21.762899 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 62/120] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 30 04:13:21 2022] GET /identity/v3/users/7a4a4a4d468841a8acfbd6ef778ab3bd => generated 247 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:21.764071 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427164b7-50c3-4109-bcc1-e3263018ae85 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:21.814292 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:21.852366 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:21.859087 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe4f245-0fe5-4e89-8380-404022845d16 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:21.896963 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2983e844-59ce-4350-b4a9-584db022f825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:21.897585 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983e844-59ce-4350-b4a9-584db022f825 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:21.897863 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983e844-59ce-4350-b4a9-584db022f825 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:21.898170 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983e844-59ce-4350-b4a9-584db022f825 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:21.898911 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2983e844-59ce-4350-b4a9-584db022f825 None admin] RBAC: Adding query filter params (role.id=643830a05faa4c2898407ace9a43df40, scope.project.id=dd52e349f605416891993a08a2251fcc, user.id=5545aa38d0ac4ac0a124d28360b089fc) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:21.899200 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2983e844-59ce-4350-b4a9-584db022f825 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:21.900733 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2983e844-59ce-4350-b4a9-584db022f825 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:21.907551 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 59/121] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 30 04:13:21 2022] GET /identity/v3/role_assignments?user.id=5545aa38d0ac4ac0a124d28360b089fc&scope.project.id=dd52e349f605416891993a08a2251fcc&role.id=643830a05faa4c2898407ace9a43df40 => generated 259 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:21.908229 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2983e844-59ce-4350-b4a9-584db022f825 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:21.953482 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427164b7-50c3-4109-bcc1-e3263018ae85 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:22.025071 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25aa81e-be55-4b59-9c92-110a489d1382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:22.025990 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25aa81e-be55-4b59-9c92-110a489d1382 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:22.027103 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25aa81e-be55-4b59-9c92-110a489d1382 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:22.027790 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25aa81e-be55-4b59-9c92-110a489d1382 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:22.054508 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25aa81e-be55-4b59-9c92-110a489d1382 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:13:22.060093 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-e25aa81e-be55-4b59-9c92-110a489d1382 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:13:22.060093 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:13:22.060093 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:13:22.060093 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:13:22.060093 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:13:22.060093 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:13:22.060093 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:13:22.060093 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:13:22.060093 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:13:22.060093 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:13:22.060093 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:13:22.060093 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:13:22.060093 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:13:22.060093 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:13:22.060093 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:13:22.060093 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:13:22.061993 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:13:22.061993 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:13:22.061993 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:13:22.061993 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:13:22.061993 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:13:22.061993 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:13:22.061993 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:13:22.061993 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:13:22.061993 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:13:22.061993 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:13:22.061993 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:13:22.061993 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:13:22.061993 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:13:22.061993 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:13:22.061993 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:13:22.061993 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:13:22.063732 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:13:22.063732 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:13:22.063732 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:13:22.063732 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:13:22.063732 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:13:22.063732 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:13:22.063732 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:13:22.063732 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:13:22.063732 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:13:22.063732 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:13:22.063732 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:13:22.063732 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:13:22.063732 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 63/122] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 30 04:13:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:13:22.063732 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25aa81e-be55-4b59-9c92-110a489d1382 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:22.097794 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2983e844-59ce-4350-b4a9-584db022f825 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:22.193196 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32998c1-9e73-44ed-8c9b-839fd2772c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:22.194228 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32998c1-9e73-44ed-8c9b-839fd2772c29 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:22.194794 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32998c1-9e73-44ed-8c9b-839fd2772c29 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:22.195335 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32998c1-9e73-44ed-8c9b-839fd2772c29 None admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:22.196663 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32998c1-9e73-44ed-8c9b-839fd2772c29 None admin] RBAC: Adding query filter params (name=member) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:22.197204 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32998c1-9e73-44ed-8c9b-839fd2772c29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:22.206704 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32998c1-9e73-44ed-8c9b-839fd2772c29 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:22.212108 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:22.225518 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25aa81e-be55-4b59-9c92-110a489d1382 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:22.243532 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 60/123] 10.222.0.91 () {56 vars in 1101 bytes} [Tue Aug 30 04:13:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:22.251620 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32998c1-9e73-44ed-8c9b-839fd2772c29 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:22.287245 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320daf62-7b7f-411c-9699-20abcd72b5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:22.287245 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320daf62-7b7f-411c-9699-20abcd72b5da None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:22.287245 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320daf62-7b7f-411c-9699-20abcd72b5da None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:22.287245 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320daf62-7b7f-411c-9699-20abcd72b5da None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:22.312345 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320daf62-7b7f-411c-9699-20abcd72b5da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:13:22.318012 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:22.321573 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-320daf62-7b7f-411c-9699-20abcd72b5da None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:13:22.321573 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:13:22.321573 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:13:22.321573 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:13:22.321573 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:13:22.321573 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:13:22.321573 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:13:22.321573 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:13:22.321573 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:13:22.321573 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:13:22.321573 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:13:22.321573 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:13:22.321573 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:13:22.321573 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:13:22.321573 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:13:22.321573 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:13:22.324812 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:13:22.324812 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:13:22.324812 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:13:22.324812 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:13:22.324812 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:13:22.324812 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:13:22.324812 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:13:22.324812 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:13:22.324812 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:13:22.324812 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:13:22.324812 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:13:22.324812 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:13:22.324812 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:13:22.324812 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:13:22.324812 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:13:22.324812 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:13:22.325950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:13:22.325950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:13:22.325950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:13:22.325950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:13:22.325950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:13:22.325950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:13:22.325950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:13:22.325950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:13:22.325950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:13:22.325950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:13:22.325950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:13:22.325950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:13:22.325950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 64/124] 10.222.0.91 () {56 vars in 1114 bytes} [Tue Aug 30 04:13:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:13:22.325950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320daf62-7b7f-411c-9699-20abcd72b5da None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:22.506762 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320daf62-7b7f-411c-9699-20abcd72b5da None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:22.568636 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65882ce-82f1-4e69-a1a4-c0d880dd4657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:22.569374 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65882ce-82f1-4e69-a1a4-c0d880dd4657 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:22.569746 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65882ce-82f1-4e69-a1a4-c0d880dd4657 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:22.570086 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65882ce-82f1-4e69-a1a4-c0d880dd4657 None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:22.571260 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65882ce-82f1-4e69-a1a4-c0d880dd4657 None admin] RBAC: Adding query filter params (name=member) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:22.571260 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65882ce-82f1-4e69-a1a4-c0d880dd4657 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:22.573413 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65882ce-82f1-4e69-a1a4-c0d880dd4657 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:22.583185 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 65/125] 10.222.0.91 () {56 vars in 1101 bytes} [Tue Aug 30 04:13:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:22.589507 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65882ce-82f1-4e69-a1a4-c0d880dd4657 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:22.590799 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32998c1-9e73-44ed-8c9b-839fd2772c29 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:22.624246 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:22.673686 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b915a-1f3f-4f8e-91b7-79214e612091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:22.675492 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b915a-1f3f-4f8e-91b7-79214e612091 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:22.676567 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b915a-1f3f-4f8e-91b7-79214e612091 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:22.677461 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b915a-1f3f-4f8e-91b7-79214e612091 None admin] PATH_INFO: `/v3/projects/dd52e349f605416891993a08a2251fcc` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:22.680776 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3b915a-1f3f-4f8e-91b7-79214e612091 None admin] RBAC: Authorizing `identity:get_project(project_id=dd52e349f605416891993a08a2251fcc)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:22.683669 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3b915a-1f3f-4f8e-91b7-79214e612091 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:22.690548 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 61/126] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 30 04:13:22 2022] GET /identity/v3/projects/dd52e349f605416891993a08a2251fcc => generated 298 bytes in 446 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:22.692247 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b915a-1f3f-4f8e-91b7-79214e612091 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:22.793214 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65882ce-82f1-4e69-a1a4-c0d880dd4657 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:22.855603 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c86c62-ae6a-4fcb-8bbf-2852fa0bd8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:22.857139 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c86c62-ae6a-4fcb-8bbf-2852fa0bd8cc None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:22.858009 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c86c62-ae6a-4fcb-8bbf-2852fa0bd8cc None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:22.858476 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c86c62-ae6a-4fcb-8bbf-2852fa0bd8cc None admin] PATH_INFO: `/v3/users/9852d8eb74a94618897a59fe50939721` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:22.860032 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c86c62-ae6a-4fcb-8bbf-2852fa0bd8cc None admin] RBAC: Authorizing `identity:get_user(user_id=9852d8eb74a94618897a59fe50939721)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:22.862409 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c86c62-ae6a-4fcb-8bbf-2852fa0bd8cc None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:22.864452 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:22.865433 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 66/127] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 30 04:13:22 2022] GET /identity/v3/users/9852d8eb74a94618897a59fe50939721 => generated 275 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:22.872780 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c86c62-ae6a-4fcb-8bbf-2852fa0bd8cc None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:22.881495 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b915a-1f3f-4f8e-91b7-79214e612091 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:22.922735 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33426d87-ecd9-4b05-8f25-17c6e9a850e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:22.923063 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33426d87-ecd9-4b05-8f25-17c6e9a850e8 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:22.923492 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33426d87-ecd9-4b05-8f25-17c6e9a850e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:22.923860 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33426d87-ecd9-4b05-8f25-17c6e9a850e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:22.924662 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33426d87-ecd9-4b05-8f25-17c6e9a850e8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:22.925029 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33426d87-ecd9-4b05-8f25-17c6e9a850e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:22.926540 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33426d87-ecd9-4b05-8f25-17c6e9a850e8 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:22.937059 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 62/128] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 30 04:13:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:22.938315 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33426d87-ecd9-4b05-8f25-17c6e9a850e8 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:22.986305 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:23.015269 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c86c62-ae6a-4fcb-8bbf-2852fa0bd8cc None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:23.061709 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33426d87-ecd9-4b05-8f25-17c6e9a850e8 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:23.074337 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0492c33-a601-4ec4-8083-b854261520f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:23.076185 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0492c33-a601-4ec4-8083-b854261520f4 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:23.076663 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0492c33-a601-4ec4-8083-b854261520f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:23.077121 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0492c33-a601-4ec4-8083-b854261520f4 None admin] PATH_INFO: `/v3/users/9852d8eb74a94618897a59fe50939721` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:23.079408 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0492c33-a601-4ec4-8083-b854261520f4 None admin] RBAC: Authorizing `identity:get_user(user_id=9852d8eb74a94618897a59fe50939721)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:23.081804 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0492c33-a601-4ec4-8083-b854261520f4 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:23.084172 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 67/129] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 30 04:13:22 2022] GET /identity/v3/users/9852d8eb74a94618897a59fe50939721 => generated 275 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:23.085180 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0492c33-a601-4ec4-8083-b854261520f4 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:23.111344 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec120cc-ed14-4c31-af7c-c619ca61dc2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:23.112426 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec120cc-ed14-4c31-af7c-c619ca61dc2c None admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:23.112886 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec120cc-ed14-4c31-af7c-c619ca61dc2c None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:23.113380 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec120cc-ed14-4c31-af7c-c619ca61dc2c None admin] PATH_INFO: `/v3/projects/dd52e349f605416891993a08a2251fcc/users/7a4a4a4d468841a8acfbd6ef778ab3bd/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:23.116872 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec120cc-ed14-4c31-af7c-c619ca61dc2c None admin] RBAC: Authorizing `identity:create_grant(project_id=dd52e349f605416891993a08a2251fcc, user_id=7a4a4a4d468841a8acfbd6ef778ab3bd, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:23.120185 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec120cc-ed14-4c31-af7c-c619ca61dc2c None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:23.140249 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 63/130] 10.222.0.91 () {58 vars in 1439 bytes} [Tue Aug 30 04:13:22 2022] PUT /identity/v3/projects/dd52e349f605416891993a08a2251fcc/users/7a4a4a4d468841a8acfbd6ef778ab3bd/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:13:23.142065 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec120cc-ed14-4c31-af7c-c619ca61dc2c None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:23.186506 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:23.242122 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0492c33-a601-4ec4-8083-b854261520f4 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:23.285005 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f46610-6483-4b88-8a6d-c7b32fa6c989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:23.286048 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f46610-6483-4b88-8a6d-c7b32fa6c989 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:23.286529 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f46610-6483-4b88-8a6d-c7b32fa6c989 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:23.287001 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f46610-6483-4b88-8a6d-c7b32fa6c989 None admin] PATH_INFO: `/v3/projects/dd52e349f605416891993a08a2251fcc` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:23.288519 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f46610-6483-4b88-8a6d-c7b32fa6c989 None admin] RBAC: Authorizing `identity:get_project(project_id=dd52e349f605416891993a08a2251fcc)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:23.290247 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f46610-6483-4b88-8a6d-c7b32fa6c989 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:23.293491 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 68/131] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 30 04:13:23 2022] GET /identity/v3/projects/dd52e349f605416891993a08a2251fcc => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:23.299743 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f46610-6483-4b88-8a6d-c7b32fa6c989 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:23.335946 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:23.392101 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec120cc-ed14-4c31-af7c-c619ca61dc2c None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:23.446945 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5873ea-a837-4cf4-be8a-e0ca3ae343ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:23.448078 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5873ea-a837-4cf4-be8a-e0ca3ae343ad None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:23.448806 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5873ea-a837-4cf4-be8a-e0ca3ae343ad None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:23.449331 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5873ea-a837-4cf4-be8a-e0ca3ae343ad None admin] PATH_INFO: `/v3/users/9852d8eb74a94618897a59fe50939721` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:23.451681 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5873ea-a837-4cf4-be8a-e0ca3ae343ad None admin] RBAC: Authorizing `identity:get_user(user_id=9852d8eb74a94618897a59fe50939721)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:23.453376 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5873ea-a837-4cf4-be8a-e0ca3ae343ad None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:23.455497 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 64/132] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 30 04:13:23 2022] GET /identity/v3/users/9852d8eb74a94618897a59fe50939721 => generated 275 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:23.456396 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5873ea-a837-4cf4-be8a-e0ca3ae343ad None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:23.519387 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f46610-6483-4b88-8a6d-c7b32fa6c989 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:23.563047 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d0264-6ce6-4921-9177-0b92cfa2577b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:23.563726 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d0264-6ce6-4921-9177-0b92cfa2577b None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:23.564050 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d0264-6ce6-4921-9177-0b92cfa2577b None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:23.564328 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d0264-6ce6-4921-9177-0b92cfa2577b None admin] PATH_INFO: `/v3/projects/2b413b73a56049a6b808775c7f6ac09d` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:23.565609 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8d0264-6ce6-4921-9177-0b92cfa2577b None admin] RBAC: Authorizing `identity:get_project(project_id=2b413b73a56049a6b808775c7f6ac09d)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:23.567083 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8d0264-6ce6-4921-9177-0b92cfa2577b None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:23.569059 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 69/133] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 30 04:13:23 2022] GET /identity/v3/projects/2b413b73a56049a6b808775c7f6ac09d => generated 312 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:23.572607 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d0264-6ce6-4921-9177-0b92cfa2577b None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:23.683457 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:23.702505 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:23.721882 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d0264-6ce6-4921-9177-0b92cfa2577b None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:23.764104 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f5107e-9e06-4078-ad6c-1ac7604fb1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:23.765174 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5107e-9e06-4078-ad6c-1ac7604fb1b7 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:23.765719 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5107e-9e06-4078-ad6c-1ac7604fb1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:23.766179 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5107e-9e06-4078-ad6c-1ac7604fb1b7 None admin] PATH_INFO: `/v3/projects/dd52e349f605416891993a08a2251fcc` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:23.767667 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f5107e-9e06-4078-ad6c-1ac7604fb1b7 None admin] RBAC: Authorizing `identity:get_project(project_id=dd52e349f605416891993a08a2251fcc)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:23.769537 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f5107e-9e06-4078-ad6c-1ac7604fb1b7 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:23.771838 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 70/134] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 30 04:13:23 2022] GET /identity/v3/projects/dd52e349f605416891993a08a2251fcc => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:23.773048 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f5107e-9e06-4078-ad6c-1ac7604fb1b7 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:23.776423 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5873ea-a837-4cf4-be8a-e0ca3ae343ad None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:23.870387 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d716489-7ae9-4b6c-8d24-89cedbab68a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:23.871585 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d716489-7ae9-4b6c-8d24-89cedbab68a9 None admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:23.872110 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d716489-7ae9-4b6c-8d24-89cedbab68a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:23.872523 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d716489-7ae9-4b6c-8d24-89cedbab68a9 None admin] PATH_INFO: `/v3/projects/dd52e349f605416891993a08a2251fcc/users/9852d8eb74a94618897a59fe50939721/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:23.882562 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d716489-7ae9-4b6c-8d24-89cedbab68a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=dd52e349f605416891993a08a2251fcc, user_id=9852d8eb74a94618897a59fe50939721, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:23.885606 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d716489-7ae9-4b6c-8d24-89cedbab68a9 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:23.929670 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f5107e-9e06-4078-ad6c-1ac7604fb1b7 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:23.938586 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 65/135] 10.222.0.91 () {58 vars in 1439 bytes} [Tue Aug 30 04:13:23 2022] PUT /identity/v3/projects/dd52e349f605416891993a08a2251fcc/users/9852d8eb74a94618897a59fe50939721/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:13:23.939487 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d716489-7ae9-4b6c-8d24-89cedbab68a9 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:23.996757 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e866be2-569b-43f2-9a22-20bf8521c8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:23.998453 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e866be2-569b-43f2-9a22-20bf8521c8d6 None admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:23.999330 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e866be2-569b-43f2-9a22-20bf8521c8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:24.000034 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e866be2-569b-43f2-9a22-20bf8521c8d6 None admin] PATH_INFO: `/v3/projects/2b413b73a56049a6b808775c7f6ac09d/users/9852d8eb74a94618897a59fe50939721/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:24.004143 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e866be2-569b-43f2-9a22-20bf8521c8d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=2b413b73a56049a6b808775c7f6ac09d, user_id=9852d8eb74a94618897a59fe50939721, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:24.007332 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e866be2-569b-43f2-9a22-20bf8521c8d6 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:24.039466 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 71/136] 10.222.0.91 () {58 vars in 1439 bytes} [Tue Aug 30 04:13:23 2022] PUT /identity/v3/projects/2b413b73a56049a6b808775c7f6ac09d/users/9852d8eb74a94618897a59fe50939721/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:13:24.043476 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84767762-acb4-4d3d-8d83-28c0d775b479 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:24.044398 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84767762-acb4-4d3d-8d83-28c0d775b479 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:24.044868 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84767762-acb4-4d3d-8d83-28c0d775b479 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:24.048285 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 72/137] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:13:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:13:24.058733 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7504bc7-f9a9-4afe-a755-020f449a81fc None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:24.059515 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7504bc7-f9a9-4afe-a755-020f449a81fc None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:24.060152 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7504bc7-f9a9-4afe-a755-020f449a81fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:24.096974 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-b7504bc7-f9a9-4afe-a755-020f449a81fc None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:24.099205 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-b7504bc7-f9a9-4afe-a755-020f449a81fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:24.121355 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:24.192400 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d716489-7ae9-4b6c-8d24-89cedbab68a9 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:24.242089 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 73/138] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:13:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 04:13:24.274819 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e261b78d-c4cd-4c40-bb86-beb2da75c4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:24.276319 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e261b78d-c4cd-4c40-bb86-beb2da75c4a8 None admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:24.277284 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e261b78d-c4cd-4c40-bb86-beb2da75c4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:24.278094 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e261b78d-c4cd-4c40-bb86-beb2da75c4a8 None admin] PATH_INFO: `/v3/projects/dd52e349f605416891993a08a2251fcc/users/9852d8eb74a94618897a59fe50939721/roles/147a152caf8346259b191a633bb4aee0` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:24.285078 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e261b78d-c4cd-4c40-bb86-beb2da75c4a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=dd52e349f605416891993a08a2251fcc, user_id=9852d8eb74a94618897a59fe50939721, role_id=147a152caf8346259b191a633bb4aee0)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:24.288437 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e261b78d-c4cd-4c40-bb86-beb2da75c4a8 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:24.314977 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:24.326824 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 66/139] 10.222.0.91 () {58 vars in 1439 bytes} [Tue Aug 30 04:13:23 2022] PUT /identity/v3/projects/dd52e349f605416891993a08a2251fcc/users/9852d8eb74a94618897a59fe50939721/roles/147a152caf8346259b191a633bb4aee0 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:13:24.928960 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7504bc7-f9a9-4afe-a755-020f449a81fc None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:25.128315 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7504bc7-f9a9-4afe-a755-020f449a81fc None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:25.193231 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c2b0cf-93f0-4e86-ad6c-a4797d2683ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:25.194260 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2b0cf-93f0-4e86-ad6c-a4797d2683ca None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:25.195132 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2b0cf-93f0-4e86-ad6c-a4797d2683ca None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:25.195593 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2b0cf-93f0-4e86-ad6c-a4797d2683ca None admin] PATH_INFO: `/v3/domains/default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:25.197677 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c2b0cf-93f0-4e86-ad6c-a4797d2683ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:25.200778 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c2b0cf-93f0-4e86-ad6c-a4797d2683ca None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:25.204144 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 74/140] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:13:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:25.213732 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e261b78d-c4cd-4c40-bb86-beb2da75c4a8 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:25.345118 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4494d72-349a-4ab5-a9b0-357424bf631c None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:25.345609 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4494d72-349a-4ab5-a9b0-357424bf631c None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:25.345983 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4494d72-349a-4ab5-a9b0-357424bf631c None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:25.348479 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 75/141] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:13:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:13:25.368939 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2264225-b057-4bc9-b053-71a69de909c5 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:25.369219 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2264225-b057-4bc9-b053-71a69de909c5 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:25.369501 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2264225-b057-4bc9-b053-71a69de909c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:25.414102 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-d2264225-b057-4bc9-b053-71a69de909c5 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:25.416176 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-d2264225-b057-4bc9-b053-71a69de909c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:25.442236 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:25.487752 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e261b78d-c4cd-4c40-bb86-beb2da75c4a8 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:25.607022 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb88b49-747c-4ec7-9d21-34417a6be1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:25.608177 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb88b49-747c-4ec7-9d21-34417a6be1b7 None admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:25.608668 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb88b49-747c-4ec7-9d21-34417a6be1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:25.609133 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb88b49-747c-4ec7-9d21-34417a6be1b7 None admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:25.610408 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb88b49-747c-4ec7-9d21-34417a6be1b7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:25.613165 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb88b49-747c-4ec7-9d21-34417a6be1b7 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:25.652596 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 76/142] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:13:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 04:13:25.692283 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 67/143] 10.222.0.91 () {60 vars in 1132 bytes} [Tue Aug 30 04:13:25 2022] POST /identity/v3/users => generated 283 bytes in 479 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:13:26.189303 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2264225-b057-4bc9-b053-71a69de909c5 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:26.443658 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2264225-b057-4bc9-b053-71a69de909c5 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:26.534741 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb442cb3-7d79-40bd-a01d-580cd30dc688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:26.535868 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb442cb3-7d79-40bd-a01d-580cd30dc688 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:26.536384 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb442cb3-7d79-40bd-a01d-580cd30dc688 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:26.536878 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb442cb3-7d79-40bd-a01d-580cd30dc688 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:26.571992 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb442cb3-7d79-40bd-a01d-580cd30dc688 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:13:26.579813 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-fb442cb3-7d79-40bd-a01d-580cd30dc688 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 04:13:26.579813 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:13:26.579813 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:13:26.579813 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:13:26.579813 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:13:26.579813 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:13:26.579813 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:13:26.579813 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:13:26.579813 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:13:26.579813 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:13:26.579813 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:13:26.579813 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:13:26.579813 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:13:26.579813 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:13:26.579813 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:13:26.579813 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:13:26.581503 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:13:26.581503 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:13:26.581503 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:13:26.581503 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:13:26.581503 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:13:26.581503 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:13:26.581503 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:13:26.581503 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:13:26.581503 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:13:26.581503 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:13:26.581503 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:13:26.581503 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:13:26.581503 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:13:26.581503 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:13:26.581503 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:13:26.581503 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:13:26.582926 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:13:26.582926 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:13:26.582926 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:13:26.582926 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:13:26.582926 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:13:26.582926 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:13:26.582926 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:13:26.582926 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:13:26.582926 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:13:26.582926 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:13:26.582926 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 04:13:26.582926 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:13:26.582926 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 77/144] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 30 04:13:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:13:26.589557 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb88b49-747c-4ec7-9d21-34417a6be1b7 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:26.766086 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:26.839678 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb88b49-747c-4ec7-9d21-34417a6be1b7 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:26.918175 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcde8c4-818b-4a93-8b66-73729592a2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:26.919455 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcde8c4-818b-4a93-8b66-73729592a2df None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:26.919879 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcde8c4-818b-4a93-8b66-73729592a2df None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:26.920320 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcde8c4-818b-4a93-8b66-73729592a2df None admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:26.921374 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcde8c4-818b-4a93-8b66-73729592a2df None admin] RBAC: Adding query filter params (name=reader) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:26.921826 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcde8c4-818b-4a93-8b66-73729592a2df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:26.924106 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcde8c4-818b-4a93-8b66-73729592a2df None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:26.942433 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 68/145] 10.222.0.91 () {56 vars in 1101 bytes} [Tue Aug 30 04:13:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:26.950676 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb442cb3-7d79-40bd-a01d-580cd30dc688 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:26.956195 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:27.164144 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb442cb3-7d79-40bd-a01d-580cd30dc688 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:27.211616 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46de8d1-75e6-497e-ba48-33b1fc6ab945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:27.214009 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46de8d1-75e6-497e-ba48-33b1fc6ab945 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:27.214790 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46de8d1-75e6-497e-ba48-33b1fc6ab945 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:27.215642 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46de8d1-75e6-497e-ba48-33b1fc6ab945 None admin] PATH_INFO: `/v3/users/5545aa38d0ac4ac0a124d28360b089fc` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:27.217545 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46de8d1-75e6-497e-ba48-33b1fc6ab945 None admin] RBAC: Authorizing `identity:get_user(user_id=5545aa38d0ac4ac0a124d28360b089fc)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:27.219563 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46de8d1-75e6-497e-ba48-33b1fc6ab945 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:27.222010 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 78/146] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 30 04:13:26 2022] GET /identity/v3/users/5545aa38d0ac4ac0a124d28360b089fc => generated 289 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:13:27.230493 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcde8c4-818b-4a93-8b66-73729592a2df None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:27.418282 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcde8c4-818b-4a93-8b66-73729592a2df None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:27.439810 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:27.464117 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d7cd55-9c59-41cc-863a-e1cdb1448298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:27.464909 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d7cd55-9c59-41cc-863a-e1cdb1448298 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:27.465184 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d7cd55-9c59-41cc-863a-e1cdb1448298 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:27.465492 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d7cd55-9c59-41cc-863a-e1cdb1448298 None admin] PATH_INFO: `/v3/projects/dd52e349f605416891993a08a2251fcc` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:27.466780 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d7cd55-9c59-41cc-863a-e1cdb1448298 None admin] RBAC: Authorizing `identity:get_project(project_id=dd52e349f605416891993a08a2251fcc)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:27.468324 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d7cd55-9c59-41cc-863a-e1cdb1448298 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:27.470343 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 69/147] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 30 04:13:27 2022] GET /identity/v3/projects/dd52e349f605416891993a08a2251fcc => generated 298 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:27.477032 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46de8d1-75e6-497e-ba48-33b1fc6ab945 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:27.583289 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:27.594035 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfbeb79-89c2-4de2-9424-ed6297f0e587 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:27.595683 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfbeb79-89c2-4de2-9424-ed6297f0e587 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:27.596531 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfbeb79-89c2-4de2-9424-ed6297f0e587 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:27.605355 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 70/148] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:13:27 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:13:27.612160 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8331a-b84b-4aee-991d-5cf8241f624e None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:27.613068 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8331a-b84b-4aee-991d-5cf8241f624e None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:27.613786 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8331a-b84b-4aee-991d-5cf8241f624e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:27.627965 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46de8d1-75e6-497e-ba48-33b1fc6ab945 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:27.674679 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e850d49-607b-45e8-85bf-cf77adce129f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:27.675305 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e850d49-607b-45e8-85bf-cf77adce129f None admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:27.675586 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e850d49-607b-45e8-85bf-cf77adce129f None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:27.675859 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e850d49-607b-45e8-85bf-cf77adce129f None admin] PATH_INFO: `/v3/projects/dd52e349f605416891993a08a2251fcc/users/5545aa38d0ac4ac0a124d28360b089fc/roles/643830a05faa4c2898407ace9a43df40` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:27.676669 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-44b8331a-b84b-4aee-991d-5cf8241f624e None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:27.678156 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-44b8331a-b84b-4aee-991d-5cf8241f624e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:27.681642 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e850d49-607b-45e8-85bf-cf77adce129f None admin] RBAC: Authorizing `identity:create_grant(project_id=dd52e349f605416891993a08a2251fcc, user_id=5545aa38d0ac4ac0a124d28360b089fc, role_id=643830a05faa4c2898407ace9a43df40)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:27.684078 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e850d49-607b-45e8-85bf-cf77adce129f None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:27.715973 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 79/149] 10.222.0.91 () {58 vars in 1439 bytes} [Tue Aug 30 04:13:27 2022] PUT /identity/v3/projects/dd52e349f605416891993a08a2251fcc/users/5545aa38d0ac4ac0a124d28360b089fc/roles/643830a05faa4c2898407ace9a43df40 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:13:27.806273 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 71/150] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:13:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 04:13:28.194482 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648d610-e1bb-4cb4-9899-c6e4b1784f02 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:28.195117 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648d610-e1bb-4cb4-9899-c6e4b1784f02 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:28.195534 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648d610-e1bb-4cb4-9899-c6e4b1784f02 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:28.197099 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 80/151] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:13:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:13:28.204248 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b103a52-da00-42cd-84bf-340c6069a6f5 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:28.204797 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b103a52-da00-42cd-84bf-340c6069a6f5 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:28.205210 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b103a52-da00-42cd-84bf-340c6069a6f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:28.227478 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-9b103a52-da00-42cd-84bf-340c6069a6f5 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:28.228981 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-9b103a52-da00-42cd-84bf-340c6069a6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:28.314192 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 72/152] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:13:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:13:28.360604 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea8058-ece0-4af8-9506-927fa233fd71 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:28.361476 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea8058-ece0-4af8-9506-927fa233fd71 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:28.361954 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea8058-ece0-4af8-9506-927fa233fd71 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:28.363631 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 81/153] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:13:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:13:28.369643 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560eb9d7-2a30-491e-a16c-5ccbe23d55bb None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:28.370552 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560eb9d7-2a30-491e-a16c-5ccbe23d55bb None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:28.371131 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560eb9d7-2a30-491e-a16c-5ccbe23d55bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:28.393250 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-560eb9d7-2a30-491e-a16c-5ccbe23d55bb None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:28.396041 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea8058-ece0-4af8-9506-927fa233fd71 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:28.407787 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-560eb9d7-2a30-491e-a16c-5ccbe23d55bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:28.518634 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:28.570516 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 73/154] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:13:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:13:28.572512 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4cb29-2729-4d91-8f36-dd21a6776e4a None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:28.573003 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4cb29-2729-4d91-8f36-dd21a6776e4a None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:28.573521 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4cb29-2729-4d91-8f36-dd21a6776e4a None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:28.575428 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 74/155] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:13:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:13:28.581536 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9869cd9d-0ef8-499b-861b-d3217896e28f None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:28.582166 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9869cd9d-0ef8-499b-861b-d3217896e28f None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:28.582635 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9869cd9d-0ef8-499b-861b-d3217896e28f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:28.611393 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-9869cd9d-0ef8-499b-861b-d3217896e28f None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:28.614145 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-9869cd9d-0ef8-499b-861b-d3217896e28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:28.665365 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea8058-ece0-4af8-9506-927fa233fd71 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:28.725884 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 75/156] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:13:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 04:13:28.744049 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:28.759983 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f6796b-47f5-415a-921b-1d8bdde477d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:28.760655 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6796b-47f5-415a-921b-1d8bdde477d5 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:28.761163 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6796b-47f5-415a-921b-1d8bdde477d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:28.761578 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6796b-47f5-415a-921b-1d8bdde477d5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:28.789143 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f6796b-47f5-415a-921b-1d8bdde477d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:13:28.795332 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-b7f6796b-47f5-415a-921b-1d8bdde477d5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:13:28.795332 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:13:28.795332 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:13:28.795332 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:13:28.795332 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:13:28.795332 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:13:28.795332 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:13:28.795332 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:13:28.795332 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:13:28.795332 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:13:28.795332 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:13:28.795332 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:13:28.795332 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:13:28.795332 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:13:28.795332 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:13:28.795332 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:13:28.796349 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:13:28.796349 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:13:28.796349 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:13:28.796349 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:13:28.796349 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:13:28.796349 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:13:28.796349 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:13:28.796349 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:13:28.796349 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:13:28.796349 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:13:28.796349 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:13:28.796349 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:13:28.796349 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:13:28.796349 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:13:28.796349 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:13:28.796349 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:13:28.797783 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:13:28.797783 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:13:28.797783 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:13:28.797783 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:13:28.797783 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:13:28.797783 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:13:28.797783 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:13:28.797783 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:13:28.797783 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:13:28.797783 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:13:28.797783 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:13:28.797783 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:13:28.797783 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 82/157] 10.222.0.91 () {56 vars in 1096 bytes} [Tue Aug 30 04:13:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 401 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:13:28.802681 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9869cd9d-0ef8-499b-861b-d3217896e28f None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:28.912926 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f6796b-47f5-415a-921b-1d8bdde477d5 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:28.956779 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9869cd9d-0ef8-499b-861b-d3217896e28f None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:28.968188 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:29.007574 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100c8c39-9bf4-4fa5-8b80-7d740d87aeea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:29.008716 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c8c39-9bf4-4fa5-8b80-7d740d87aeea None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:29.009237 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c8c39-9bf4-4fa5-8b80-7d740d87aeea None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:29.009704 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c8c39-9bf4-4fa5-8b80-7d740d87aeea None admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:29.010663 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100c8c39-9bf4-4fa5-8b80-7d740d87aeea None admin] RBAC: Adding query filter params (name=admin) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:29.011484 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100c8c39-9bf4-4fa5-8b80-7d740d87aeea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:29.015206 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100c8c39-9bf4-4fa5-8b80-7d740d87aeea None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:29.035703 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 76/158] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 30 04:13:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:29.045043 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100c8c39-9bf4-4fa5-8b80-7d740d87aeea None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:29.194911 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f6796b-47f5-415a-921b-1d8bdde477d5 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:29.280223 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100c8c39-9bf4-4fa5-8b80-7d740d87aeea None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:29.286328 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c07652-af08-416f-8f69-25c83afe6bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:29.286328 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c07652-af08-416f-8f69-25c83afe6bb3 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:29.286328 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c07652-af08-416f-8f69-25c83afe6bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:29.286328 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c07652-af08-416f-8f69-25c83afe6bb3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:29.315484 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c07652-af08-416f-8f69-25c83afe6bb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:13:29.320463 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-76c07652-af08-416f-8f69-25c83afe6bb3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:13:29.320463 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:13:29.320463 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:13:29.320463 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:13:29.320463 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:13:29.320463 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:13:29.320463 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:13:29.320463 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:13:29.320463 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:13:29.320463 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:13:29.320463 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:13:29.320463 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:13:29.320463 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:13:29.320463 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:13:29.320463 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:13:29.320463 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:13:29.322772 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:13:29.322772 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:13:29.322772 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:13:29.322772 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:13:29.322772 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:13:29.322772 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:13:29.322772 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:13:29.322772 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:13:29.322772 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:13:29.322772 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:13:29.322772 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:13:29.322772 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:13:29.322772 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:13:29.322772 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:13:29.322772 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:13:29.322772 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:13:29.324142 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:13:29.324142 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:13:29.324142 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:13:29.324142 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:13:29.324142 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:13:29.324142 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:13:29.324142 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:13:29.324142 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:13:29.324142 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:13:29.324142 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:13:29.324142 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:13:29.324142 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:13:29.324142 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 83/159] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 30 04:13:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 409 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:13:29.328963 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c07652-af08-416f-8f69-25c83afe6bb3 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:29.377257 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d281d-dad3-4995-8550-0943846212da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:29.378356 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d281d-dad3-4995-8550-0943846212da None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:29.379077 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d281d-dad3-4995-8550-0943846212da None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:29.379590 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d281d-dad3-4995-8550-0943846212da None admin] PATH_INFO: `/v3/users/7a4a4a4d468841a8acfbd6ef778ab3bd` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:29.381066 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0d281d-dad3-4995-8550-0943846212da None admin] RBAC: Authorizing `identity:get_user(user_id=7a4a4a4d468841a8acfbd6ef778ab3bd)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:29.382777 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0d281d-dad3-4995-8550-0943846212da None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:29.384657 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 77/160] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 30 04:13:29 2022] GET /identity/v3/users/7a4a4a4d468841a8acfbd6ef778ab3bd => generated 247 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:29.390431 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d281d-dad3-4995-8550-0943846212da None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:29.440664 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:29.501591 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:29.537986 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d281d-dad3-4995-8550-0943846212da None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:29.616072 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c07652-af08-416f-8f69-25c83afe6bb3 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:29.621058 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378004b0-348b-435e-8342-405c2a65b601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:29.621878 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378004b0-348b-435e-8342-405c2a65b601 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:29.622162 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378004b0-348b-435e-8342-405c2a65b601 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:29.622439 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378004b0-348b-435e-8342-405c2a65b601 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:29.648464 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378004b0-348b-435e-8342-405c2a65b601 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:13:29.655696 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-378004b0-348b-435e-8342-405c2a65b601 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:13:29.655696 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:13:29.655696 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:13:29.655696 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:13:29.655696 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:13:29.655696 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:13:29.655696 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:13:29.655696 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:13:29.655696 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:13:29.655696 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:13:29.655696 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:13:29.655696 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:13:29.655696 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:13:29.655696 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:13:29.655696 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:13:29.655696 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:13:29.656752 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:13:29.656752 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:13:29.656752 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:13:29.656752 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:13:29.656752 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:13:29.656752 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:13:29.656752 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:13:29.656752 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:13:29.656752 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:13:29.656752 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:13:29.656752 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:13:29.656752 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:13:29.656752 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:13:29.656752 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:13:29.656752 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:13:29.656752 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:13:29.657512 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:13:29.657512 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:13:29.657512 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:13:29.657512 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:13:29.657512 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:13:29.657512 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:13:29.657512 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:13:29.657512 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:13:29.657512 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:13:29.657512 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:13:29.657512 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:13:29.657512 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:13:29.658937 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 78/161] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 30 04:13:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:13:29.659827 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378004b0-348b-435e-8342-405c2a65b601 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:29.660503 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccabb777-6229-42b0-903d-e124e59cb11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:29.661157 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccabb777-6229-42b0-903d-e124e59cb11d None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:29.661428 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccabb777-6229-42b0-903d-e124e59cb11d None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:29.661690 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccabb777-6229-42b0-903d-e124e59cb11d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:29.688315 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccabb777-6229-42b0-903d-e124e59cb11d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:13:29.701859 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-ccabb777-6229-42b0-903d-e124e59cb11d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:13:29.701859 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:13:29.701859 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:13:29.701859 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:13:29.701859 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:13:29.701859 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:13:29.701859 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:13:29.701859 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:13:29.701859 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:13:29.701859 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:13:29.701859 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:13:29.701859 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:13:29.701859 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:13:29.701859 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:13:29.701859 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:13:29.701859 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:13:29.704188 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:13:29.704188 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:13:29.704188 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:13:29.704188 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:13:29.704188 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:13:29.704188 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:13:29.704188 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:13:29.704188 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:13:29.704188 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:13:29.704188 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:13:29.704188 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:13:29.704188 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:13:29.704188 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:13:29.704188 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:13:29.704188 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:13:29.704188 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:13:29.706403 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:13:29.706403 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:13:29.706403 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:13:29.706403 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:13:29.706403 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:13:29.706403 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:13:29.706403 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:13:29.706403 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:13:29.706403 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:13:29.706403 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:13:29.706403 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:13:29.706403 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:13:29.706403 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 84/162] 10.222.0.91 () {56 vars in 1114 bytes} [Tue Aug 30 04:13:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:13:29.706403 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccabb777-6229-42b0-903d-e124e59cb11d None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:29.905429 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378004b0-348b-435e-8342-405c2a65b601 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:29.943427 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:29.952397 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e8e08-0cf9-42b8-a230-4a6e18d30228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:29.953156 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e8e08-0cf9-42b8-a230-4a6e18d30228 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:29.953439 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e8e08-0cf9-42b8-a230-4a6e18d30228 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:29.953716 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e8e08-0cf9-42b8-a230-4a6e18d30228 None admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:29.954418 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e8e08-0cf9-42b8-a230-4a6e18d30228 None admin] RBAC: Adding query filter params (name=member) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:29.954724 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e8e08-0cf9-42b8-a230-4a6e18d30228 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:29.956253 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e8e08-0cf9-42b8-a230-4a6e18d30228 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:29.972355 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 79/163] 10.222.0.91 () {56 vars in 1101 bytes} [Tue Aug 30 04:13:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:29.973308 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e8e08-0cf9-42b8-a230-4a6e18d30228 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:30.017079 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccabb777-6229-42b0-903d-e124e59cb11d None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:30.046377 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:30.117001 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a6181-f6d5-4f9c-9a69-7e392ff36c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:30.117649 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a6181-f6d5-4f9c-9a69-7e392ff36c62 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:30.117964 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a6181-f6d5-4f9c-9a69-7e392ff36c62 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:30.118198 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a6181-f6d5-4f9c-9a69-7e392ff36c62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:30.193329 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e8e08-0cf9-42b8-a230-4a6e18d30228 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:30.209922 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056a6181-f6d5-4f9c-9a69-7e392ff36c62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:30.209922 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056a6181-f6d5-4f9c-9a69-7e392ff36c62 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:30.260131 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff1726-fd44-4000-8f79-fb33df967201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:30.261240 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff1726-fd44-4000-8f79-fb33df967201 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:30.261730 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff1726-fd44-4000-8f79-fb33df967201 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:30.262307 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff1726-fd44-4000-8f79-fb33df967201 None admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:30.263309 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff1726-fd44-4000-8f79-fb33df967201 None admin] RBAC: Adding query filter params (name=member) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:30.263847 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff1726-fd44-4000-8f79-fb33df967201 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:30.265738 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff1726-fd44-4000-8f79-fb33df967201 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:30.286912 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 80/164] 10.222.0.91 () {56 vars in 1101 bytes} [Tue Aug 30 04:13:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:30.288271 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff1726-fd44-4000-8f79-fb33df967201 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:30.352256 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 85/165] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 30 04:13:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 649 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:30.353165 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a6181-f6d5-4f9c-9a69-7e392ff36c62 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:30.355095 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:30.377065 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:30.585497 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a6181-f6d5-4f9c-9a69-7e392ff36c62 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:30.608074 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff1726-fd44-4000-8f79-fb33df967201 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:30.656535 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e24630c-d95d-4dd1-8389-1b6693885b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:30.657216 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e24630c-d95d-4dd1-8389-1b6693885b54 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:30.657498 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e24630c-d95d-4dd1-8389-1b6693885b54 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:30.657772 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e24630c-d95d-4dd1-8389-1b6693885b54 None admin] PATH_INFO: `/v3/users/9852d8eb74a94618897a59fe50939721` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:30.664906 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e24630c-d95d-4dd1-8389-1b6693885b54 None admin] RBAC: Authorizing `identity:get_user(user_id=9852d8eb74a94618897a59fe50939721)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:30.666458 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e24630c-d95d-4dd1-8389-1b6693885b54 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:30.668379 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 86/166] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 30 04:13:30 2022] GET /identity/v3/users/9852d8eb74a94618897a59fe50939721 => generated 275 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:30.669597 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e24630c-d95d-4dd1-8389-1b6693885b54 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:30.745552 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e4d53-adce-4a00-8568-c0516c3683da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:30.746666 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e4d53-adce-4a00-8568-c0516c3683da None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:30.746666 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e4d53-adce-4a00-8568-c0516c3683da None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:30.746917 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e4d53-adce-4a00-8568-c0516c3683da None admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:30.749964 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64e4d53-adce-4a00-8568-c0516c3683da None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:30.749964 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64e4d53-adce-4a00-8568-c0516c3683da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:30.749964 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64e4d53-adce-4a00-8568-c0516c3683da None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:30.764628 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:30.777439 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 81/167] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 30 04:13:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 489 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:30.777439 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e4d53-adce-4a00-8568-c0516c3683da None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:30.792356 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e24630c-d95d-4dd1-8389-1b6693885b54 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:30.865839 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8973ea-9524-41df-91f8-5fd44fdb8d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:30.866515 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8973ea-9524-41df-91f8-5fd44fdb8d4b None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:30.866796 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8973ea-9524-41df-91f8-5fd44fdb8d4b None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:30.867067 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8973ea-9524-41df-91f8-5fd44fdb8d4b None admin] PATH_INFO: `/v3/users/9852d8eb74a94618897a59fe50939721` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:30.872998 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8973ea-9524-41df-91f8-5fd44fdb8d4b None admin] RBAC: Authorizing `identity:get_user(user_id=9852d8eb74a94618897a59fe50939721)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:30.874769 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8973ea-9524-41df-91f8-5fd44fdb8d4b None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:30.876691 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 87/168] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 30 04:13:30 2022] GET /identity/v3/users/9852d8eb74a94618897a59fe50939721 => generated 275 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:30.878146 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8973ea-9524-41df-91f8-5fd44fdb8d4b None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:30.947315 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:30.991570 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e4d53-adce-4a00-8568-c0516c3683da None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:31.058302 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac153b-86d5-42a3-997f-964e207d1247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:31.059481 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac153b-86d5-42a3-997f-964e207d1247 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:31.060360 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac153b-86d5-42a3-997f-964e207d1247 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:31.061034 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac153b-86d5-42a3-997f-964e207d1247 None admin] PATH_INFO: `/v3/projects/dd52e349f605416891993a08a2251fcc` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:31.062680 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ac153b-86d5-42a3-997f-964e207d1247 None admin] RBAC: Authorizing `identity:get_project(project_id=dd52e349f605416891993a08a2251fcc)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:31.065112 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ac153b-86d5-42a3-997f-964e207d1247 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:31.068336 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 82/169] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 30 04:13:30 2022] GET /identity/v3/projects/dd52e349f605416891993a08a2251fcc => generated 298 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:31.069855 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac153b-86d5-42a3-997f-964e207d1247 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:31.107975 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8973ea-9524-41df-91f8-5fd44fdb8d4b None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:31.160123 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4166b9c-01d8-4ce2-957c-6d194db97330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:31.160659 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4166b9c-01d8-4ce2-957c-6d194db97330 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:31.160936 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4166b9c-01d8-4ce2-957c-6d194db97330 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:31.161208 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4166b9c-01d8-4ce2-957c-6d194db97330 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:31.185324 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:31.300275 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac153b-86d5-42a3-997f-964e207d1247 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:31.303003 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4166b9c-01d8-4ce2-957c-6d194db97330 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:31.304588 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4166b9c-01d8-4ce2-957c-6d194db97330 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:31.371512 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e447a9-06d4-4836-9345-187c022728a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:31.373124 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e447a9-06d4-4836-9345-187c022728a0 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:31.374051 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e447a9-06d4-4836-9345-187c022728a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:31.374872 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e447a9-06d4-4836-9345-187c022728a0 None admin] PATH_INFO: `/v3/users/9852d8eb74a94618897a59fe50939721` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:31.377829 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e447a9-06d4-4836-9345-187c022728a0 None admin] RBAC: Authorizing `identity:get_user(user_id=9852d8eb74a94618897a59fe50939721)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:31.381075 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e447a9-06d4-4836-9345-187c022728a0 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:31.385552 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 83/170] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 30 04:13:31 2022] GET /identity/v3/users/9852d8eb74a94618897a59fe50939721 => generated 275 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:31.388367 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b83d72-0bc6-4527-9733-2704ef6db992 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:31.388856 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b83d72-0bc6-4527-9733-2704ef6db992 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:31.389343 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b83d72-0bc6-4527-9733-2704ef6db992 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:31.392333 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 84/171] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:13:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:13:31.393716 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b83d72-0bc6-4527-9733-2704ef6db992 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:31.425691 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:31.470118 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 88/172] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 30 04:13:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 593 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:31.471408 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4166b9c-01d8-4ce2-957c-6d194db97330 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:31.559630 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:31.565904 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b83d72-0bc6-4527-9733-2704ef6db992 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:31.610300 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290dc62-9302-41cd-805a-cef31aefdb63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:31.610925 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290dc62-9302-41cd-805a-cef31aefdb63 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:31.611204 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290dc62-9302-41cd-805a-cef31aefdb63 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:31.611474 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290dc62-9302-41cd-805a-cef31aefdb63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:31.658143 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4166b9c-01d8-4ce2-957c-6d194db97330 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:31.702512 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4290dc62-9302-41cd-805a-cef31aefdb63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:31.703358 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e13066b-cc67-49f9-a46f-51cbc959cb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:31.703958 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4290dc62-9302-41cd-805a-cef31aefdb63 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:31.704130 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13066b-cc67-49f9-a46f-51cbc959cb29 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:31.704279 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13066b-cc67-49f9-a46f-51cbc959cb29 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:31.704537 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13066b-cc67-49f9-a46f-51cbc959cb29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:31.705288 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e13066b-cc67-49f9-a46f-51cbc959cb29 None admin] RBAC: Adding query filter params (role.id=d8f440a82947486ebb20a633ebee736b, scope.project.id=dd52e349f605416891993a08a2251fcc, user.id=7a4a4a4d468841a8acfbd6ef778ab3bd) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:31.705596 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e13066b-cc67-49f9-a46f-51cbc959cb29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:31.707082 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e13066b-cc67-49f9-a46f-51cbc959cb29 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:31.714232 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 89/173] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 30 04:13:31 2022] GET /identity/v3/role_assignments?user.id=7a4a4a4d468841a8acfbd6ef778ab3bd&scope.project.id=dd52e349f605416891993a08a2251fcc&role.id=d8f440a82947486ebb20a633ebee736b => generated 608 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:31.715751 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0eaeff-7242-4d97-b7f1-822d941c9835 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:31.716203 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0eaeff-7242-4d97-b7f1-822d941c9835 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:31.716560 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0eaeff-7242-4d97-b7f1-822d941c9835 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:31.717998 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 90/174] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:13:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:13:31.722480 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ce34d-414e-4a95-a2a5-6402c6f255ea None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:31.722857 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ce34d-414e-4a95-a2a5-6402c6f255ea None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:31.723334 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ce34d-414e-4a95-a2a5-6402c6f255ea None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:31.725129 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 91/175] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:13:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:13:31.726557 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ce34d-414e-4a95-a2a5-6402c6f255ea None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:31.747522 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:31.884508 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 85/176] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 30 04:13:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:31.885446 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e17543-715c-4ad1-90be-ea5b4779279d None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:31.885865 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e17543-715c-4ad1-90be-ea5b4779279d None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:31.886108 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e17543-715c-4ad1-90be-ea5b4779279d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:31.909772 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ce34d-414e-4a95-a2a5-6402c6f255ea None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:31.910030 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-52e17543-715c-4ad1-90be-ea5b4779279d None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:31.910877 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-52e17543-715c-4ad1-90be-ea5b4779279d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:31.928388 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:31.971007 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1421a57-a7a4-47c7-a734-a4e5aa28e18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:31.972049 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1421a57-a7a4-47c7-a734-a4e5aa28e18c None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:31.972524 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1421a57-a7a4-47c7-a734-a4e5aa28e18c None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:31.973069 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1421a57-a7a4-47c7-a734-a4e5aa28e18c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:32.017921 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 86/177] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:13:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:13:32.020436 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e17543-715c-4ad1-90be-ea5b4779279d None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:32.114519 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:32.127565 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1421a57-a7a4-47c7-a734-a4e5aa28e18c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:32.129346 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1421a57-a7a4-47c7-a734-a4e5aa28e18c None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:32.215609 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e17543-715c-4ad1-90be-ea5b4779279d None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:32.278241 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02e4960-173e-46fd-b84f-c26529d1c6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:32.279147 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e4960-173e-46fd-b84f-c26529d1c6c5 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:32.279608 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e4960-173e-46fd-b84f-c26529d1c6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:32.280189 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e4960-173e-46fd-b84f-c26529d1c6c5 None admin] PATH_INFO: `/v3/projects/dd52e349f605416891993a08a2251fcc` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:32.282133 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02e4960-173e-46fd-b84f-c26529d1c6c5 None admin] RBAC: Authorizing `identity:get_project(project_id=dd52e349f605416891993a08a2251fcc)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:32.284730 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02e4960-173e-46fd-b84f-c26529d1c6c5 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:32.287493 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 87/178] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 30 04:13:32 2022] GET /identity/v3/projects/dd52e349f605416891993a08a2251fcc => generated 298 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:32.287493 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42876b1-b9bd-4148-aa3d-215146075bfb None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:32.287493 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42876b1-b9bd-4148-aa3d-215146075bfb None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:32.287493 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42876b1-b9bd-4148-aa3d-215146075bfb None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:32.299114 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 88/179] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:13:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:13:32.299114 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20385cfa-d99f-42d8-a884-5ad0df64495d None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:32.299114 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20385cfa-d99f-42d8-a884-5ad0df64495d None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:32.299114 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20385cfa-d99f-42d8-a884-5ad0df64495d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:32.299670 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 92/180] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 30 04:13:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:32.302046 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5fb43-7900-46e7-b066-8865a977c6a2 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:32.302497 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5fb43-7900-46e7-b066-8865a977c6a2 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:32.303424 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5fb43-7900-46e7-b066-8865a977c6a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:32.325208 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-20385cfa-d99f-42d8-a884-5ad0df64495d None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:32.326360 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-94f5fb43-7900-46e7-b066-8865a977c6a2 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:32.327068 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-20385cfa-d99f-42d8-a884-5ad0df64495d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:32.327536 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-94f5fb43-7900-46e7-b066-8865a977c6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:32.332248 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:32.429724 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 93/181] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:13:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:13:32.440142 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f5fb43-7900-46e7-b066-8865a977c6a2 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:32.440236 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 89/182] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:13:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:13:32.440236 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20385cfa-d99f-42d8-a884-5ad0df64495d None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:32.519251 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:32.597222 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20385cfa-d99f-42d8-a884-5ad0df64495d None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:32.631353 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f5fb43-7900-46e7-b066-8865a977c6a2 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:32.662163 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ebf68-df58-40f8-9331-4b2f71f42fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:32.662802 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ebf68-df58-40f8-9331-4b2f71f42fa3 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:32.663076 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ebf68-df58-40f8-9331-4b2f71f42fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:32.663650 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ebf68-df58-40f8-9331-4b2f71f42fa3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:32.664461 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72ebf68-df58-40f8-9331-4b2f71f42fa3 None admin] RBAC: Adding query filter params (role.id=1aaf128d062240b28b37771b36f6b38b, scope.project.id=dd52e349f605416891993a08a2251fcc, user.id=9852d8eb74a94618897a59fe50939721) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:32.664770 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72ebf68-df58-40f8-9331-4b2f71f42fa3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:32.666907 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72ebf68-df58-40f8-9331-4b2f71f42fa3 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:32.675487 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 90/183] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 30 04:13:32 2022] GET /identity/v3/role_assignments?user.id=9852d8eb74a94618897a59fe50939721&scope.project.id=dd52e349f605416891993a08a2251fcc&role.id=1aaf128d062240b28b37771b36f6b38b => generated 608 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:32.677308 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a38658-bf16-4b51-84f2-f239e632156e None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:32.677598 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a38658-bf16-4b51-84f2-f239e632156e None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:32.677873 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a38658-bf16-4b51-84f2-f239e632156e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:32.704550 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249c7e4c-17e6-477c-af92-5fd58e9a9ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:32.705533 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c7e4c-17e6-477c-af92-5fd58e9a9ecf None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:32.705813 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c7e4c-17e6-477c-af92-5fd58e9a9ecf None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:32.706088 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c7e4c-17e6-477c-af92-5fd58e9a9ecf None admin] PATH_INFO: `/v3/projects/2b413b73a56049a6b808775c7f6ac09d` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:32.707353 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249c7e4c-17e6-477c-af92-5fd58e9a9ecf None admin] RBAC: Authorizing `identity:get_project(project_id=2b413b73a56049a6b808775c7f6ac09d)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:32.707599 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-75a38658-bf16-4b51-84f2-f239e632156e None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:32.708924 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249c7e4c-17e6-477c-af92-5fd58e9a9ecf None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:32.709786 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-75a38658-bf16-4b51-84f2-f239e632156e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:32.710722 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 94/184] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 30 04:13:32 2022] GET /identity/v3/projects/2b413b73a56049a6b808775c7f6ac09d => generated 312 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:32.711656 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249c7e4c-17e6-477c-af92-5fd58e9a9ecf None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:32.726109 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:32.856105 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 91/185] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:13:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:13:32.861117 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a38658-bf16-4b51-84f2-f239e632156e None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:32.910258 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249c7e4c-17e6-477c-af92-5fd58e9a9ecf None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:32.958404 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:32.977861 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f751462-10da-4c77-a86d-dadba4b5be9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:32.978848 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f751462-10da-4c77-a86d-dadba4b5be9e None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:32.979140 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f751462-10da-4c77-a86d-dadba4b5be9e None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:32.979412 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f751462-10da-4c77-a86d-dadba4b5be9e None admin] PATH_INFO: `/v3/projects/dd52e349f605416891993a08a2251fcc` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:32.981837 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f751462-10da-4c77-a86d-dadba4b5be9e None admin] RBAC: Authorizing `identity:get_project(project_id=dd52e349f605416891993a08a2251fcc)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:32.983311 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f751462-10da-4c77-a86d-dadba4b5be9e None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:32.988139 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 95/186] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 30 04:13:32 2022] GET /identity/v3/projects/dd52e349f605416891993a08a2251fcc => generated 298 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:32.989750 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f751462-10da-4c77-a86d-dadba4b5be9e None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:33.074366 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a38658-bf16-4b51-84f2-f239e632156e None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:33.113466 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:33.139325 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35df60-16f5-4cb8-8f19-15c77634272c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:33.140476 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35df60-16f5-4cb8-8f19-15c77634272c None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:33.140952 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35df60-16f5-4cb8-8f19-15c77634272c None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:33.141433 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35df60-16f5-4cb8-8f19-15c77634272c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:33.143970 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f751462-10da-4c77-a86d-dadba4b5be9e None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:33.159098 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b35df60-16f5-4cb8-8f19-15c77634272c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:13:33.169791 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-8b35df60-16f5-4cb8-8f19-15c77634272c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:13:33.169791 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:13:33.169791 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:13:33.169791 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:13:33.169791 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:13:33.169791 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:13:33.169791 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:13:33.169791 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:13:33.169791 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:13:33.169791 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:13:33.169791 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:13:33.169791 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:13:33.169791 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:13:33.169791 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:13:33.169791 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:13:33.169791 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:13:33.170872 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:13:33.170872 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:13:33.170872 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:13:33.170872 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:13:33.170872 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:13:33.170872 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:13:33.170872 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:13:33.170872 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:13:33.170872 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:13:33.170872 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:13:33.170872 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:13:33.170872 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:13:33.170872 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:13:33.170872 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:13:33.170872 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:13:33.170872 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:13:33.171663 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:13:33.171663 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:13:33.171663 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:13:33.171663 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:13:33.171663 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:13:33.171663 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:13:33.171663 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:13:33.171663 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:13:33.171663 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:13:33.171663 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:13:33.171663 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:13:33.171663 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:13:33.171663 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 92/187] 10.222.0.91 () {56 vars in 1096 bytes} [Tue Aug 30 04:13:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:13:33.173842 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35df60-16f5-4cb8-8f19-15c77634272c None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:33.184328 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed8d99-fdf8-4d0b-948a-c121eea561cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:33.184977 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed8d99-fdf8-4d0b-948a-c121eea561cf None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:33.185243 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed8d99-fdf8-4d0b-948a-c121eea561cf None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:33.185510 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed8d99-fdf8-4d0b-948a-c121eea561cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:33.186711 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bed8d99-fdf8-4d0b-948a-c121eea561cf None admin] RBAC: Adding query filter params (role.id=1aaf128d062240b28b37771b36f6b38b, scope.project.id=2b413b73a56049a6b808775c7f6ac09d, user.id=9852d8eb74a94618897a59fe50939721) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:33.186711 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bed8d99-fdf8-4d0b-948a-c121eea561cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:33.188687 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bed8d99-fdf8-4d0b-948a-c121eea561cf None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:33.195790 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 96/188] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 30 04:13:32 2022] GET /identity/v3/role_assignments?user.id=9852d8eb74a94618897a59fe50939721&scope.project.id=2b413b73a56049a6b808775c7f6ac09d&role.id=1aaf128d062240b28b37771b36f6b38b => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:33.196549 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed8d99-fdf8-4d0b-948a-c121eea561cf None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:33.330368 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:33.332165 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed8d99-fdf8-4d0b-948a-c121eea561cf None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:33.334240 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35df60-16f5-4cb8-8f19-15c77634272c None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:33.397500 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8998157-3071-43f3-8519-24662e11a42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:33.397760 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897f0db6-2228-4d8c-929c-c4c7d7f79886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:33.397941 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8998157-3071-43f3-8519-24662e11a42a None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:33.398089 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f0db6-2228-4d8c-929c-c4c7d7f79886 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:33.398364 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8998157-3071-43f3-8519-24662e11a42a None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:33.398751 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8998157-3071-43f3-8519-24662e11a42a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:33.399378 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f0db6-2228-4d8c-929c-c4c7d7f79886 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:33.399792 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f0db6-2228-4d8c-929c-c4c7d7f79886 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:33.403242 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897f0db6-2228-4d8c-929c-c4c7d7f79886 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:33.406232 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897f0db6-2228-4d8c-929c-c4c7d7f79886 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:33.410151 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 93/189] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:13:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:33.410833 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897f0db6-2228-4d8c-929c-c4c7d7f79886 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:33.418472 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8998157-3071-43f3-8519-24662e11a42a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:13:33.424362 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:33.426979 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-a8998157-3071-43f3-8519-24662e11a42a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:13:33.426979 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:13:33.426979 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:13:33.426979 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:13:33.426979 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:13:33.426979 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:13:33.426979 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:13:33.426979 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:13:33.426979 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:13:33.426979 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:13:33.426979 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:13:33.426979 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:13:33.426979 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:13:33.426979 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:13:33.426979 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:13:33.426979 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:13:33.428582 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:13:33.428582 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:13:33.428582 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:13:33.428582 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:13:33.428582 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:13:33.428582 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:13:33.428582 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:13:33.428582 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:13:33.428582 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:13:33.428582 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:13:33.428582 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:13:33.428582 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:13:33.428582 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:13:33.428582 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:13:33.428582 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:13:33.428582 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:13:33.429814 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:13:33.429814 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:13:33.429814 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:13:33.429814 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:13:33.429814 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:13:33.429814 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:13:33.429814 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:13:33.429814 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:13:33.429814 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:13:33.429814 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:13:33.429814 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:13:33.429814 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:13:33.429814 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 97/190] 10.222.0.91 () {56 vars in 1114 bytes} [Tue Aug 30 04:13:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:13:33.429814 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8998157-3071-43f3-8519-24662e11a42a None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:33.570641 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897f0db6-2228-4d8c-929c-c4c7d7f79886 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:33.586788 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8998157-3071-43f3-8519-24662e11a42a None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:33.620973 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c0fc1-d28a-4190-b543-35060790f767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:33.621664 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c0fc1-d28a-4190-b543-35060790f767 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:33.621980 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c0fc1-d28a-4190-b543-35060790f767 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:33.622291 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c0fc1-d28a-4190-b543-35060790f767 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:33.623097 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041c0fc1-d28a-4190-b543-35060790f767 None admin] RBAC: Adding query filter params (role.id=147a152caf8346259b191a633bb4aee0, scope.project.id=dd52e349f605416891993a08a2251fcc, user.id=9852d8eb74a94618897a59fe50939721) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:33.623442 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041c0fc1-d28a-4190-b543-35060790f767 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:33.625036 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041c0fc1-d28a-4190-b543-35060790f767 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:33.631889 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 94/191] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 30 04:13:33 2022] GET /identity/v3/role_assignments?user.id=9852d8eb74a94618897a59fe50939721&scope.project.id=dd52e349f605416891993a08a2251fcc&role.id=147a152caf8346259b191a633bb4aee0 => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:33.632793 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c0fc1-d28a-4190-b543-35060790f767 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:33.640521 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbebc10-9732-42c9-8d8e-62b3994a3f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:33.642095 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbebc10-9732-42c9-8d8e-62b3994a3f85 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:33.642858 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbebc10-9732-42c9-8d8e-62b3994a3f85 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:33.644194 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbebc10-9732-42c9-8d8e-62b3994a3f85 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:33.670710 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbebc10-9732-42c9-8d8e-62b3994a3f85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:13:33.680334 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-0bbebc10-9732-42c9-8d8e-62b3994a3f85 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 04:13:33.680334 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:13:33.680334 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:13:33.680334 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:13:33.680334 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:13:33.680334 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:13:33.680334 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:13:33.680334 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:13:33.680334 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:13:33.680334 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:13:33.680334 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:13:33.680334 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:13:33.680334 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:13:33.680334 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:13:33.680334 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:13:33.680334 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:13:33.682176 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:13:33.682176 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:13:33.682176 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:13:33.682176 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:13:33.682176 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:13:33.682176 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:13:33.682176 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:13:33.682176 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:13:33.682176 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:13:33.682176 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:13:33.682176 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:13:33.682176 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:13:33.682176 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:13:33.682176 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:13:33.682176 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:13:33.682176 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:13:33.683860 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:13:33.683860 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:13:33.683860 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:13:33.683860 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:13:33.683860 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:13:33.683860 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:13:33.683860 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:13:33.683860 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:13:33.683860 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:13:33.683860 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:13:33.683860 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 04:13:33.683860 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:13:33.694891 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 98/192] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 30 04:13:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:13:33.694891 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbebc10-9732-42c9-8d8e-62b3994a3f85 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:33.697036 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:33.806252 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c0fc1-d28a-4190-b543-35060790f767 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:33.811430 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:33.866644 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf56c05-a9c6-45e9-a2fe-5fb4bf806fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:33.870604 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf56c05-a9c6-45e9-a2fe-5fb4bf806fe5 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:33.871611 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf56c05-a9c6-45e9-a2fe-5fb4bf806fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:33.872342 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf56c05-a9c6-45e9-a2fe-5fb4bf806fe5 None admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:33.873592 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf56c05-a9c6-45e9-a2fe-5fb4bf806fe5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:33.874115 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf56c05-a9c6-45e9-a2fe-5fb4bf806fe5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:33.877048 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf56c05-a9c6-45e9-a2fe-5fb4bf806fe5 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:33.888873 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 95/193] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 30 04:13:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:33.889996 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf56c05-a9c6-45e9-a2fe-5fb4bf806fe5 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:33.891656 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbebc10-9732-42c9-8d8e-62b3994a3f85 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:33.946756 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c1e567-89f2-4bb1-8596-8d64cdc17504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:33.947443 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1e567-89f2-4bb1-8596-8d64cdc17504 None admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:33.947844 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1e567-89f2-4bb1-8596-8d64cdc17504 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:33.948337 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1e567-89f2-4bb1-8596-8d64cdc17504 None admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:33.949476 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c1e567-89f2-4bb1-8596-8d64cdc17504 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:33.951260 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c1e567-89f2-4bb1-8596-8d64cdc17504 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:33.979239 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 99/194] 10.222.0.91 () {60 vars in 1132 bytes} [Tue Aug 30 04:13:33 2022] POST /identity/v3/users => generated 297 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:13:33.980825 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c1e567-89f2-4bb1-8596-8d64cdc17504 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:34.061103 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:34.074792 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf56c05-a9c6-45e9-a2fe-5fb4bf806fe5 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:34.131033 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624936cc-476a-4e14-8599-489766620e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:34.131816 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624936cc-476a-4e14-8599-489766620e25 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:34.132290 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624936cc-476a-4e14-8599-489766620e25 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:34.132688 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624936cc-476a-4e14-8599-489766620e25 None admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:34.133769 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624936cc-476a-4e14-8599-489766620e25 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:34.134203 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624936cc-476a-4e14-8599-489766620e25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:34.136327 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624936cc-476a-4e14-8599-489766620e25 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:34.152453 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c1e567-89f2-4bb1-8596-8d64cdc17504 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:34.152889 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 96/195] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 30 04:13:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:34.154562 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624936cc-476a-4e14-8599-489766620e25 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:34.189856 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:34.230162 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4962c444-15e7-4f6d-8cfe-f53a0ad72d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:34.231052 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962c444-15e7-4f6d-8cfe-f53a0ad72d5a None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:34.231508 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962c444-15e7-4f6d-8cfe-f53a0ad72d5a None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:34.232934 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962c444-15e7-4f6d-8cfe-f53a0ad72d5a None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:34.233154 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4962c444-15e7-4f6d-8cfe-f53a0ad72d5a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:34.233684 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4962c444-15e7-4f6d-8cfe-f53a0ad72d5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:34.235358 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4962c444-15e7-4f6d-8cfe-f53a0ad72d5a None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:34.251964 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 100/196] 10.222.0.91 () {56 vars in 1101 bytes} [Tue Aug 30 04:13:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:34.252851 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4962c444-15e7-4f6d-8cfe-f53a0ad72d5a None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:34.337347 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624936cc-476a-4e14-8599-489766620e25 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:34.400877 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64f737-6324-4ffd-90be-7817b849b876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:34.402396 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64f737-6324-4ffd-90be-7817b849b876 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:34.402907 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64f737-6324-4ffd-90be-7817b849b876 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:34.403400 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64f737-6324-4ffd-90be-7817b849b876 None admin] PATH_INFO: `/v3/users/855bfcd16b974fd395af8a0095c59389` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:34.428230 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a64f737-6324-4ffd-90be-7817b849b876 None admin] RBAC: Authorizing `identity:get_user(user_id=855bfcd16b974fd395af8a0095c59389)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:34.431209 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a64f737-6324-4ffd-90be-7817b849b876 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:34.434771 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 97/197] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 30 04:13:34 2022] GET /identity/v3/users/855bfcd16b974fd395af8a0095c59389 => generated 283 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:34.437865 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64f737-6324-4ffd-90be-7817b849b876 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:34.446187 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4962c444-15e7-4f6d-8cfe-f53a0ad72d5a None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:34.471771 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:34.515636 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73835c42-5e9e-4559-ad7d-645f5d81faed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:34.516828 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73835c42-5e9e-4559-ad7d-645f5d81faed None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:34.517438 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73835c42-5e9e-4559-ad7d-645f5d81faed None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:34.517993 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73835c42-5e9e-4559-ad7d-645f5d81faed None admin] PATH_INFO: `/v3/users/855bfcd16b974fd395af8a0095c59389` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:34.520385 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73835c42-5e9e-4559-ad7d-645f5d81faed None admin] RBAC: Authorizing `identity:get_user(user_id=855bfcd16b974fd395af8a0095c59389)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:34.523085 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73835c42-5e9e-4559-ad7d-645f5d81faed None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:34.527231 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 101/198] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 30 04:13:34 2022] GET /identity/v3/users/855bfcd16b974fd395af8a0095c59389 => generated 283 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:34.528593 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73835c42-5e9e-4559-ad7d-645f5d81faed None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:34.626143 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:34.661019 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64f737-6324-4ffd-90be-7817b849b876 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:34.727548 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8cd23a-1f2d-40bc-9ae5-dd0e3eec2976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:34.728775 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8cd23a-1f2d-40bc-9ae5-dd0e3eec2976 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:34.729346 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8cd23a-1f2d-40bc-9ae5-dd0e3eec2976 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:34.729960 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8cd23a-1f2d-40bc-9ae5-dd0e3eec2976 None admin] PATH_INFO: `/v3/users/5545aa38d0ac4ac0a124d28360b089fc` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:34.731845 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73835c42-5e9e-4559-ad7d-645f5d81faed None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:34.732356 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8cd23a-1f2d-40bc-9ae5-dd0e3eec2976 None admin] RBAC: Authorizing `identity:get_user(user_id=5545aa38d0ac4ac0a124d28360b089fc)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:34.735270 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8cd23a-1f2d-40bc-9ae5-dd0e3eec2976 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:34.743962 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 98/199] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 30 04:13:34 2022] GET /identity/v3/users/5545aa38d0ac4ac0a124d28360b089fc => generated 289 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:34.743962 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8cd23a-1f2d-40bc-9ae5-dd0e3eec2976 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:34.804384 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc7c14e-7933-4d29-b859-6e22d5a040f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:34.805866 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7c14e-7933-4d29-b859-6e22d5a040f2 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:34.806617 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7c14e-7933-4d29-b859-6e22d5a040f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:34.807319 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7c14e-7933-4d29-b859-6e22d5a040f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:34.894376 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:34.933626 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8cd23a-1f2d-40bc-9ae5-dd0e3eec2976 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:34.934643 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc7c14e-7933-4d29-b859-6e22d5a040f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:34.937591 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc7c14e-7933-4d29-b859-6e22d5a040f2 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:35.002539 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e51f7fd-03d0-4630-aa52-27167ca49ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:35.004000 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51f7fd-03d0-4630-aa52-27167ca49ba1 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:35.004634 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51f7fd-03d0-4630-aa52-27167ca49ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:35.005243 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51f7fd-03d0-4630-aa52-27167ca49ba1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:35.023542 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:35.131205 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 102/200] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 30 04:13:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:35.131205 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc7c14e-7933-4d29-b859-6e22d5a040f2 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:35.151710 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e51f7fd-03d0-4630-aa52-27167ca49ba1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:35.154921 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e51f7fd-03d0-4630-aa52-27167ca49ba1 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:35.309569 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc7c14e-7933-4d29-b859-6e22d5a040f2 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:35.316847 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:35.354176 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 99/201] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 30 04:13:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 615 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:35.356266 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e51f7fd-03d0-4630-aa52-27167ca49ba1 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:35.381859 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcfe50e-da59-4a8d-bf3e-741e5457fa09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:35.382777 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcfe50e-da59-4a8d-bf3e-741e5457fa09 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:35.383254 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcfe50e-da59-4a8d-bf3e-741e5457fa09 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:35.383780 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcfe50e-da59-4a8d-bf3e-741e5457fa09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:35.414639 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:35.494369 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e51f7fd-03d0-4630-aa52-27167ca49ba1 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:35.538601 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcfe50e-da59-4a8d-bf3e-741e5457fa09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:35.542984 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcfe50e-da59-4a8d-bf3e-741e5457fa09 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:35.545559 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e966a764-fae4-408b-bb39-4f91841a14a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:35.546486 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966a764-fae4-408b-bb39-4f91841a14a8 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:35.546962 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966a764-fae4-408b-bb39-4f91841a14a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:35.547426 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966a764-fae4-408b-bb39-4f91841a14a8 None admin] PATH_INFO: `/v3/projects/2013198a52ce4d88a1546ba74e7ab400` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:35.548965 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e966a764-fae4-408b-bb39-4f91841a14a8 None admin] RBAC: Authorizing `identity:get_project(project_id=2013198a52ce4d88a1546ba74e7ab400)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:35.550693 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e966a764-fae4-408b-bb39-4f91841a14a8 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:35.552651 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 100/202] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 30 04:13:35 2022] GET /identity/v3/projects/2013198a52ce4d88a1546ba74e7ab400 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:35.553655 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e966a764-fae4-408b-bb39-4f91841a14a8 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:35.622400 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:35.684658 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 103/203] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 30 04:13:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:35.685648 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcfe50e-da59-4a8d-bf3e-741e5457fa09 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:35.690905 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e966a764-fae4-408b-bb39-4f91841a14a8 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:35.732559 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae95d5f0-2619-479f-a477-c2f56ba7d834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:35.733647 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95d5f0-2619-479f-a477-c2f56ba7d834 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:35.734160 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95d5f0-2619-479f-a477-c2f56ba7d834 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:35.734624 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95d5f0-2619-479f-a477-c2f56ba7d834 None admin] PATH_INFO: `/v3/projects/2013198a52ce4d88a1546ba74e7ab400` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:35.736245 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae95d5f0-2619-479f-a477-c2f56ba7d834 None admin] RBAC: Authorizing `identity:get_project(project_id=2013198a52ce4d88a1546ba74e7ab400)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:35.738236 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae95d5f0-2619-479f-a477-c2f56ba7d834 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:35.740443 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 101/204] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 30 04:13:35 2022] GET /identity/v3/projects/2013198a52ce4d88a1546ba74e7ab400 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:35.740995 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:35.742801 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae95d5f0-2619-479f-a477-c2f56ba7d834 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:35.808415 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcfe50e-da59-4a8d-bf3e-741e5457fa09 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:35.850221 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b1f9f-f700-446d-a3af-7c9d153eac54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:35.850865 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b1f9f-f700-446d-a3af-7c9d153eac54 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:35.851137 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b1f9f-f700-446d-a3af-7c9d153eac54 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:35.851414 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b1f9f-f700-446d-a3af-7c9d153eac54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:35.852213 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7b1f9f-f700-446d-a3af-7c9d153eac54 None admin] RBAC: Adding query filter params (role.id=d8f440a82947486ebb20a633ebee736b, scope.project.id=2013198a52ce4d88a1546ba74e7ab400, user.id=855bfcd16b974fd395af8a0095c59389) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:35.852517 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7b1f9f-f700-446d-a3af-7c9d153eac54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:35.854907 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7b1f9f-f700-446d-a3af-7c9d153eac54 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:35.868016 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 104/205] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 30 04:13:35 2022] GET /identity/v3/role_assignments?user.id=855bfcd16b974fd395af8a0095c59389&scope.project.id=2013198a52ce4d88a1546ba74e7ab400&role.id=d8f440a82947486ebb20a633ebee736b => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:35.869522 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b1f9f-f700-446d-a3af-7c9d153eac54 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:35.877210 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae95d5f0-2619-479f-a477-c2f56ba7d834 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:35.916507 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:35.961547 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b879c07-52b7-46d9-9f7d-cd628a3d4388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:35.962830 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b879c07-52b7-46d9-9f7d-cd628a3d4388 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:35.963311 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b879c07-52b7-46d9-9f7d-cd628a3d4388 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:35.963842 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b879c07-52b7-46d9-9f7d-cd628a3d4388 None admin] PATH_INFO: `/v3/projects/dd52e349f605416891993a08a2251fcc` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:35.965430 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b879c07-52b7-46d9-9f7d-cd628a3d4388 None admin] RBAC: Authorizing `identity:get_project(project_id=dd52e349f605416891993a08a2251fcc)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:35.967325 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b879c07-52b7-46d9-9f7d-cd628a3d4388 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:35.970112 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 102/206] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 30 04:13:35 2022] GET /identity/v3/projects/dd52e349f605416891993a08a2251fcc => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:35.977691 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b879c07-52b7-46d9-9f7d-cd628a3d4388 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:36.140980 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b1f9f-f700-446d-a3af-7c9d153eac54 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:36.156416 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:36.190923 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e4b624-d5f0-47a4-90bf-394495f5e781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:36.191896 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4b624-d5f0-47a4-90bf-394495f5e781 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:36.192451 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4b624-d5f0-47a4-90bf-394495f5e781 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:36.192921 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4b624-d5f0-47a4-90bf-394495f5e781 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:36.193888 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e4b624-d5f0-47a4-90bf-394495f5e781 None admin] RBAC: Adding query filter params (role.id=147a152caf8346259b191a633bb4aee0, scope.project.id=2013198a52ce4d88a1546ba74e7ab400, user.id=855bfcd16b974fd395af8a0095c59389) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:36.194407 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e4b624-d5f0-47a4-90bf-394495f5e781 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:36.197120 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e4b624-d5f0-47a4-90bf-394495f5e781 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:36.204263 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 105/207] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 30 04:13:35 2022] GET /identity/v3/role_assignments?user.id=855bfcd16b974fd395af8a0095c59389&scope.project.id=2013198a52ce4d88a1546ba74e7ab400&role.id=147a152caf8346259b191a633bb4aee0 => generated 259 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:36.214421 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b879c07-52b7-46d9-9f7d-cd628a3d4388 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:36.261255 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401bad9b-f4ee-44a7-8966-a618b89d5c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:36.262334 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401bad9b-f4ee-44a7-8966-a618b89d5c54 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:36.262826 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401bad9b-f4ee-44a7-8966-a618b89d5c54 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:36.263289 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401bad9b-f4ee-44a7-8966-a618b89d5c54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:36.264361 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401bad9b-f4ee-44a7-8966-a618b89d5c54 None admin] RBAC: Adding query filter params (role.id=643830a05faa4c2898407ace9a43df40, scope.project.id=dd52e349f605416891993a08a2251fcc, user.id=5545aa38d0ac4ac0a124d28360b089fc) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:36.264912 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401bad9b-f4ee-44a7-8966-a618b89d5c54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:36.266716 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401bad9b-f4ee-44a7-8966-a618b89d5c54 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:36.274408 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 103/208] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 30 04:13:35 2022] GET /identity/v3/role_assignments?user.id=5545aa38d0ac4ac0a124d28360b089fc&scope.project.id=dd52e349f605416891993a08a2251fcc&role.id=643830a05faa4c2898407ace9a43df40 => generated 608 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:13:36.384215 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb331d82-1c7d-4df2-b259-8fea768fec1a None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:36.384914 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb331d82-1c7d-4df2-b259-8fea768fec1a None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:36.385403 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb331d82-1c7d-4df2-b259-8fea768fec1a None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:36.387358 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 106/209] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:13:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:13:36.393711 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4470f5ab-be07-4e96-a5c2-b31a1f3add6c None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:36.394393 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4470f5ab-be07-4e96-a5c2-b31a1f3add6c None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:36.394869 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4470f5ab-be07-4e96-a5c2-b31a1f3add6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:36.420278 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-4470f5ab-be07-4e96-a5c2-b31a1f3add6c None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:36.422038 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-4470f5ab-be07-4e96-a5c2-b31a1f3add6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:36.487900 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:36.515313 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 104/210] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:13:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:13:36.881969 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d7e97-2423-4bab-9a41-4c1ebc46ebc7 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:36.882813 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d7e97-2423-4bab-9a41-4c1ebc46ebc7 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:36.883329 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d7e97-2423-4bab-9a41-4c1ebc46ebc7 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:36.885009 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 107/211] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:13:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:13:36.886600 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4470f5ab-be07-4e96-a5c2-b31a1f3add6c None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:36.915675 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f504f1-034a-4638-a7ba-5abc215d8655 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:36.916969 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f504f1-034a-4638-a7ba-5abc215d8655 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:36.917804 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f504f1-034a-4638-a7ba-5abc215d8655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:36.944180 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-79f504f1-034a-4638-a7ba-5abc215d8655 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:36.945969 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-79f504f1-034a-4638-a7ba-5abc215d8655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:37.026612 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4470f5ab-be07-4e96-a5c2-b31a1f3add6c None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:37.048503 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 108/212] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:13:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:13:37.079075 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb168277-1c14-4514-802a-09852ed3ac16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:37.080168 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb168277-1c14-4514-802a-09852ed3ac16 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:37.080689 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb168277-1c14-4514-802a-09852ed3ac16 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:37.081150 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb168277-1c14-4514-802a-09852ed3ac16 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:37.094322 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb168277-1c14-4514-802a-09852ed3ac16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:13:37.099807 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-bb168277-1c14-4514-802a-09852ed3ac16 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:13:37.099807 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:13:37.099807 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:13:37.099807 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:13:37.099807 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:13:37.099807 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:13:37.099807 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:13:37.099807 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:13:37.099807 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:13:37.099807 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:13:37.099807 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:13:37.099807 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:13:37.099807 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:13:37.099807 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:13:37.099807 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:13:37.099807 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:13:37.100792 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:13:37.100792 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:13:37.100792 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:13:37.100792 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:13:37.100792 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:13:37.100792 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:13:37.100792 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:13:37.100792 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:13:37.100792 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:13:37.100792 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:13:37.100792 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:13:37.100792 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:13:37.100792 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:13:37.100792 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:13:37.100792 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:13:37.100792 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:13:37.101584 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:13:37.101584 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:13:37.101584 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:13:37.101584 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:13:37.101584 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:13:37.101584 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:13:37.101584 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:13:37.101584 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:13:37.101584 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:13:37.101584 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:13:37.101584 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:13:37.101584 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:13:37.104114 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 105/213] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 30 04:13:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:13:37.113753 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f504f1-034a-4638-a7ba-5abc215d8655 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:37.243540 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f504f1-034a-4638-a7ba-5abc215d8655 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:37.252320 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:37.283342 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b385ae-1d4a-41c4-b236-4f5f10148352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:37.283999 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b385ae-1d4a-41c4-b236-4f5f10148352 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:37.284273 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b385ae-1d4a-41c4-b236-4f5f10148352 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:37.284538 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b385ae-1d4a-41c4-b236-4f5f10148352 None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:37.285209 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b385ae-1d4a-41c4-b236-4f5f10148352 None admin] RBAC: Adding query filter params (name=member) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:37.285504 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b385ae-1d4a-41c4-b236-4f5f10148352 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:37.286939 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b385ae-1d4a-41c4-b236-4f5f10148352 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:37.297982 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 109/214] 10.222.0.91 () {56 vars in 1101 bytes} [Tue Aug 30 04:13:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:37.306983 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb168277-1c14-4514-802a-09852ed3ac16 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:37.338376 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b385ae-1d4a-41c4-b236-4f5f10148352 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:37.364702 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:37.439270 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb168277-1c14-4514-802a-09852ed3ac16 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:37.489024 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b385ae-1d4a-41c4-b236-4f5f10148352 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:37.493367 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d842a102-7fcd-4404-a3fd-f7f8f27c2b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:37.494312 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d842a102-7fcd-4404-a3fd-f7f8f27c2b0d None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:37.494731 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d842a102-7fcd-4404-a3fd-f7f8f27c2b0d None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:37.495282 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d842a102-7fcd-4404-a3fd-f7f8f27c2b0d None admin] PATH_INFO: `/v3/users/26a94a02251749d4ad8a27978ec9b5de` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:37.515764 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d842a102-7fcd-4404-a3fd-f7f8f27c2b0d None admin] RBAC: Authorizing `identity:get_user(user_id=26a94a02251749d4ad8a27978ec9b5de)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:37.518319 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d842a102-7fcd-4404-a3fd-f7f8f27c2b0d None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:37.520846 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 106/215] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 30 04:13:37 2022] GET /identity/v3/users/26a94a02251749d4ad8a27978ec9b5de => generated 297 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:37.533493 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d842a102-7fcd-4404-a3fd-f7f8f27c2b0d None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:37.539724 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50816e7a-4fe1-428e-8b70-43494ca1442a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:37.541270 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50816e7a-4fe1-428e-8b70-43494ca1442a None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:37.542012 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50816e7a-4fe1-428e-8b70-43494ca1442a None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:37.544050 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50816e7a-4fe1-428e-8b70-43494ca1442a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:37.546802 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50816e7a-4fe1-428e-8b70-43494ca1442a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:37.550275 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50816e7a-4fe1-428e-8b70-43494ca1442a None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:37.553956 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 110/216] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:13:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:13:37.562272 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50816e7a-4fe1-428e-8b70-43494ca1442a None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:37.635137 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:37.728001 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:37.737910 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d842a102-7fcd-4404-a3fd-f7f8f27c2b0d None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:37.758551 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50816e7a-4fe1-428e-8b70-43494ca1442a None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:37.792178 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e3913f-bfaa-461f-b61e-6e130247f722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:37.794577 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e3913f-bfaa-461f-b61e-6e130247f722 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:37.795474 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e3913f-bfaa-461f-b61e-6e130247f722 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:37.796040 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e3913f-bfaa-461f-b61e-6e130247f722 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:37.830132 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85764958-faaf-4f42-b189-be8f2cb20c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:37.832215 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85764958-faaf-4f42-b189-be8f2cb20c74 None admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:37.832728 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85764958-faaf-4f42-b189-be8f2cb20c74 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:37.833135 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85764958-faaf-4f42-b189-be8f2cb20c74 None admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:37.834193 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85764958-faaf-4f42-b189-be8f2cb20c74 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:37.837018 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85764958-faaf-4f42-b189-be8f2cb20c74 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:37.885900 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 111/217] 10.222.0.91 () {60 vars in 1132 bytes} [Tue Aug 30 04:13:37 2022] POST /identity/v3/users => generated 297 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:13:37.899879 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e3913f-bfaa-461f-b61e-6e130247f722 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:37.902482 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e3913f-bfaa-461f-b61e-6e130247f722 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:38.042028 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:38.048844 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 107/218] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 30 04:13:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:38.056585 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85764958-faaf-4f42-b189-be8f2cb20c74 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:38.177989 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:38.191006 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85764958-faaf-4f42-b189-be8f2cb20c74 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:38.232614 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c702a08-0473-4f4c-a903-5ae22e9f76ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:38.233287 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c702a08-0473-4f4c-a903-5ae22e9f76ac None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:38.233567 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c702a08-0473-4f4c-a903-5ae22e9f76ac None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:38.233841 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c702a08-0473-4f4c-a903-5ae22e9f76ac None admin] PATH_INFO: `/v3/projects/2013198a52ce4d88a1546ba74e7ab400` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:38.235105 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c702a08-0473-4f4c-a903-5ae22e9f76ac None admin] RBAC: Authorizing `identity:get_project(project_id=2013198a52ce4d88a1546ba74e7ab400)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:38.236720 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c702a08-0473-4f4c-a903-5ae22e9f76ac None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:38.238825 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 112/219] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 30 04:13:38 2022] GET /identity/v3/projects/2013198a52ce4d88a1546ba74e7ab400 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:38.248860 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e3913f-bfaa-461f-b61e-6e130247f722 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:38.431691 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e3913f-bfaa-461f-b61e-6e130247f722 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:38.475232 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a08bfad-ca34-4a2d-af2f-7e0d104e4270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:38.475860 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08bfad-ca34-4a2d-af2f-7e0d104e4270 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:38.476160 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08bfad-ca34-4a2d-af2f-7e0d104e4270 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:38.476429 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08bfad-ca34-4a2d-af2f-7e0d104e4270 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:38.477175 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a08bfad-ca34-4a2d-af2f-7e0d104e4270 None admin] RBAC: Adding query filter params (role.id=1aaf128d062240b28b37771b36f6b38b, scope.project.id=2013198a52ce4d88a1546ba74e7ab400, user.id=26a94a02251749d4ad8a27978ec9b5de) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:38.477478 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a08bfad-ca34-4a2d-af2f-7e0d104e4270 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:38.478971 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a08bfad-ca34-4a2d-af2f-7e0d104e4270 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:38.485895 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 108/220] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 30 04:13:38 2022] GET /identity/v3/role_assignments?user.id=26a94a02251749d4ad8a27978ec9b5de&scope.project.id=2013198a52ce4d88a1546ba74e7ab400&role.id=1aaf128d062240b28b37771b36f6b38b => generated 259 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:38.552017 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7e298-67a5-4008-8622-dd4211e2dc03 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:38.552557 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7e298-67a5-4008-8622-dd4211e2dc03 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:38.552752 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7e298-67a5-4008-8622-dd4211e2dc03 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:38.554636 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 113/221] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:13:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:13:38.562458 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83595dc7-cd62-4d99-aa5c-4b539c1e90f7 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:38.562918 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83595dc7-cd62-4d99-aa5c-4b539c1e90f7 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:38.563416 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83595dc7-cd62-4d99-aa5c-4b539c1e90f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:38.591052 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-83595dc7-cd62-4d99-aa5c-4b539c1e90f7 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:38.592805 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-83595dc7-cd62-4d99-aa5c-4b539c1e90f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:38.611028 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9449de2-80b6-4dc7-89aa-88969d8ce9ec None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:38.611312 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9449de2-80b6-4dc7-89aa-88969d8ce9ec None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:38.611730 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9449de2-80b6-4dc7-89aa-88969d8ce9ec None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:38.613545 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 114/222] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:13:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:13:38.619410 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721444ea-611b-4dee-901d-189f77ae74f7 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:38.619709 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721444ea-611b-4dee-901d-189f77ae74f7 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:38.620019 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721444ea-611b-4dee-901d-189f77ae74f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:38.654326 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-721444ea-611b-4dee-901d-189f77ae74f7 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:38.656352 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-721444ea-611b-4dee-901d-189f77ae74f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:38.720593 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:38.753414 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 109/223] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:13:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:13:38.804748 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 115/224] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:13:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 04:13:39.155593 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83595dc7-cd62-4d99-aa5c-4b539c1e90f7 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:39.163062 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721444ea-611b-4dee-901d-189f77ae74f7 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:39.308636 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83595dc7-cd62-4d99-aa5c-4b539c1e90f7 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:39.390442 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:39.412129 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721444ea-611b-4dee-901d-189f77ae74f7 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:39.432777 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cc2d82-ba81-4d7d-8c9c-8eb714e8b3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:39.433705 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc2d82-ba81-4d7d-8c9c-8eb714e8b3eb None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:39.434106 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc2d82-ba81-4d7d-8c9c-8eb714e8b3eb None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:39.434472 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc2d82-ba81-4d7d-8c9c-8eb714e8b3eb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:39.465278 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cc2d82-ba81-4d7d-8c9c-8eb714e8b3eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:13:39.470503 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-74cc2d82-ba81-4d7d-8c9c-8eb714e8b3eb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:13:39.470503 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:13:39.470503 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:13:39.470503 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:13:39.470503 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:13:39.470503 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:13:39.470503 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:13:39.470503 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:13:39.470503 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:13:39.470503 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:13:39.470503 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:13:39.470503 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:13:39.470503 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:13:39.470503 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:13:39.470503 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:13:39.470503 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:13:39.472368 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:13:39.472368 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:13:39.472368 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:13:39.472368 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:13:39.472368 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:13:39.472368 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:13:39.472368 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:13:39.472368 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:13:39.472368 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:13:39.472368 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:13:39.472368 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:13:39.472368 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:13:39.472368 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:13:39.472368 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:13:39.472368 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:13:39.472368 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:13:39.473952 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:13:39.473952 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:13:39.473952 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:13:39.473952 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:13:39.473952 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:13:39.473952 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:13:39.473952 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:13:39.473952 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:13:39.473952 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:13:39.473952 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:13:39.473952 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:13:39.473952 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:13:39.480476 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 110/225] 10.222.0.91 () {56 vars in 1114 bytes} [Tue Aug 30 04:13:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:13:39.488261 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cc2d82-ba81-4d7d-8c9c-8eb714e8b3eb None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:39.493579 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f27e65-70d4-4439-acbd-6b0ba05a6802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:39.495656 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f27e65-70d4-4439-acbd-6b0ba05a6802 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:39.496634 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f27e65-70d4-4439-acbd-6b0ba05a6802 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:39.497365 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f27e65-70d4-4439-acbd-6b0ba05a6802 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:39.525215 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f27e65-70d4-4439-acbd-6b0ba05a6802 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:13:39.538038 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-34f27e65-70d4-4439-acbd-6b0ba05a6802 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:13:39.538038 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:13:39.538038 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:13:39.538038 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:13:39.538038 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:13:39.538038 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:13:39.538038 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:13:39.538038 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:13:39.538038 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:13:39.538038 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:13:39.538038 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:13:39.538038 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:13:39.538038 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:13:39.538038 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:13:39.538038 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:13:39.538038 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:13:39.539708 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:13:39.539708 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:13:39.539708 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:13:39.539708 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:13:39.539708 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:13:39.539708 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:13:39.539708 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:13:39.539708 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:13:39.539708 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:13:39.539708 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:13:39.539708 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:13:39.539708 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:13:39.539708 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:13:39.539708 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:13:39.539708 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:13:39.539708 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:13:39.541328 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:13:39.541328 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:13:39.541328 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:13:39.541328 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:13:39.541328 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:13:39.541328 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:13:39.541328 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:13:39.541328 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:13:39.541328 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:13:39.541328 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:13:39.541328 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:13:39.541328 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:13:39.547599 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 116/226] 10.222.0.91 () {56 vars in 1096 bytes} [Tue Aug 30 04:13:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:13:39.559471 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f27e65-70d4-4439-acbd-6b0ba05a6802 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:39.682894 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:39.802663 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cc2d82-ba81-4d7d-8c9c-8eb714e8b3eb None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:39.859942 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f27e65-70d4-4439-acbd-6b0ba05a6802 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:39.892762 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c38c3b7-b877-4f8f-87f8-fcce9beefaaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:39.893425 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38c3b7-b877-4f8f-87f8-fcce9beefaaa None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:39.893700 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38c3b7-b877-4f8f-87f8-fcce9beefaaa None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:39.893960 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38c3b7-b877-4f8f-87f8-fcce9beefaaa None admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:39.894766 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c38c3b7-b877-4f8f-87f8-fcce9beefaaa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:39.895068 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c38c3b7-b877-4f8f-87f8-fcce9beefaaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:39.896548 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c38c3b7-b877-4f8f-87f8-fcce9beefaaa None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:39.916634 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 111/227] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 30 04:13:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 429 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:13:39.923223 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c38c3b7-b877-4f8f-87f8-fcce9beefaaa None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:39.947659 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26889c0b-414c-491f-8944-d604aa111085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:39.948780 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26889c0b-414c-491f-8944-d604aa111085 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:39.948780 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26889c0b-414c-491f-8944-d604aa111085 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:39.949134 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26889c0b-414c-491f-8944-d604aa111085 None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:39.951951 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26889c0b-414c-491f-8944-d604aa111085 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:39.951951 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26889c0b-414c-491f-8944-d604aa111085 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:39.955820 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26889c0b-414c-491f-8944-d604aa111085 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:39.976180 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 117/228] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 30 04:13:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:40.001223 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26889c0b-414c-491f-8944-d604aa111085 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:40.032903 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:40.088454 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c38c3b7-b877-4f8f-87f8-fcce9beefaaa None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:40.109779 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:40.142972 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e92d1-0527-4cf3-b7c7-5b45b9ca5f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:40.143634 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e92d1-0527-4cf3-b7c7-5b45b9ca5f07 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:40.143928 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e92d1-0527-4cf3-b7c7-5b45b9ca5f07 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:40.144331 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e92d1-0527-4cf3-b7c7-5b45b9ca5f07 None admin] PATH_INFO: `/v3/users/855bfcd16b974fd395af8a0095c59389` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:40.148638 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853e92d1-0527-4cf3-b7c7-5b45b9ca5f07 None admin] RBAC: Authorizing `identity:get_user(user_id=855bfcd16b974fd395af8a0095c59389)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:40.150157 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853e92d1-0527-4cf3-b7c7-5b45b9ca5f07 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:40.152124 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 112/229] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 30 04:13:39 2022] GET /identity/v3/users/855bfcd16b974fd395af8a0095c59389 => generated 283 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:40.157663 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e92d1-0527-4cf3-b7c7-5b45b9ca5f07 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:40.258802 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26889c0b-414c-491f-8944-d604aa111085 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:40.306909 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb98026c-87b2-4ee2-99e7-4c21822094da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:40.311715 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98026c-87b2-4ee2-99e7-4c21822094da None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:40.312042 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98026c-87b2-4ee2-99e7-4c21822094da None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:40.312264 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98026c-87b2-4ee2-99e7-4c21822094da None admin] PATH_INFO: `/v3/users/855bfcd16b974fd395af8a0095c59389` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:40.313738 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb98026c-87b2-4ee2-99e7-4c21822094da None admin] RBAC: Authorizing `identity:get_user(user_id=855bfcd16b974fd395af8a0095c59389)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:40.315243 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb98026c-87b2-4ee2-99e7-4c21822094da None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:40.316973 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 118/230] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 30 04:13:39 2022] GET /identity/v3/users/855bfcd16b974fd395af8a0095c59389 => generated 283 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:40.326713 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb98026c-87b2-4ee2-99e7-4c21822094da None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:40.405209 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e92d1-0527-4cf3-b7c7-5b45b9ca5f07 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:40.461730 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d0397-a0a1-4eb0-bee4-fa609915db93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:40.462764 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d0397-a0a1-4eb0-bee4-fa609915db93 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:40.463207 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d0397-a0a1-4eb0-bee4-fa609915db93 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:40.463677 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d0397-a0a1-4eb0-bee4-fa609915db93 None admin] PATH_INFO: `/v3/projects/2013198a52ce4d88a1546ba74e7ab400` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:40.468891 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0d0397-a0a1-4eb0-bee4-fa609915db93 None admin] RBAC: Authorizing `identity:get_project(project_id=2013198a52ce4d88a1546ba74e7ab400)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:40.470429 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0d0397-a0a1-4eb0-bee4-fa609915db93 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:40.482133 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 113/231] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 30 04:13:40 2022] GET /identity/v3/projects/2013198a52ce4d88a1546ba74e7ab400 => generated 302 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:40.483599 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d0397-a0a1-4eb0-bee4-fa609915db93 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:40.572447 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:40.605059 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:40.629401 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb98026c-87b2-4ee2-99e7-4c21822094da None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:40.706768 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be8ba3-dee1-4c69-91fb-f50d84358d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:40.707528 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be8ba3-dee1-4c69-91fb-f50d84358d1f None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:40.707804 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be8ba3-dee1-4c69-91fb-f50d84358d1f None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:40.708109 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be8ba3-dee1-4c69-91fb-f50d84358d1f None admin] PATH_INFO: `/v3/projects/2013198a52ce4d88a1546ba74e7ab400` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:40.709321 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be8ba3-dee1-4c69-91fb-f50d84358d1f None admin] RBAC: Authorizing `identity:get_project(project_id=2013198a52ce4d88a1546ba74e7ab400)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:40.710917 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be8ba3-dee1-4c69-91fb-f50d84358d1f None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:40.713205 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 119/232] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 30 04:13:40 2022] GET /identity/v3/projects/2013198a52ce4d88a1546ba74e7ab400 => generated 302 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:40.719555 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42586b1b-3d4c-4bb4-9145-3d20f117fc75 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:40.720076 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42586b1b-3d4c-4bb4-9145-3d20f117fc75 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:40.720361 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42586b1b-3d4c-4bb4-9145-3d20f117fc75 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:40.722242 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 120/233] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:13:40 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:13:40.722889 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d0397-a0a1-4eb0-bee4-fa609915db93 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:40.723076 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42586b1b-3d4c-4bb4-9145-3d20f117fc75 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:40.768503 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c25c2-0e88-4f35-b6bd-065588c45530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:40.770027 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c25c2-0e88-4f35-b6bd-065588c45530 None admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:40.770639 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c25c2-0e88-4f35-b6bd-065588c45530 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:40.771118 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c25c2-0e88-4f35-b6bd-065588c45530 None admin] PATH_INFO: `/v3/projects/2013198a52ce4d88a1546ba74e7ab400/users/855bfcd16b974fd395af8a0095c59389/roles/147a152caf8346259b191a633bb4aee0` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:40.774748 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743c25c2-0e88-4f35-b6bd-065588c45530 None admin] RBAC: Authorizing `identity:create_grant(project_id=2013198a52ce4d88a1546ba74e7ab400, user_id=855bfcd16b974fd395af8a0095c59389, role_id=147a152caf8346259b191a633bb4aee0)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:40.777401 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743c25c2-0e88-4f35-b6bd-065588c45530 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:40.797739 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 114/234] 10.222.0.91 () {58 vars in 1439 bytes} [Tue Aug 30 04:13:40 2022] PUT /identity/v3/projects/2013198a52ce4d88a1546ba74e7ab400/users/855bfcd16b974fd395af8a0095c59389/roles/147a152caf8346259b191a633bb4aee0 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:13:40.800900 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf0d43-e34e-4bcf-8b87-e2e2ce67b5c2 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:40.801186 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf0d43-e34e-4bcf-8b87-e2e2ce67b5c2 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:40.801446 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf0d43-e34e-4bcf-8b87-e2e2ce67b5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:40.847127 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-efcf0d43-e34e-4bcf-8b87-e2e2ce67b5c2 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:40.848660 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-efcf0d43-e34e-4bcf-8b87-e2e2ce67b5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:40.910313 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42586b1b-3d4c-4bb4-9145-3d20f117fc75 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:40.954623 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1965cb5c-f7b6-4329-88cd-1b0fe29c3448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:40.955164 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965cb5c-f7b6-4329-88cd-1b0fe29c3448 None admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:40.955439 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965cb5c-f7b6-4329-88cd-1b0fe29c3448 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:40.955713 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965cb5c-f7b6-4329-88cd-1b0fe29c3448 None admin] PATH_INFO: `/v3/projects/2013198a52ce4d88a1546ba74e7ab400/users/855bfcd16b974fd395af8a0095c59389/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:40.958222 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1965cb5c-f7b6-4329-88cd-1b0fe29c3448 None admin] RBAC: Authorizing `identity:create_grant(project_id=2013198a52ce4d88a1546ba74e7ab400, user_id=855bfcd16b974fd395af8a0095c59389, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:40.959748 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1965cb5c-f7b6-4329-88cd-1b0fe29c3448 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:40.977746 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 115/235] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:13:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:13:40.979809 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19eaf10-47f0-4fe0-854e-53923852af05 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:40.980405 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19eaf10-47f0-4fe0-854e-53923852af05 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:40.981005 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19eaf10-47f0-4fe0-854e-53923852af05 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:40.982720 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 116/236] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:13:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:13:40.987312 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 121/237] 10.222.0.91 () {58 vars in 1439 bytes} [Tue Aug 30 04:13:40 2022] PUT /identity/v3/projects/2013198a52ce4d88a1546ba74e7ab400/users/855bfcd16b974fd395af8a0095c59389/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:13:40.989027 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7c7fe-af30-4b3d-a006-fdfc1a5a8fa7 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:40.989254 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7c7fe-af30-4b3d-a006-fdfc1a5a8fa7 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:40.990124 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7c7fe-af30-4b3d-a006-fdfc1a5a8fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:41.005135 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:41.013191 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-22e7c7fe-af30-4b3d-a006-fdfc1a5a8fa7 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:41.015239 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-22e7c7fe-af30-4b3d-a006-fdfc1a5a8fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:41.056699 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee11cb6-3412-4b51-a95c-e13bfc6c4394 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:41.057809 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee11cb6-3412-4b51-a95c-e13bfc6c4394 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:41.058499 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee11cb6-3412-4b51-a95c-e13bfc6c4394 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:41.061746 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 117/238] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:13:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:13:41.071743 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd11f14-e5eb-4233-bfb0-a677bd3421f7 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:41.072272 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd11f14-e5eb-4233-bfb0-a677bd3421f7 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:41.072737 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd11f14-e5eb-4233-bfb0-a677bd3421f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:41.110667 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-7cd11f14-e5eb-4233-bfb0-a677bd3421f7 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:41.112648 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-7cd11f14-e5eb-4233-bfb0-a677bd3421f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:41.122326 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 122/239] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:13:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:13:41.198762 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:41.269549 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 118/240] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:13:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:13:41.457063 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e7c7fe-af30-4b3d-a006-fdfc1a5a8fa7 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:41.555336 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd11f14-e5eb-4233-bfb0-a677bd3421f7 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:41.703669 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e7c7fe-af30-4b3d-a006-fdfc1a5a8fa7 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:41.774571 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b3be0e-9435-4dc4-a356-9a8601423866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:41.775132 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b3be0e-9435-4dc4-a356-9a8601423866 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:41.775409 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b3be0e-9435-4dc4-a356-9a8601423866 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:41.775701 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b3be0e-9435-4dc4-a356-9a8601423866 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:41.780008 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b3be0e-9435-4dc4-a356-9a8601423866 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:41.781620 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b3be0e-9435-4dc4-a356-9a8601423866 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:41.783412 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 123/241] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:13:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:41.794170 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b3be0e-9435-4dc4-a356-9a8601423866 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:41.801959 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:41.827709 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd11f14-e5eb-4233-bfb0-a677bd3421f7 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:41.871557 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5819b6f5-272b-43bd-96b4-058f24b9b9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:41.872259 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819b6f5-272b-43bd-96b4-058f24b9b9f7 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:41.872538 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819b6f5-272b-43bd-96b4-058f24b9b9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:41.872812 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819b6f5-272b-43bd-96b4-058f24b9b9f7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:41.885804 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5819b6f5-272b-43bd-96b4-058f24b9b9f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:13:41.891860 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-5819b6f5-272b-43bd-96b4-058f24b9b9f7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 04:13:41.891860 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:13:41.891860 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:13:41.891860 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:13:41.891860 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:13:41.891860 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:13:41.891860 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:13:41.891860 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:13:41.891860 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:13:41.891860 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:13:41.891860 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:13:41.891860 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:13:41.891860 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:13:41.891860 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:13:41.891860 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:13:41.891860 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:13:41.893605 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:13:41.893605 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:13:41.893605 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:13:41.893605 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:13:41.893605 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:13:41.893605 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:13:41.893605 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:13:41.893605 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:13:41.893605 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:13:41.893605 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:13:41.893605 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:13:41.893605 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:13:41.893605 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:13:41.893605 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:13:41.893605 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:13:41.893605 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:13:41.896925 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:13:41.896925 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:13:41.896925 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:13:41.896925 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:13:41.896925 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:13:41.896925 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:13:41.896925 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:13:41.896925 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:13:41.896925 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:13:41.896925 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:13:41.896925 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 04:13:41.896925 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:13:41.896925 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 119/242] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 30 04:13:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:13:41.896925 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5819b6f5-272b-43bd-96b4-058f24b9b9f7 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:41.934506 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:41.993213 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b3be0e-9435-4dc4-a356-9a8601423866 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:42.028515 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5819b6f5-272b-43bd-96b4-058f24b9b9f7 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:42.059727 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb16740c-d55c-4728-b96e-ac0797aae74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:42.060678 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16740c-d55c-4728-b96e-ac0797aae74e None admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:42.061116 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16740c-d55c-4728-b96e-ac0797aae74e None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:42.061611 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16740c-d55c-4728-b96e-ac0797aae74e None admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:42.062690 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb16740c-d55c-4728-b96e-ac0797aae74e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:42.065027 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb16740c-d55c-4728-b96e-ac0797aae74e None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:42.071864 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee5630b-4b01-4680-b66d-cbd0582af5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:42.072656 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5630b-4b01-4680-b66d-cbd0582af5e2 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:42.072937 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5630b-4b01-4680-b66d-cbd0582af5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:42.073333 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5630b-4b01-4680-b66d-cbd0582af5e2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:42.088560 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee5630b-4b01-4680-b66d-cbd0582af5e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:13:42.095765 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-9ee5630b-4b01-4680-b66d-cbd0582af5e2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:13:42.095765 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:13:42.095765 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:13:42.095765 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:13:42.095765 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:13:42.095765 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:13:42.095765 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:13:42.095765 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:13:42.095765 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:13:42.095765 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:13:42.095765 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:13:42.095765 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:13:42.095765 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:13:42.095765 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:13:42.095765 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:13:42.095765 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:13:42.099830 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:13:42.099830 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:13:42.099830 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:13:42.099830 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:13:42.099830 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:13:42.099830 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:13:42.099830 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:13:42.099830 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:13:42.099830 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:13:42.099830 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:13:42.099830 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:13:42.099830 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:13:42.099830 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:13:42.099830 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:13:42.099830 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:13:42.099830 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:13:42.102701 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:13:42.102701 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:13:42.102701 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:13:42.102701 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:13:42.102701 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:13:42.102701 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:13:42.102701 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:13:42.102701 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:13:42.102701 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:13:42.102701 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:13:42.102701 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:13:42.102701 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:13:42.102701 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 120/243] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 30 04:13:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:13:42.102701 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee5630b-4b01-4680-b66d-cbd0582af5e2 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:42.112180 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 124/244] 10.222.0.91 () {60 vars in 1132 bytes} [Tue Aug 30 04:13:41 2022] POST /identity/v3/users => generated 293 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:13:42.112180 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb16740c-d55c-4728-b96e-ac0797aae74e None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:42.251895 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:42.341346 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:42.358553 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee5630b-4b01-4680-b66d-cbd0582af5e2 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:42.371496 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb16740c-d55c-4728-b96e-ac0797aae74e None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:42.413658 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eabda55-c486-469d-90ad-9e1f7a94874a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:42.414300 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabda55-c486-469d-90ad-9e1f7a94874a None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:42.414580 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabda55-c486-469d-90ad-9e1f7a94874a None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:42.414853 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabda55-c486-469d-90ad-9e1f7a94874a None admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:42.415553 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eabda55-c486-469d-90ad-9e1f7a94874a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:42.415857 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eabda55-c486-469d-90ad-9e1f7a94874a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:42.418021 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eabda55-c486-469d-90ad-9e1f7a94874a None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:42.432508 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 121/245] 10.222.0.91 () {56 vars in 1101 bytes} [Tue Aug 30 04:13:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:42.440804 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eabda55-c486-469d-90ad-9e1f7a94874a None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:42.461057 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba8ff9d-6e5f-4d9b-9ab8-c409e1aecf5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:42.461698 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8ff9d-6e5f-4d9b-9ab8-c409e1aecf5e None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:42.462118 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8ff9d-6e5f-4d9b-9ab8-c409e1aecf5e None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:42.462394 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8ff9d-6e5f-4d9b-9ab8-c409e1aecf5e None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:42.463154 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba8ff9d-6e5f-4d9b-9ab8-c409e1aecf5e None admin] RBAC: Adding query filter params (name=member) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:42.463430 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba8ff9d-6e5f-4d9b-9ab8-c409e1aecf5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:42.465979 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba8ff9d-6e5f-4d9b-9ab8-c409e1aecf5e None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:42.477997 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 125/246] 10.222.0.91 () {56 vars in 1101 bytes} [Tue Aug 30 04:13:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:42.484210 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba8ff9d-6e5f-4d9b-9ab8-c409e1aecf5e None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:42.576247 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eabda55-c486-469d-90ad-9e1f7a94874a None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:42.623145 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b20cc7c-70fd-40c1-9665-c5e2e3aa1da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:42.623869 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20cc7c-70fd-40c1-9665-c5e2e3aa1da1 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:42.624182 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20cc7c-70fd-40c1-9665-c5e2e3aa1da1 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:42.624474 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20cc7c-70fd-40c1-9665-c5e2e3aa1da1 None admin] PATH_INFO: `/v3/users/cff17f8b6629403ebecc39fd743b979f` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:42.629055 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba8ff9d-6e5f-4d9b-9ab8-c409e1aecf5e None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:42.641104 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b20cc7c-70fd-40c1-9665-c5e2e3aa1da1 None admin] RBAC: Authorizing `identity:get_user(user_id=cff17f8b6629403ebecc39fd743b979f)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:42.642780 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b20cc7c-70fd-40c1-9665-c5e2e3aa1da1 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:42.644937 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 122/247] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 30 04:13:42 2022] GET /identity/v3/users/cff17f8b6629403ebecc39fd743b979f => generated 297 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:42.651294 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b20cc7c-70fd-40c1-9665-c5e2e3aa1da1 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:42.666807 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:42.670177 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:42.695240 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac966c-5232-44c8-8393-36d7fcc239ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:42.696217 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac966c-5232-44c8-8393-36d7fcc239ac None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:42.696675 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac966c-5232-44c8-8393-36d7fcc239ac None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:42.697136 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac966c-5232-44c8-8393-36d7fcc239ac None admin] PATH_INFO: `/v3/users/26a94a02251749d4ad8a27978ec9b5de` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:42.699661 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fac966c-5232-44c8-8393-36d7fcc239ac None admin] RBAC: Authorizing `identity:get_user(user_id=26a94a02251749d4ad8a27978ec9b5de)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:42.702423 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fac966c-5232-44c8-8393-36d7fcc239ac None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:42.705672 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 126/248] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 30 04:13:42 2022] GET /identity/v3/users/26a94a02251749d4ad8a27978ec9b5de => generated 297 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:13:42.715375 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac966c-5232-44c8-8393-36d7fcc239ac None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:42.843973 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b20cc7c-70fd-40c1-9665-c5e2e3aa1da1 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:42.891321 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b28cd32-2ea4-45e7-a7f2-dab78fceda1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:42.892401 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28cd32-2ea4-45e7-a7f2-dab78fceda1e None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:42.892919 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28cd32-2ea4-45e7-a7f2-dab78fceda1e None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:42.893408 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28cd32-2ea4-45e7-a7f2-dab78fceda1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:42.924052 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac966c-5232-44c8-8393-36d7fcc239ac None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:42.972803 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528515b5-7259-41f1-931f-dbb5cffcd396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:42.973543 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528515b5-7259-41f1-931f-dbb5cffcd396 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:42.973996 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528515b5-7259-41f1-931f-dbb5cffcd396 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:42.974215 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528515b5-7259-41f1-931f-dbb5cffcd396 None admin] PATH_INFO: `/v3/projects/2013198a52ce4d88a1546ba74e7ab400` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:42.975604 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528515b5-7259-41f1-931f-dbb5cffcd396 None admin] RBAC: Authorizing `identity:get_project(project_id=2013198a52ce4d88a1546ba74e7ab400)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:42.977445 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528515b5-7259-41f1-931f-dbb5cffcd396 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:42.980003 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 127/249] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 30 04:13:42 2022] GET /identity/v3/projects/2013198a52ce4d88a1546ba74e7ab400 => generated 302 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:13:42.986461 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b28cd32-2ea4-45e7-a7f2-dab78fceda1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:42.986684 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528515b5-7259-41f1-931f-dbb5cffcd396 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:42.988632 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b28cd32-2ea4-45e7-a7f2-dab78fceda1e None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:43.002399 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:43.117087 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:43.160136 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 123/250] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 30 04:13:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:43.164692 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b28cd32-2ea4-45e7-a7f2-dab78fceda1e None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:43.210573 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528515b5-7259-41f1-931f-dbb5cffcd396 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:43.295651 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b3c77-14e7-4422-aefa-e9fa8979622a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:43.296792 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b3c77-14e7-4422-aefa-e9fa8979622a None admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:43.297284 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b3c77-14e7-4422-aefa-e9fa8979622a None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:43.298411 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b3c77-14e7-4422-aefa-e9fa8979622a None admin] PATH_INFO: `/v3/projects/2013198a52ce4d88a1546ba74e7ab400/users/26a94a02251749d4ad8a27978ec9b5de/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:43.306091 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841b3c77-14e7-4422-aefa-e9fa8979622a None admin] RBAC: Authorizing `identity:create_grant(project_id=2013198a52ce4d88a1546ba74e7ab400, user_id=26a94a02251749d4ad8a27978ec9b5de, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:43.308231 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841b3c77-14e7-4422-aefa-e9fa8979622a None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:43.338430 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 128/251] 10.222.0.91 () {58 vars in 1439 bytes} [Tue Aug 30 04:13:42 2022] PUT /identity/v3/projects/2013198a52ce4d88a1546ba74e7ab400/users/26a94a02251749d4ad8a27978ec9b5de/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:13:43.381890 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b28cd32-2ea4-45e7-a7f2-dab78fceda1e None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:43.400716 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:43.429902 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed8bb2-2045-4b73-be64-11c62d3526f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:43.430987 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed8bb2-2045-4b73-be64-11c62d3526f1 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:43.431484 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed8bb2-2045-4b73-be64-11c62d3526f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:43.431998 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed8bb2-2045-4b73-be64-11c62d3526f1 None admin] PATH_INFO: `/v3/projects/2013198a52ce4d88a1546ba74e7ab400` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:43.433938 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ed8bb2-2045-4b73-be64-11c62d3526f1 None admin] RBAC: Authorizing `identity:get_project(project_id=2013198a52ce4d88a1546ba74e7ab400)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:43.435775 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ed8bb2-2045-4b73-be64-11c62d3526f1 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:43.437817 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 124/252] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 30 04:13:43 2022] GET /identity/v3/projects/2013198a52ce4d88a1546ba74e7ab400 => generated 302 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:43.444642 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b3c77-14e7-4422-aefa-e9fa8979622a None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:43.597196 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b3c77-14e7-4422-aefa-e9fa8979622a None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:43.630992 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:43.660049 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee2d73-a8de-43c4-8584-d5c8ae8ded3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:43.660698 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee2d73-a8de-43c4-8584-d5c8ae8ded3d None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:43.660978 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee2d73-a8de-43c4-8584-d5c8ae8ded3d None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:43.661259 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee2d73-a8de-43c4-8584-d5c8ae8ded3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:43.663288 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee2d73-a8de-43c4-8584-d5c8ae8ded3d None admin] RBAC: Adding query filter params (role.id=643830a05faa4c2898407ace9a43df40, scope.project.id=2013198a52ce4d88a1546ba74e7ab400, user.id=cff17f8b6629403ebecc39fd743b979f) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:43.663288 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee2d73-a8de-43c4-8584-d5c8ae8ded3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:43.663842 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee2d73-a8de-43c4-8584-d5c8ae8ded3d None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:43.674791 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 129/253] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 30 04:13:43 2022] GET /identity/v3/role_assignments?user.id=cff17f8b6629403ebecc39fd743b979f&scope.project.id=2013198a52ce4d88a1546ba74e7ab400&role.id=643830a05faa4c2898407ace9a43df40 => generated 259 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:44.045297 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cef18d-fb0e-4f0c-95a1-26f0bf7dd689 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:44.045628 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cef18d-fb0e-4f0c-95a1-26f0bf7dd689 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:44.046026 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cef18d-fb0e-4f0c-95a1-26f0bf7dd689 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:44.047264 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 125/254] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:13:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:13:44.056249 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899fcbdb-7134-4471-82e6-94f51becfffc None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:44.057782 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899fcbdb-7134-4471-82e6-94f51becfffc None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:44.058543 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899fcbdb-7134-4471-82e6-94f51becfffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:44.097168 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-899fcbdb-7134-4471-82e6-94f51becfffc None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:44.098758 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-899fcbdb-7134-4471-82e6-94f51becfffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:44.210274 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 130/255] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:13:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:13:44.466807 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a5f2e-b687-4b7b-9f1f-a0a905c438cf None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:44.467343 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a5f2e-b687-4b7b-9f1f-a0a905c438cf None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:44.467343 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a5f2e-b687-4b7b-9f1f-a0a905c438cf None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:44.469089 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 126/256] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:13:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:13:44.475231 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52886a4-11e4-46d8-a5aa-14484871a7eb None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:44.475540 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52886a4-11e4-46d8-a5aa-14484871a7eb None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:44.475778 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52886a4-11e4-46d8-a5aa-14484871a7eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:44.501192 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-e52886a4-11e4-46d8-a5aa-14484871a7eb None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:44.502446 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-e52886a4-11e4-46d8-a5aa-14484871a7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:44.606687 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 131/257] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:13:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 04:13:44.863757 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a5f2e-b687-4b7b-9f1f-a0a905c438cf None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:45.017669 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a5f2e-b687-4b7b-9f1f-a0a905c438cf None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:45.060069 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f2694-cd95-440e-9540-6900b28d17d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:45.060747 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f2694-cd95-440e-9540-6900b28d17d9 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:45.061027 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f2694-cd95-440e-9540-6900b28d17d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:45.061297 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f2694-cd95-440e-9540-6900b28d17d9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:45.074092 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499f2694-cd95-440e-9540-6900b28d17d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:13:45.079331 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-499f2694-cd95-440e-9540-6900b28d17d9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:13:45.079331 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:13:45.079331 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:13:45.079331 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:13:45.079331 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:13:45.079331 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:13:45.079331 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:13:45.079331 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:13:45.079331 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:13:45.079331 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:13:45.079331 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:13:45.079331 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:13:45.079331 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:13:45.079331 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:13:45.079331 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:13:45.079331 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:13:45.080313 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:13:45.080313 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:13:45.080313 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:13:45.080313 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:13:45.080313 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:13:45.080313 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:13:45.080313 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:13:45.080313 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:13:45.080313 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:13:45.080313 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:13:45.080313 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:13:45.080313 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:13:45.080313 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:13:45.080313 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:13:45.080313 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:13:45.080313 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:13:45.081105 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:13:45.081105 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:13:45.081105 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:13:45.081105 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:13:45.081105 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:13:45.081105 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:13:45.081105 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:13:45.081105 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:13:45.081105 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:13:45.081105 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:13:45.081105 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:13:45.081105 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:13:45.081105 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 127/258] 10.222.0.91 () {56 vars in 1114 bytes} [Tue Aug 30 04:13:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:13:45.090161 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52886a4-11e4-46d8-a5aa-14484871a7eb None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:45.170358 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:45.225345 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f2694-cd95-440e-9540-6900b28d17d9 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:45.257372 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52886a4-11e4-46d8-a5aa-14484871a7eb None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:45.312029 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:45.329532 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef749ae-cc4d-4a8a-8486-9520db7b8ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:45.330173 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef749ae-cc4d-4a8a-8486-9520db7b8ff4 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:45.330459 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef749ae-cc4d-4a8a-8486-9520db7b8ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:45.330711 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef749ae-cc4d-4a8a-8486-9520db7b8ff4 None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:45.331543 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef749ae-cc4d-4a8a-8486-9520db7b8ff4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:45.331976 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef749ae-cc4d-4a8a-8486-9520db7b8ff4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:45.333518 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef749ae-cc4d-4a8a-8486-9520db7b8ff4 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:45.352670 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 132/259] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 30 04:13:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:45.355996 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef749ae-cc4d-4a8a-8486-9520db7b8ff4 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:45.436525 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f2694-cd95-440e-9540-6900b28d17d9 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:45.530981 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce8406c-6e5b-414b-a44a-e5043893a48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:45.533484 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8406c-6e5b-414b-a44a-e5043893a48c None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:45.534296 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8406c-6e5b-414b-a44a-e5043893a48c None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:45.535054 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8406c-6e5b-414b-a44a-e5043893a48c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:45.575193 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce8406c-6e5b-414b-a44a-e5043893a48c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:13:45.594652 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-4ce8406c-6e5b-414b-a44a-e5043893a48c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:13:45.594652 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:13:45.594652 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:13:45.594652 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:13:45.594652 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:13:45.594652 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:13:45.594652 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:13:45.594652 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:13:45.594652 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:13:45.594652 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:13:45.594652 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:13:45.594652 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:13:45.594652 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:13:45.594652 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:13:45.594652 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:13:45.594652 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:13:45.596365 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:13:45.596365 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:13:45.596365 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:13:45.596365 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:13:45.596365 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:13:45.596365 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:13:45.596365 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:13:45.596365 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:13:45.596365 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:13:45.596365 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:13:45.596365 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:13:45.596365 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:13:45.596365 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:13:45.596365 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:13:45.596365 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:13:45.596365 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:13:45.597867 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:13:45.597867 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:13:45.597867 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:13:45.597867 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:13:45.597867 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:13:45.597867 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:13:45.597867 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:13:45.597867 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:13:45.597867 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:13:45.597867 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:13:45.597867 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:13:45.597867 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:13:45.602204 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 128/260] 10.222.0.91 () {56 vars in 1096 bytes} [Tue Aug 30 04:13:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:13:45.621916 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef749ae-cc4d-4a8a-8486-9520db7b8ff4 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:45.631959 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce8406c-6e5b-414b-a44a-e5043893a48c None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:45.641067 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:45.742036 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6b7e3b-c567-4163-a587-d0fb9e4f3b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:45.746315 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b7e3b-c567-4163-a587-d0fb9e4f3b40 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:45.747128 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b7e3b-c567-4163-a587-d0fb9e4f3b40 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:45.747742 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b7e3b-c567-4163-a587-d0fb9e4f3b40 None admin] PATH_INFO: `/v3/users/855bfcd16b974fd395af8a0095c59389` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:45.755593 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6b7e3b-c567-4163-a587-d0fb9e4f3b40 None admin] RBAC: Authorizing `identity:get_user(user_id=855bfcd16b974fd395af8a0095c59389)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:45.757746 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6b7e3b-c567-4163-a587-d0fb9e4f3b40 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:45.760601 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 133/261] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 30 04:13:45 2022] GET /identity/v3/users/855bfcd16b974fd395af8a0095c59389 => generated 283 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:13:45.774983 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6b7e3b-c567-4163-a587-d0fb9e4f3b40 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:45.985447 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6b7e3b-c567-4163-a587-d0fb9e4f3b40 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:46.039441 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:46.051477 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce8406c-6e5b-414b-a44a-e5043893a48c None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:46.064708 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11876be3-c474-47c2-a70c-2374f611a3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:46.065364 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11876be3-c474-47c2-a70c-2374f611a3d5 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:46.065647 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11876be3-c474-47c2-a70c-2374f611a3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:46.065924 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11876be3-c474-47c2-a70c-2374f611a3d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:46.163712 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c5cea-bf8c-4c77-8c9d-ec7ce440d700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:46.164977 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c5cea-bf8c-4c77-8c9d-ec7ce440d700 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:46.165507 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c5cea-bf8c-4c77-8c9d-ec7ce440d700 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:46.165976 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c5cea-bf8c-4c77-8c9d-ec7ce440d700 None admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:46.166944 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0c5cea-bf8c-4c77-8c9d-ec7ce440d700 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:46.167739 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0c5cea-bf8c-4c77-8c9d-ec7ce440d700 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:46.170541 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0c5cea-bf8c-4c77-8c9d-ec7ce440d700 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:46.174313 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:46.190950 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 129/262] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 30 04:13:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 577 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:13:46.200181 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c5cea-bf8c-4c77-8c9d-ec7ce440d700 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:46.249270 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11876be3-c474-47c2-a70c-2374f611a3d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:46.250819 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11876be3-c474-47c2-a70c-2374f611a3d5 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:46.449234 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c5cea-bf8c-4c77-8c9d-ec7ce440d700 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:46.522205 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bed5aa-7076-45ba-998c-b16704ac2557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:46.522940 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bed5aa-7076-45ba-998c-b16704ac2557 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:46.523220 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bed5aa-7076-45ba-998c-b16704ac2557 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:46.523488 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bed5aa-7076-45ba-998c-b16704ac2557 None admin] PATH_INFO: `/v3/users/855bfcd16b974fd395af8a0095c59389` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:46.528890 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bed5aa-7076-45ba-998c-b16704ac2557 None admin] RBAC: Authorizing `identity:get_user(user_id=855bfcd16b974fd395af8a0095c59389)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:46.530421 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bed5aa-7076-45ba-998c-b16704ac2557 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:46.532565 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 130/263] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 30 04:13:46 2022] GET /identity/v3/users/855bfcd16b974fd395af8a0095c59389 => generated 283 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:13:46.542464 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bed5aa-7076-45ba-998c-b16704ac2557 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:46.594002 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:46.700678 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 134/264] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 30 04:13:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 927 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:46.715514 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11876be3-c474-47c2-a70c-2374f611a3d5 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:46.776274 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bed5aa-7076-45ba-998c-b16704ac2557 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:46.915452 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2436e94a-675d-4616-b6d8-67bfe8313483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:46.917075 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2436e94a-675d-4616-b6d8-67bfe8313483 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:46.918047 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2436e94a-675d-4616-b6d8-67bfe8313483 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:46.919176 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2436e94a-675d-4616-b6d8-67bfe8313483 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:46.948558 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:47.015146 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11876be3-c474-47c2-a70c-2374f611a3d5 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:47.073554 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2436e94a-675d-4616-b6d8-67bfe8313483 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:47.075114 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2436e94a-675d-4616-b6d8-67bfe8313483 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:47.107000 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:47.108926 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88944309-822d-4337-974e-86df9107f7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:47.110408 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88944309-822d-4337-974e-86df9107f7a4 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:47.111220 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88944309-822d-4337-974e-86df9107f7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:47.111893 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88944309-822d-4337-974e-86df9107f7a4 None admin] PATH_INFO: `/v3/projects/2013198a52ce4d88a1546ba74e7ab400` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:47.114100 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88944309-822d-4337-974e-86df9107f7a4 None admin] RBAC: Authorizing `identity:get_project(project_id=2013198a52ce4d88a1546ba74e7ab400)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:47.117136 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88944309-822d-4337-974e-86df9107f7a4 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:47.123005 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 135/265] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 30 04:13:46 2022] GET /identity/v3/projects/2013198a52ce4d88a1546ba74e7ab400 => generated 302 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:47.126029 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9998c-05c9-4338-a269-a6f1561806ab None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:47.126762 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9998c-05c9-4338-a269-a6f1561806ab None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:47.127411 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9998c-05c9-4338-a269-a6f1561806ab None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:47.130287 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 136/266] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:13:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:13:47.133351 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892f7ac-551d-4b46-b177-488cf4fef395 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:47.134082 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892f7ac-551d-4b46-b177-488cf4fef395 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:47.134766 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892f7ac-551d-4b46-b177-488cf4fef395 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:47.138369 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 137/267] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:13:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:13:47.140137 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6892f7ac-551d-4b46-b177-488cf4fef395 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:47.226210 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 131/268] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 30 04:13:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 684 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 04:13:47.229077 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d9497-31ad-47cd-9dbb-4da884a94224 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:47.229895 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d9497-31ad-47cd-9dbb-4da884a94224 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:47.230552 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d9497-31ad-47cd-9dbb-4da884a94224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:47.263689 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-714d9497-31ad-47cd-9dbb-4da884a94224 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:47.266301 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-714d9497-31ad-47cd-9dbb-4da884a94224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:47.330377 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6892f7ac-551d-4b46-b177-488cf4fef395 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:47.367465 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 132/269] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:13:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:13:47.369294 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4ef63-60d1-4b4a-8eb2-7ffdd2b33c4a None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:47.369969 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4ef63-60d1-4b4a-8eb2-7ffdd2b33c4a None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:47.370583 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4ef63-60d1-4b4a-8eb2-7ffdd2b33c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:47.389363 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d0467-ceb9-4181-8d3d-0adf64fb2a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:47.390935 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d0467-ceb9-4181-8d3d-0adf64fb2a7b None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:47.391771 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d0467-ceb9-4181-8d3d-0adf64fb2a7b None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:47.392507 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d0467-ceb9-4181-8d3d-0adf64fb2a7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:47.394065 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98d0467-ceb9-4181-8d3d-0adf64fb2a7b None admin] RBAC: Adding query filter params (role.id=147a152caf8346259b191a633bb4aee0, scope.project.id=2013198a52ce4d88a1546ba74e7ab400, user.id=855bfcd16b974fd395af8a0095c59389) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:47.394971 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98d0467-ceb9-4181-8d3d-0adf64fb2a7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:47.398806 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98d0467-ceb9-4181-8d3d-0adf64fb2a7b None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:47.406651 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-8af4ef63-60d1-4b4a-8eb2-7ffdd2b33c4a None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:47.408871 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-8af4ef63-60d1-4b4a-8eb2-7ffdd2b33c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:47.411526 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 138/270] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 30 04:13:47 2022] GET /identity/v3/role_assignments?user.id=855bfcd16b974fd395af8a0095c59389&scope.project.id=2013198a52ce4d88a1546ba74e7ab400&role.id=147a152caf8346259b191a633bb4aee0 => generated 608 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:47.413613 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d0467-ceb9-4181-8d3d-0adf64fb2a7b None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:47.422909 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:47.592970 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:47.641222 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 133/271] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:13:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:13:47.644833 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a28d87-d511-485d-8c8b-654d514212e8 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:47.645607 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a28d87-d511-485d-8c8b-654d514212e8 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:47.646362 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a28d87-d511-485d-8c8b-654d514212e8 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:47.649028 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 134/272] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:13:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:13:47.651729 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6abaa-4d23-4fcd-a19d-efede91659ef None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:47.652602 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6abaa-4d23-4fcd-a19d-efede91659ef None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:47.653302 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6abaa-4d23-4fcd-a19d-efede91659ef None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:47.656385 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 135/273] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:13:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:13:47.658743 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c3a12e-e2d5-4aec-abf0-ea76058cc521 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:47.659486 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c3a12e-e2d5-4aec-abf0-ea76058cc521 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:47.660300 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c3a12e-e2d5-4aec-abf0-ea76058cc521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:47.694266 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-43c3a12e-e2d5-4aec-abf0-ea76058cc521 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:47.696798 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-43c3a12e-e2d5-4aec-abf0-ea76058cc521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:47.705023 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d0467-ceb9-4181-8d3d-0adf64fb2a7b None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:47.775090 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fccdc9-b18f-4aa7-9067-cad60e186b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:47.776230 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fccdc9-b18f-4aa7-9067-cad60e186b64 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:47.776716 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fccdc9-b18f-4aa7-9067-cad60e186b64 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:47.777424 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fccdc9-b18f-4aa7-9067-cad60e186b64 None admin] PATH_INFO: `/v3/projects/2013198a52ce4d88a1546ba74e7ab400` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:47.779516 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fccdc9-b18f-4aa7-9067-cad60e186b64 None admin] RBAC: Authorizing `identity:get_project(project_id=2013198a52ce4d88a1546ba74e7ab400)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:47.782093 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fccdc9-b18f-4aa7-9067-cad60e186b64 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:47.786252 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 139/274] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 30 04:13:47 2022] GET /identity/v3/projects/2013198a52ce4d88a1546ba74e7ab400 => generated 302 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:47.792621 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac026f0-3424-46cc-b3eb-4b41f0d5b921 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:47.795036 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac026f0-3424-46cc-b3eb-4b41f0d5b921 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:47.795827 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac026f0-3424-46cc-b3eb-4b41f0d5b921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:47.828801 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-9ac026f0-3424-46cc-b3eb-4b41f0d5b921 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:47.831309 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-9ac026f0-3424-46cc-b3eb-4b41f0d5b921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:47.848113 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 136/275] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:13:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:13:47.850419 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c3a12e-e2d5-4aec-abf0-ea76058cc521 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:47.976233 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 140/276] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:13:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:13:48.035772 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac026f0-3424-46cc-b3eb-4b41f0d5b921 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:48.048452 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:48.075766 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c3a12e-e2d5-4aec-abf0-ea76058cc521 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:48.121288 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:48.163028 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e272b66-eaab-41be-83fd-2e2a22ee827a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:48.164283 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e272b66-eaab-41be-83fd-2e2a22ee827a None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:48.165963 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e272b66-eaab-41be-83fd-2e2a22ee827a None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:48.166738 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e272b66-eaab-41be-83fd-2e2a22ee827a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:48.169063 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e272b66-eaab-41be-83fd-2e2a22ee827a None admin] RBAC: Adding query filter params (role.id=d8f440a82947486ebb20a633ebee736b, scope.project.id=2013198a52ce4d88a1546ba74e7ab400, user.id=855bfcd16b974fd395af8a0095c59389) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:48.169620 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e272b66-eaab-41be-83fd-2e2a22ee827a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:48.173028 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e272b66-eaab-41be-83fd-2e2a22ee827a None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:48.189238 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 137/277] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 30 04:13:47 2022] GET /identity/v3/role_assignments?user.id=855bfcd16b974fd395af8a0095c59389&scope.project.id=2013198a52ce4d88a1546ba74e7ab400&role.id=d8f440a82947486ebb20a633ebee736b => generated 608 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:48.192107 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e272b66-eaab-41be-83fd-2e2a22ee827a None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:48.203629 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac026f0-3424-46cc-b3eb-4b41f0d5b921 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:48.297987 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f2cec-2a2e-42ad-a2ee-986d7c71a65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:48.298952 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f2cec-2a2e-42ad-a2ee-986d7c71a65b None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:48.299386 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f2cec-2a2e-42ad-a2ee-986d7c71a65b None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:48.299863 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f2cec-2a2e-42ad-a2ee-986d7c71a65b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:48.302084 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5f2cec-2a2e-42ad-a2ee-986d7c71a65b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:48.307956 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5f2cec-2a2e-42ad-a2ee-986d7c71a65b None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:48.309241 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 141/278] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:13:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:48.318372 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f2cec-2a2e-42ad-a2ee-986d7c71a65b None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:48.458469 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e272b66-eaab-41be-83fd-2e2a22ee827a None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:48.471235 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:48.526469 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea8ee3-e3ee-4461-823b-301821f35a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:48.527590 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea8ee3-e3ee-4461-823b-301821f35a42 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:48.528096 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea8ee3-e3ee-4461-823b-301821f35a42 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:48.528595 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea8ee3-e3ee-4461-823b-301821f35a42 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:48.537668 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f2cec-2a2e-42ad-a2ee-986d7c71a65b None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:48.550116 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dea8ee3-e3ee-4461-823b-301821f35a42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:13:48.558632 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-8dea8ee3-e3ee-4461-823b-301821f35a42 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:13:48.558632 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:13:48.558632 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:13:48.558632 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:13:48.558632 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:13:48.558632 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:13:48.558632 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:13:48.558632 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:13:48.558632 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:13:48.558632 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:13:48.558632 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:13:48.558632 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:13:48.558632 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:13:48.558632 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:13:48.558632 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:13:48.558632 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:13:48.560424 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:13:48.560424 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:13:48.560424 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:13:48.560424 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:13:48.560424 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:13:48.560424 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:13:48.560424 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:13:48.560424 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:13:48.560424 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:13:48.560424 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:13:48.560424 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:13:48.560424 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:13:48.560424 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:13:48.560424 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:13:48.560424 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:13:48.560424 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:13:48.562000 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:13:48.562000 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:13:48.562000 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:13:48.562000 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:13:48.562000 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:13:48.562000 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:13:48.562000 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:13:48.562000 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:13:48.562000 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:13:48.562000 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:13:48.562000 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:13:48.562000 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:13:48.562000 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 138/279] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 30 04:13:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:13:48.563259 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea8ee3-e3ee-4461-823b-301821f35a42 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:48.603042 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46663880-6a41-4f8e-be7f-58ea7b4611f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:48.603699 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46663880-6a41-4f8e-be7f-58ea7b4611f7 None admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:48.604016 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46663880-6a41-4f8e-be7f-58ea7b4611f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:48.604732 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46663880-6a41-4f8e-be7f-58ea7b4611f7 None admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:48.607208 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46663880-6a41-4f8e-be7f-58ea7b4611f7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:48.608893 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46663880-6a41-4f8e-be7f-58ea7b4611f7 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:48.635486 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:48.637408 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 142/280] 10.222.0.91 () {60 vars in 1132 bytes} [Tue Aug 30 04:13:48 2022] POST /identity/v3/users => generated 293 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:13:48.638395 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46663880-6a41-4f8e-be7f-58ea7b4611f7 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:48.730790 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea8ee3-e3ee-4461-823b-301821f35a42 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:48.781179 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c66aadc-9530-4455-8f77-827198018338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:48.781859 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c66aadc-9530-4455-8f77-827198018338 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:48.782141 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c66aadc-9530-4455-8f77-827198018338 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:48.782415 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c66aadc-9530-4455-8f77-827198018338 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:48.798559 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c66aadc-9530-4455-8f77-827198018338 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:13:48.802364 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46663880-6a41-4f8e-be7f-58ea7b4611f7 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:48.804859 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-7c66aadc-9530-4455-8f77-827198018338 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:13:48.804859 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:13:48.804859 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:13:48.804859 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:13:48.804859 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:13:48.804859 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:13:48.804859 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:13:48.804859 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:13:48.804859 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:13:48.804859 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:13:48.804859 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:13:48.804859 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:13:48.804859 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:13:48.804859 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:13:48.804859 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:13:48.804859 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:13:48.806599 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:13:48.806599 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:13:48.806599 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:13:48.806599 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:13:48.806599 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:13:48.806599 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:13:48.806599 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:13:48.806599 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:13:48.806599 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:13:48.806599 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:13:48.806599 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:13:48.806599 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:13:48.806599 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:13:48.806599 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:13:48.806599 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:13:48.806599 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:13:48.808388 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:13:48.808388 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:13:48.808388 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:13:48.808388 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:13:48.808388 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:13:48.808388 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:13:48.808388 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:13:48.808388 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:13:48.808388 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:13:48.808388 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:13:48.808388 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:13:48.808388 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:13:48.808388 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 139/281] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 30 04:13:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:13:48.808388 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c66aadc-9530-4455-8f77-827198018338 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:48.848717 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:48.865423 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c83ff6b-6266-42df-ab3f-0d8a5a6761df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:48.866347 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83ff6b-6266-42df-ab3f-0d8a5a6761df None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:48.866740 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83ff6b-6266-42df-ab3f-0d8a5a6761df None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:48.867122 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83ff6b-6266-42df-ab3f-0d8a5a6761df None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:48.884285 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c83ff6b-6266-42df-ab3f-0d8a5a6761df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:13:48.891902 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-2c83ff6b-6266-42df-ab3f-0d8a5a6761df None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 04:13:48.891902 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:13:48.891902 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:13:48.891902 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:13:48.891902 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:13:48.891902 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:13:48.891902 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:13:48.891902 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:13:48.891902 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:13:48.891902 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:13:48.891902 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:13:48.891902 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:13:48.891902 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:13:48.891902 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:13:48.891902 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:13:48.891902 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:13:48.893699 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:13:48.893699 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:13:48.893699 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:13:48.893699 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:13:48.893699 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:13:48.893699 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:13:48.893699 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:13:48.893699 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:13:48.893699 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:13:48.893699 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:13:48.893699 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:13:48.893699 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:13:48.893699 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:13:48.893699 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:13:48.893699 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:13:48.893699 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:13:48.895264 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:13:48.895264 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:13:48.895264 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:13:48.895264 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:13:48.895264 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:13:48.895264 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:13:48.895264 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:13:48.895264 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:13:48.895264 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:13:48.895264 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:13:48.895264 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 04:13:48.895264 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:13:48.895264 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 143/282] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 30 04:13:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:13:48.896564 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c83ff6b-6266-42df-ab3f-0d8a5a6761df None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:48.982532 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c66aadc-9530-4455-8f77-827198018338 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:48.984950 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:49.052806 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e755b8f0-cb4c-4828-9304-3d1c443ad10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:49.053483 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e755b8f0-cb4c-4828-9304-3d1c443ad10f None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:49.053732 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e755b8f0-cb4c-4828-9304-3d1c443ad10f None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:49.054007 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e755b8f0-cb4c-4828-9304-3d1c443ad10f None admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:49.054790 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e755b8f0-cb4c-4828-9304-3d1c443ad10f None admin] RBAC: Adding query filter params (name=member) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:49.055197 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e755b8f0-cb4c-4828-9304-3d1c443ad10f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:49.058228 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e755b8f0-cb4c-4828-9304-3d1c443ad10f None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:49.066648 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c83ff6b-6266-42df-ab3f-0d8a5a6761df None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:49.068359 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 140/283] 10.222.0.91 () {56 vars in 1101 bytes} [Tue Aug 30 04:13:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:49.069276 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e755b8f0-cb4c-4828-9304-3d1c443ad10f None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:49.134320 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb0e36c-f6b1-458b-add0-5f1bd271fe5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:49.134981 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb0e36c-f6b1-458b-add0-5f1bd271fe5c None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:49.135263 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb0e36c-f6b1-458b-add0-5f1bd271fe5c None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:49.135655 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb0e36c-f6b1-458b-add0-5f1bd271fe5c None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:49.137220 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb0e36c-f6b1-458b-add0-5f1bd271fe5c None admin] RBAC: Adding query filter params (name=member) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:49.137220 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb0e36c-f6b1-458b-add0-5f1bd271fe5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:49.138232 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb0e36c-f6b1-458b-add0-5f1bd271fe5c None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:49.149947 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 144/284] 10.222.0.91 () {56 vars in 1101 bytes} [Tue Aug 30 04:13:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:49.150953 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb0e36c-f6b1-458b-add0-5f1bd271fe5c None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:49.241780 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:49.270208 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e755b8f0-cb4c-4828-9304-3d1c443ad10f None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:49.312002 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb0e36c-f6b1-458b-add0-5f1bd271fe5c None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:49.342390 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec5ae8-bf6b-4d26-b3f3-be6206d874dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:49.343026 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec5ae8-bf6b-4d26-b3f3-be6206d874dc None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:49.343308 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec5ae8-bf6b-4d26-b3f3-be6206d874dc None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:49.343595 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec5ae8-bf6b-4d26-b3f3-be6206d874dc None admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:49.344578 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ec5ae8-bf6b-4d26-b3f3-be6206d874dc None admin] RBAC: Adding query filter params (name=reader) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:49.344883 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ec5ae8-bf6b-4d26-b3f3-be6206d874dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:49.346993 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ec5ae8-bf6b-4d26-b3f3-be6206d874dc None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:49.359441 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 141/285] 10.222.0.91 () {56 vars in 1101 bytes} [Tue Aug 30 04:13:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:49.361274 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec5ae8-bf6b-4d26-b3f3-be6206d874dc None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:49.378430 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4990aa0e-d2c4-44e2-9d1d-86011215dc5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:49.379600 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4990aa0e-d2c4-44e2-9d1d-86011215dc5a None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:49.380348 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4990aa0e-d2c4-44e2-9d1d-86011215dc5a None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:49.380632 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4990aa0e-d2c4-44e2-9d1d-86011215dc5a None admin] PATH_INFO: `/v3/users/92ec18c2add9425ca044194fb3616e7a` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:49.406555 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4990aa0e-d2c4-44e2-9d1d-86011215dc5a None admin] RBAC: Authorizing `identity:get_user(user_id=92ec18c2add9425ca044194fb3616e7a)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:49.408115 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4990aa0e-d2c4-44e2-9d1d-86011215dc5a None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:49.410495 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 145/286] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 30 04:13:49 2022] GET /identity/v3/users/92ec18c2add9425ca044194fb3616e7a => generated 293 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:49.411409 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4990aa0e-d2c4-44e2-9d1d-86011215dc5a None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:49.427506 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:49.560078 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec5ae8-bf6b-4d26-b3f3-be6206d874dc None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:49.627283 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4990aa0e-d2c4-44e2-9d1d-86011215dc5a None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:49.637637 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c9ca88-d568-4ffc-ae64-098aa4382b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:49.639660 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9ca88-d568-4ffc-ae64-098aa4382b37 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:49.640748 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9ca88-d568-4ffc-ae64-098aa4382b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:49.641385 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9ca88-d568-4ffc-ae64-098aa4382b37 None admin] PATH_INFO: `/v3/users/26a94a02251749d4ad8a27978ec9b5de` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:49.643940 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:49.645470 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c9ca88-d568-4ffc-ae64-098aa4382b37 None admin] RBAC: Authorizing `identity:get_user(user_id=26a94a02251749d4ad8a27978ec9b5de)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:49.649986 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c9ca88-d568-4ffc-ae64-098aa4382b37 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:49.663951 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 142/287] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 30 04:13:49 2022] GET /identity/v3/users/26a94a02251749d4ad8a27978ec9b5de => generated 297 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:49.663951 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c9ca88-d568-4ffc-ae64-098aa4382b37 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:49.713026 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e46419-46d9-432b-9527-337ba5559316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:49.714196 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e46419-46d9-432b-9527-337ba5559316 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:49.714613 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e46419-46d9-432b-9527-337ba5559316 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:49.715226 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e46419-46d9-432b-9527-337ba5559316 None admin] PATH_INFO: `/v3/users/cff17f8b6629403ebecc39fd743b979f` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:49.717619 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e46419-46d9-432b-9527-337ba5559316 None admin] RBAC: Authorizing `identity:get_user(user_id=cff17f8b6629403ebecc39fd743b979f)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:49.721201 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e46419-46d9-432b-9527-337ba5559316 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:49.728034 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 146/288] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 30 04:13:49 2022] GET /identity/v3/users/cff17f8b6629403ebecc39fd743b979f => generated 297 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:49.730060 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e46419-46d9-432b-9527-337ba5559316 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:49.876096 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:49.890655 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c9ca88-d568-4ffc-ae64-098aa4382b37 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:49.936784 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e46419-46d9-432b-9527-337ba5559316 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:49.968690 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a2d72b-1229-479b-894a-2c00753e2cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:49.970183 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2d72b-1229-479b-894a-2c00753e2cc1 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:49.970650 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2d72b-1229-479b-894a-2c00753e2cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:49.971104 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2d72b-1229-479b-894a-2c00753e2cc1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:49.973129 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a2d72b-1229-479b-894a-2c00753e2cc1 None admin] RBAC: Adding query filter params (role.id=1aaf128d062240b28b37771b36f6b38b, user.id=92ec18c2add9425ca044194fb3616e7a, scope.system=all) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:49.973732 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a2d72b-1229-479b-894a-2c00753e2cc1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:49.977115 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a2d72b-1229-479b-894a-2c00753e2cc1 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:49.989506 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 143/289] 10.222.0.91 () {56 vars in 1308 bytes} [Tue Aug 30 04:13:49 2022] GET /identity/v3/role_assignments?user.id=92ec18c2add9425ca044194fb3616e7a&scope.system=all&role.id=1aaf128d062240b28b37771b36f6b38b => generated 226 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:49.991453 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a2d72b-1229-479b-894a-2c00753e2cc1 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:50.008482 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa0e3ed-bb9d-4e27-90df-1d8af32c0407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:50.009997 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0e3ed-bb9d-4e27-90df-1d8af32c0407 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:50.010922 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0e3ed-bb9d-4e27-90df-1d8af32c0407 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:50.011890 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0e3ed-bb9d-4e27-90df-1d8af32c0407 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:50.122375 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:50.164153 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a2d72b-1229-479b-894a-2c00753e2cc1 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:50.173342 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa0e3ed-bb9d-4e27-90df-1d8af32c0407 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:50.176673 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa0e3ed-bb9d-4e27-90df-1d8af32c0407 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:50.212158 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6048d5-b630-455d-9b84-61c18eb71802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:50.212834 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6048d5-b630-455d-9b84-61c18eb71802 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:50.213117 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6048d5-b630-455d-9b84-61c18eb71802 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:50.213549 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6048d5-b630-455d-9b84-61c18eb71802 None admin] PATH_INFO: `/v3/projects/2013198a52ce4d88a1546ba74e7ab400` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:50.215446 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6048d5-b630-455d-9b84-61c18eb71802 None admin] RBAC: Authorizing `identity:get_project(project_id=2013198a52ce4d88a1546ba74e7ab400)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:50.217030 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6048d5-b630-455d-9b84-61c18eb71802 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:50.224050 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 144/290] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 30 04:13:49 2022] GET /identity/v3/projects/2013198a52ce4d88a1546ba74e7ab400 => generated 302 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:50.226099 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6048d5-b630-455d-9b84-61c18eb71802 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:50.268188 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:50.382242 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6048d5-b630-455d-9b84-61c18eb71802 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:50.410459 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 147/291] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 30 04:13:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 682 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:50.421067 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa0e3ed-bb9d-4e27-90df-1d8af32c0407 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:50.433782 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e519d54-a02a-4b4d-9275-0c96359a0535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:50.434968 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e519d54-a02a-4b4d-9275-0c96359a0535 None admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:50.435422 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e519d54-a02a-4b4d-9275-0c96359a0535 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:50.435931 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e519d54-a02a-4b4d-9275-0c96359a0535 None admin] PATH_INFO: `/v3/projects/2013198a52ce4d88a1546ba74e7ab400/users/cff17f8b6629403ebecc39fd743b979f/roles/643830a05faa4c2898407ace9a43df40` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:50.439688 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e519d54-a02a-4b4d-9275-0c96359a0535 None admin] RBAC: Authorizing `identity:create_grant(project_id=2013198a52ce4d88a1546ba74e7ab400, user_id=cff17f8b6629403ebecc39fd743b979f, role_id=643830a05faa4c2898407ace9a43df40)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:50.442442 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e519d54-a02a-4b4d-9275-0c96359a0535 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:50.478012 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 145/292] 10.222.0.91 () {58 vars in 1439 bytes} [Tue Aug 30 04:13:50 2022] PUT /identity/v3/projects/2013198a52ce4d88a1546ba74e7ab400/users/cff17f8b6629403ebecc39fd743b979f/roles/643830a05faa4c2898407ace9a43df40 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:13:50.596865 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:50.679077 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa0e3ed-bb9d-4e27-90df-1d8af32c0407 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:50.752097 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de51807-c66f-4393-b90d-3327a3c7859b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:50.753384 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de51807-c66f-4393-b90d-3327a3c7859b None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:50.753932 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de51807-c66f-4393-b90d-3327a3c7859b None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:50.754493 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de51807-c66f-4393-b90d-3327a3c7859b None admin] PATH_INFO: `/v3/projects/2013198a52ce4d88a1546ba74e7ab400` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:50.756886 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de51807-c66f-4393-b90d-3327a3c7859b None admin] RBAC: Authorizing `identity:get_project(project_id=2013198a52ce4d88a1546ba74e7ab400)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:50.759742 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de51807-c66f-4393-b90d-3327a3c7859b None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:50.768129 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 148/293] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 30 04:13:50 2022] GET /identity/v3/projects/2013198a52ce4d88a1546ba74e7ab400 => generated 302 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:50.774087 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e519d54-a02a-4b4d-9275-0c96359a0535 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:50.993071 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:51.015604 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e519d54-a02a-4b4d-9275-0c96359a0535 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:51.071395 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba525d3-2ff6-4e13-8247-52efac978ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:51.072047 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba525d3-2ff6-4e13-8247-52efac978ba4 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:51.072327 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba525d3-2ff6-4e13-8247-52efac978ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:51.072606 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba525d3-2ff6-4e13-8247-52efac978ba4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:51.073450 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba525d3-2ff6-4e13-8247-52efac978ba4 None admin] RBAC: Adding query filter params (role.id=1aaf128d062240b28b37771b36f6b38b, scope.project.id=2013198a52ce4d88a1546ba74e7ab400, user.id=26a94a02251749d4ad8a27978ec9b5de) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:51.073761 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba525d3-2ff6-4e13-8247-52efac978ba4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:51.075319 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba525d3-2ff6-4e13-8247-52efac978ba4 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:51.083127 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 146/294] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 30 04:13:50 2022] GET /identity/v3/role_assignments?user.id=26a94a02251749d4ad8a27978ec9b5de&scope.project.id=2013198a52ce4d88a1546ba74e7ab400&role.id=1aaf128d062240b28b37771b36f6b38b => generated 608 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:51.743653 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e6e974-5ef3-49f6-be94-f8e0cfc673ac None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:51.744914 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e6e974-5ef3-49f6-be94-f8e0cfc673ac None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:51.745610 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e6e974-5ef3-49f6-be94-f8e0cfc673ac None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:51.747901 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 149/295] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:13:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:13:51.754420 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad1eaa-d2d7-4602-94bd-c5501b14326b None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:51.755077 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad1eaa-d2d7-4602-94bd-c5501b14326b None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:51.755626 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad1eaa-d2d7-4602-94bd-c5501b14326b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:51.779153 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-32ad1eaa-d2d7-4602-94bd-c5501b14326b None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:51.781210 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-32ad1eaa-d2d7-4602-94bd-c5501b14326b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:51.874240 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 147/296] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:13:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:13:52.202177 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4039df6-521f-4fb6-a89b-881b846e2a65 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:52.202509 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4039df6-521f-4fb6-a89b-881b846e2a65 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:52.202930 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4039df6-521f-4fb6-a89b-881b846e2a65 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:52.204511 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 150/297] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:13:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:13:52.210840 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48425ab-9e8c-498f-9754-2ef04431b404 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:52.211244 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48425ab-9e8c-498f-9754-2ef04431b404 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:52.211434 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48425ab-9e8c-498f-9754-2ef04431b404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:52.231847 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-c48425ab-9e8c-498f-9754-2ef04431b404 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:52.233159 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-c48425ab-9e8c-498f-9754-2ef04431b404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:52.312325 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 148/298] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:13:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:13:52.324868 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4039df6-521f-4fb6-a89b-881b846e2a65 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:52.498433 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4039df6-521f-4fb6-a89b-881b846e2a65 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:52.541801 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebad767-412a-412d-b0dd-44c94c978fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:52.543711 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebad767-412a-412d-b0dd-44c94c978fd0 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:52.544531 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebad767-412a-412d-b0dd-44c94c978fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:52.545274 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebad767-412a-412d-b0dd-44c94c978fd0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:52.547749 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebad767-412a-412d-b0dd-44c94c978fd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:52.550980 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebad767-412a-412d-b0dd-44c94c978fd0 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:52.554839 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 151/299] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:13:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:52.564694 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48425ab-9e8c-498f-9754-2ef04431b404 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:52.585609 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:52.674998 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebad767-412a-412d-b0dd-44c94c978fd0 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:52.696800 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48425ab-9e8c-498f-9754-2ef04431b404 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:52.700150 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:52.747380 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7e9ce-0f8f-45ac-ae18-24853b0d024f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:52.748096 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7e9ce-0f8f-45ac-ae18-24853b0d024f None admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:52.748380 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7e9ce-0f8f-45ac-ae18-24853b0d024f None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:52.748714 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7e9ce-0f8f-45ac-ae18-24853b0d024f None admin] PATH_INFO: `/v3/groups` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:52.749625 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf7e9ce-0f8f-45ac-ae18-24853b0d024f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:52.752172 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf7e9ce-0f8f-45ac-ae18-24853b0d024f None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:52.784019 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 149/300] 10.222.0.91 () {60 vars in 1134 bytes} [Tue Aug 30 04:13:52 2022] POST /identity/v3/groups => generated 229 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:13:52.856785 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebad767-412a-412d-b0dd-44c94c978fd0 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:52.901395 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401667f4-f7e2-4909-a338-5048b8162cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:52.902112 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401667f4-f7e2-4909-a338-5048b8162cf7 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:52.902359 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401667f4-f7e2-4909-a338-5048b8162cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:52.902624 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401667f4-f7e2-4909-a338-5048b8162cf7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:52.916452 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401667f4-f7e2-4909-a338-5048b8162cf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:13:52.922233 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-401667f4-f7e2-4909-a338-5048b8162cf7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 04:13:52.922233 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:13:52.922233 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:13:52.922233 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:13:52.922233 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:13:52.922233 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:13:52.922233 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:13:52.922233 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:13:52.922233 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:13:52.922233 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:13:52.922233 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:13:52.922233 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:13:52.922233 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:13:52.922233 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:13:52.922233 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:13:52.922233 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:13:52.924009 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:13:52.924009 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:13:52.924009 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:13:52.924009 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:13:52.924009 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:13:52.924009 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:13:52.924009 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:13:52.924009 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:13:52.924009 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:13:52.924009 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:13:52.924009 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:13:52.924009 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:13:52.924009 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:13:52.924009 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:13:52.924009 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:13:52.924009 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:13:52.925579 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:13:52.925579 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:13:52.925579 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:13:52.925579 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:13:52.925579 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:13:52.925579 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:13:52.925579 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:13:52.925579 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:13:52.925579 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:13:52.925579 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:13:52.925579 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 04:13:52.925579 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:13:52.925579 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 152/301] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 30 04:13:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:13:52.937244 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7e9ce-0f8f-45ac-ae18-24853b0d024f None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:53.040606 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:53.078869 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7e9ce-0f8f-45ac-ae18-24853b0d024f None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:53.124301 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27175100-9fab-41a8-a8ef-98d3dbe0eb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:53.124952 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27175100-9fab-41a8-a8ef-98d3dbe0eb2c None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:53.125232 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27175100-9fab-41a8-a8ef-98d3dbe0eb2c None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:53.125516 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27175100-9fab-41a8-a8ef-98d3dbe0eb2c None admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:53.126219 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27175100-9fab-41a8-a8ef-98d3dbe0eb2c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:53.126522 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27175100-9fab-41a8-a8ef-98d3dbe0eb2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:53.128183 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27175100-9fab-41a8-a8ef-98d3dbe0eb2c None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:53.139181 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 150/302] 10.222.0.91 () {56 vars in 1101 bytes} [Tue Aug 30 04:13:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:13:53.145160 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401667f4-f7e2-4909-a338-5048b8162cf7 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:53.281170 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:53.283278 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b0d7f-046e-4c9f-947a-66201c8f5bf7 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:53.283748 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b0d7f-046e-4c9f-947a-66201c8f5bf7 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:53.284240 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b0d7f-046e-4c9f-947a-66201c8f5bf7 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:53.287498 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 151/303] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:13:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:13:53.294514 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d5188-cb43-4678-a4c7-56e20febd9da None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:53.295049 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d5188-cb43-4678-a4c7-56e20febd9da None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:53.295616 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d5188-cb43-4678-a4c7-56e20febd9da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:53.330516 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-6d2d5188-cb43-4678-a4c7-56e20febd9da None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:53.332746 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-6d2d5188-cb43-4678-a4c7-56e20febd9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:53.339696 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401667f4-f7e2-4909-a338-5048b8162cf7 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:53.402418 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ddff77-f876-411b-969d-b39c3258c4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:53.403580 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ddff77-f876-411b-969d-b39c3258c4c3 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:53.404198 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ddff77-f876-411b-969d-b39c3258c4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:53.405100 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ddff77-f876-411b-969d-b39c3258c4c3 None admin] PATH_INFO: `/v3/users/b03efae67e4545db80c6f88c70640c73` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:53.433714 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ddff77-f876-411b-969d-b39c3258c4c3 None admin] RBAC: Authorizing `identity:get_user(user_id=b03efae67e4545db80c6f88c70640c73)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:53.436650 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ddff77-f876-411b-969d-b39c3258c4c3 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:53.440313 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 153/304] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 30 04:13:53 2022] GET /identity/v3/users/b03efae67e4545db80c6f88c70640c73 => generated 293 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:13:53.453258 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ddff77-f876-411b-969d-b39c3258c4c3 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:53.499948 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 152/305] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:13:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:13:53.675159 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ddff77-f876-411b-969d-b39c3258c4c3 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:53.717683 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:53.721815 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50573c-86df-4ed8-a572-579a587c7d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:53.722841 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50573c-86df-4ed8-a572-579a587c7d87 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:53.723473 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50573c-86df-4ed8-a572-579a587c7d87 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:53.723957 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50573c-86df-4ed8-a572-579a587c7d87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:53.724938 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d50573c-86df-4ed8-a572-579a587c7d87 None admin] RBAC: Adding query filter params (role.id=643830a05faa4c2898407ace9a43df40, user.id=b03efae67e4545db80c6f88c70640c73, scope.system=all) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:53.725498 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d50573c-86df-4ed8-a572-579a587c7d87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:53.727495 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d50573c-86df-4ed8-a572-579a587c7d87 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:53.735075 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 154/306] 10.222.0.91 () {56 vars in 1308 bytes} [Tue Aug 30 04:13:53 2022] GET /identity/v3/role_assignments?user.id=b03efae67e4545db80c6f88c70640c73&scope.system=all&role.id=643830a05faa4c2898407ace9a43df40 => generated 226 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:53.941940 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d5188-cb43-4678-a4c7-56e20febd9da None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:54.023623 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:54.097039 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d5188-cb43-4678-a4c7-56e20febd9da None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:54.171952 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17d6391-9fe6-427a-b1e2-a774761fea27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:54.173133 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d6391-9fe6-427a-b1e2-a774761fea27 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:54.173595 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d6391-9fe6-427a-b1e2-a774761fea27 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:54.174041 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d6391-9fe6-427a-b1e2-a774761fea27 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:54.196498 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17d6391-9fe6-427a-b1e2-a774761fea27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:13:54.197227 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c7dde-4f35-41b7-9fbd-8940990238a5 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:54.197968 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c7dde-4f35-41b7-9fbd-8940990238a5 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:54.197968 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c7dde-4f35-41b7-9fbd-8940990238a5 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:54.204146 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 155/307] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:13:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:13:54.206028 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f08d3b9-eca5-4478-ad52-20d7b9ff71d8 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:54.206344 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f08d3b9-eca5-4478-ad52-20d7b9ff71d8 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:54.206560 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f08d3b9-eca5-4478-ad52-20d7b9ff71d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:54.206799 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-e17d6391-9fe6-427a-b1e2-a774761fea27 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:13:54.206799 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:13:54.206799 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:13:54.206799 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:13:54.206799 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:13:54.206799 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:13:54.206799 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:13:54.206799 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:13:54.206799 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:13:54.206799 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:13:54.206799 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:13:54.206799 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:13:54.206799 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:13:54.206799 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:13:54.206799 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:13:54.206799 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:13:54.209962 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:13:54.209962 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:13:54.209962 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:13:54.209962 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:13:54.209962 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:13:54.209962 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:13:54.209962 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:13:54.209962 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:13:54.209962 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:13:54.209962 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:13:54.209962 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:13:54.209962 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:13:54.209962 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:13:54.209962 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:13:54.209962 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:13:54.209962 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:13:54.213093 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:13:54.213093 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:13:54.213093 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:13:54.213093 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:13:54.213093 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:13:54.213093 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:13:54.213093 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:13:54.213093 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:13:54.213093 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:13:54.213093 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:13:54.213093 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:13:54.213093 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:13:54.213093 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 153/308] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 30 04:13:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:13:54.221213 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17d6391-9fe6-427a-b1e2-a774761fea27 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:54.242627 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-8f08d3b9-eca5-4478-ad52-20d7b9ff71d8 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:54.245584 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-8f08d3b9-eca5-4478-ad52-20d7b9ff71d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:54.402280 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 156/309] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:13:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 04:13:54.438184 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17d6391-9fe6-427a-b1e2-a774761fea27 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:54.488139 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:54.516043 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5929f705-eb4e-4ad7-ac5b-08f99165bb84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:54.517159 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929f705-eb4e-4ad7-ac5b-08f99165bb84 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:54.517909 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929f705-eb4e-4ad7-ac5b-08f99165bb84 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:54.518409 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929f705-eb4e-4ad7-ac5b-08f99165bb84 None admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:54.519700 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5929f705-eb4e-4ad7-ac5b-08f99165bb84 None admin] RBAC: Adding query filter params (name=member) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:54.520266 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5929f705-eb4e-4ad7-ac5b-08f99165bb84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:54.522930 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5929f705-eb4e-4ad7-ac5b-08f99165bb84 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:54.542278 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 154/310] 10.222.0.91 () {56 vars in 1101 bytes} [Tue Aug 30 04:13:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:13:54.552107 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f08d3b9-eca5-4478-ad52-20d7b9ff71d8 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:54.684552 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5929f705-eb4e-4ad7-ac5b-08f99165bb84 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:54.766634 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f08d3b9-eca5-4478-ad52-20d7b9ff71d8 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:54.819700 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:54.849467 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a991a-4bdd-489e-b7df-5b912d601d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:54.850324 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a991a-4bdd-489e-b7df-5b912d601d71 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:54.850723 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a991a-4bdd-489e-b7df-5b912d601d71 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:54.851119 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a991a-4bdd-489e-b7df-5b912d601d71 None admin] PATH_INFO: `/v3/users/92ec18c2add9425ca044194fb3616e7a` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:54.853671 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50a991a-4bdd-489e-b7df-5b912d601d71 None admin] RBAC: Authorizing `identity:get_user(user_id=92ec18c2add9425ca044194fb3616e7a)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:54.855787 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50a991a-4bdd-489e-b7df-5b912d601d71 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:54.858469 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 157/311] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 30 04:13:54 2022] GET /identity/v3/users/92ec18c2add9425ca044194fb3616e7a => generated 293 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:54.867831 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a991a-4bdd-489e-b7df-5b912d601d71 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:54.901965 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5929f705-eb4e-4ad7-ac5b-08f99165bb84 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:54.974842 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac1d7ff-2b2b-4d24-b187-1349735a8198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:54.977604 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1d7ff-2b2b-4d24-b187-1349735a8198 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:54.978267 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1d7ff-2b2b-4d24-b187-1349735a8198 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:54.978958 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1d7ff-2b2b-4d24-b187-1349735a8198 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:55.003680 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac1d7ff-2b2b-4d24-b187-1349735a8198 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:13:55.017218 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-dac1d7ff-2b2b-4d24-b187-1349735a8198 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 04:13:55.017218 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:13:55.017218 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:13:55.017218 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:13:55.017218 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:13:55.017218 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:13:55.017218 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:13:55.017218 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:13:55.017218 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:13:55.017218 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:13:55.017218 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:13:55.017218 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:13:55.017218 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:13:55.017218 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:13:55.017218 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:13:55.017218 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:13:55.019172 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:13:55.019172 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:13:55.019172 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:13:55.019172 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:13:55.019172 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:13:55.019172 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:13:55.019172 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:13:55.019172 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:13:55.019172 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:13:55.019172 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:13:55.019172 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:13:55.019172 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:13:55.019172 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:13:55.019172 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:13:55.019172 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:13:55.019172 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:13:55.021040 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:13:55.021040 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:13:55.021040 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:13:55.021040 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:13:55.021040 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:13:55.021040 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:13:55.021040 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:13:55.021040 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:13:55.021040 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:13:55.021040 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:13:55.021040 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 04:13:55.021040 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:13:55.023598 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 155/312] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 30 04:13:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:13:55.032881 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac1d7ff-2b2b-4d24-b187-1349735a8198 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:55.107639 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a991a-4bdd-489e-b7df-5b912d601d71 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:55.142589 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:55.182486 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0527f2-e6d0-45a4-965b-f49e1f0eb38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:55.183583 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0527f2-e6d0-45a4-965b-f49e1f0eb38b None admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:55.184210 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0527f2-e6d0-45a4-965b-f49e1f0eb38b None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:55.184731 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0527f2-e6d0-45a4-965b-f49e1f0eb38b None admin] PATH_INFO: `/v3/system/users/92ec18c2add9425ca044194fb3616e7a/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:55.187580 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0527f2-e6d0-45a4-965b-f49e1f0eb38b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=92ec18c2add9425ca044194fb3616e7a, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:55.190390 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0527f2-e6d0-45a4-965b-f49e1f0eb38b None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:55.215993 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 158/313] 10.222.0.91 () {58 vars in 1334 bytes} [Tue Aug 30 04:13:54 2022] PUT /identity/v3/system/users/92ec18c2add9425ca044194fb3616e7a/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:13:55.288407 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac1d7ff-2b2b-4d24-b187-1349735a8198 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:55.362479 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89caf22e-e5e2-4be1-be1a-0f1054a3d6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:55.363485 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89caf22e-e5e2-4be1-be1a-0f1054a3d6e0 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:55.363877 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89caf22e-e5e2-4be1-be1a-0f1054a3d6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:55.364434 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89caf22e-e5e2-4be1-be1a-0f1054a3d6e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:55.365785 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89caf22e-e5e2-4be1-be1a-0f1054a3d6e0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:55.366340 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89caf22e-e5e2-4be1-be1a-0f1054a3d6e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:55.368689 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89caf22e-e5e2-4be1-be1a-0f1054a3d6e0 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:55.392137 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 156/314] 10.222.0.91 () {56 vars in 1101 bytes} [Tue Aug 30 04:13:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:55.397827 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0527f2-e6d0-45a4-965b-f49e1f0eb38b None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:55.516267 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:55.610571 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0527f2-e6d0-45a4-965b-f49e1f0eb38b None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:55.701362 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3816da3f-4459-4a22-b692-66163567b2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:55.702897 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3816da3f-4459-4a22-b692-66163567b2d4 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:55.703710 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3816da3f-4459-4a22-b692-66163567b2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:55.704558 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3816da3f-4459-4a22-b692-66163567b2d4 None admin] PATH_INFO: `/v3/users/cff17f8b6629403ebecc39fd743b979f` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:55.707090 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3816da3f-4459-4a22-b692-66163567b2d4 None admin] RBAC: Authorizing `identity:get_user(user_id=cff17f8b6629403ebecc39fd743b979f)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:55.710347 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3816da3f-4459-4a22-b692-66163567b2d4 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:55.715607 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 159/315] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 30 04:13:55 2022] GET /identity/v3/users/cff17f8b6629403ebecc39fd743b979f => generated 297 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:55.726048 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89caf22e-e5e2-4be1-be1a-0f1054a3d6e0 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:55.927420 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89caf22e-e5e2-4be1-be1a-0f1054a3d6e0 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:55.938383 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:55.988660 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443d2c6a-1282-407d-8501-2c0432840478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:55.988660 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d2c6a-1282-407d-8501-2c0432840478 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:55.988660 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d2c6a-1282-407d-8501-2c0432840478 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:55.988660 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d2c6a-1282-407d-8501-2c0432840478 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:56.030386 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c5af7-1249-4d01-9beb-2ad246bc4f09 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:56.031404 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c5af7-1249-4d01-9beb-2ad246bc4f09 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:56.032152 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c5af7-1249-4d01-9beb-2ad246bc4f09 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:56.035285 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 160/316] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:13:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:13:56.045971 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9257e05-b4ac-422c-bfd2-79d85a6bd9db None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:56.047087 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9257e05-b4ac-422c-bfd2-79d85a6bd9db None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:56.048063 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9257e05-b4ac-422c-bfd2-79d85a6bd9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:56.082561 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-b9257e05-b4ac-422c-bfd2-79d85a6bd9db None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:56.085399 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-b9257e05-b4ac-422c-bfd2-79d85a6bd9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:56.128456 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443d2c6a-1282-407d-8501-2c0432840478 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:56.131057 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443d2c6a-1282-407d-8501-2c0432840478 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:56.232213 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 161/317] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:13:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 04:13:56.339213 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 157/318] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 30 04:13:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 615 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:56.348866 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9257e05-b4ac-422c-bfd2-79d85a6bd9db None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:56.412375 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9db9d2-45ce-4c09-9070-16b72a3a2bdf None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:56.412821 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9db9d2-45ce-4c09-9070-16b72a3a2bdf None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:56.413276 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9db9d2-45ce-4c09-9070-16b72a3a2bdf None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:56.415667 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 158/319] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:13:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:13:56.426170 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829fef55-011b-452b-88a2-d1e4299fdf28 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:56.426590 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829fef55-011b-452b-88a2-d1e4299fdf28 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:56.427050 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829fef55-011b-452b-88a2-d1e4299fdf28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:56.450175 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:56.459438 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-829fef55-011b-452b-88a2-d1e4299fdf28 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:56.461435 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-829fef55-011b-452b-88a2-d1e4299fdf28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:56.465524 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:56.563827 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9257e05-b4ac-422c-bfd2-79d85a6bd9db None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:56.593318 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 159/320] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:13:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 04:13:56.594767 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829fef55-011b-452b-88a2-d1e4299fdf28 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:56.633805 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8926f288-9162-42d0-a989-25cb936ded2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:56.635663 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926f288-9162-42d0-a989-25cb936ded2c None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:56.636596 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926f288-9162-42d0-a989-25cb936ded2c None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:56.637217 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926f288-9162-42d0-a989-25cb936ded2c None admin] PATH_INFO: `/v3/projects/2013198a52ce4d88a1546ba74e7ab400` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:56.639760 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8926f288-9162-42d0-a989-25cb936ded2c None admin] RBAC: Authorizing `identity:get_project(project_id=2013198a52ce4d88a1546ba74e7ab400)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:56.642992 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8926f288-9162-42d0-a989-25cb936ded2c None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:56.653226 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 162/321] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 30 04:13:56 2022] GET /identity/v3/projects/2013198a52ce4d88a1546ba74e7ab400 => generated 302 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:56.659598 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8926f288-9162-42d0-a989-25cb936ded2c None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:56.812408 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829fef55-011b-452b-88a2-d1e4299fdf28 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:56.871101 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8926f288-9162-42d0-a989-25cb936ded2c None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:56.880630 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4363d40-003a-4616-81ee-1dfcf6e868bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:56.881641 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4363d40-003a-4616-81ee-1dfcf6e868bc None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:56.882108 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4363d40-003a-4616-81ee-1dfcf6e868bc None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:56.882568 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4363d40-003a-4616-81ee-1dfcf6e868bc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:56.884765 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4363d40-003a-4616-81ee-1dfcf6e868bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:56.888430 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4363d40-003a-4616-81ee-1dfcf6e868bc None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:56.891317 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 160/322] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:13:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:56.892726 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4363d40-003a-4616-81ee-1dfcf6e868bc None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:56.902728 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:56.915138 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:56.943132 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a2faa-8dc3-4ac1-8dd2-5221950feb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:56.944216 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a2faa-8dc3-4ac1-8dd2-5221950feb38 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:56.945452 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a2faa-8dc3-4ac1-8dd2-5221950feb38 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:56.945452 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a2faa-8dc3-4ac1-8dd2-5221950feb38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:56.946565 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687a2faa-8dc3-4ac1-8dd2-5221950feb38 None admin] RBAC: Adding query filter params (role.id=643830a05faa4c2898407ace9a43df40, scope.project.id=2013198a52ce4d88a1546ba74e7ab400, user.id=cff17f8b6629403ebecc39fd743b979f) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:56.947114 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687a2faa-8dc3-4ac1-8dd2-5221950feb38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:56.950174 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687a2faa-8dc3-4ac1-8dd2-5221950feb38 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:56.967961 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 163/323] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 30 04:13:56 2022] GET /identity/v3/role_assignments?user.id=cff17f8b6629403ebecc39fd743b979f&scope.project.id=2013198a52ce4d88a1546ba74e7ab400&role.id=643830a05faa4c2898407ace9a43df40 => generated 608 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:56.967961 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a2faa-8dc3-4ac1-8dd2-5221950feb38 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:57.090298 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4363d40-003a-4616-81ee-1dfcf6e868bc None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:57.168745 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a2faa-8dc3-4ac1-8dd2-5221950feb38 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:57.169387 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad7f54e-bb6f-47c5-ad72-e0450cb612ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:57.170479 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7f54e-bb6f-47c5-ad72-e0450cb612ed None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:57.170997 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7f54e-bb6f-47c5-ad72-e0450cb612ed None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:57.171528 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7f54e-bb6f-47c5-ad72-e0450cb612ed None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:57.197922 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad7f54e-bb6f-47c5-ad72-e0450cb612ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:13:57.204890 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-9ad7f54e-bb6f-47c5-ad72-e0450cb612ed None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 04:13:57.204890 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:13:57.204890 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:13:57.204890 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:13:57.204890 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:13:57.204890 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:13:57.204890 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:13:57.204890 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:13:57.204890 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:13:57.204890 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:13:57.204890 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:13:57.204890 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:13:57.204890 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:13:57.204890 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:13:57.204890 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:13:57.204890 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:13:57.205889 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:13:57.205889 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:13:57.205889 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:13:57.205889 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:13:57.205889 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:13:57.205889 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:13:57.205889 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:13:57.205889 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:13:57.205889 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:13:57.205889 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:13:57.205889 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:13:57.205889 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:13:57.205889 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:13:57.205889 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:13:57.205889 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:13:57.205889 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:13:57.206839 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:13:57.206839 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:13:57.206839 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:13:57.206839 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:13:57.206839 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:13:57.206839 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:13:57.206839 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:13:57.206839 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:13:57.206839 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:13:57.206839 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:13:57.206839 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 04:13:57.206839 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:13:57.206839 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 161/324] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 30 04:13:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:13:57.221099 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad7f54e-bb6f-47c5-ad72-e0450cb612ed None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:57.232328 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87662b9a-aef8-4ef6-bf4f-d73f619cf12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:57.233433 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87662b9a-aef8-4ef6-bf4f-d73f619cf12b None admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:57.233861 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87662b9a-aef8-4ef6-bf4f-d73f619cf12b None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:57.234287 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87662b9a-aef8-4ef6-bf4f-d73f619cf12b None admin] PATH_INFO: `/v3/groups` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:57.235498 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87662b9a-aef8-4ef6-bf4f-d73f619cf12b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:57.238440 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87662b9a-aef8-4ef6-bf4f-d73f619cf12b None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:57.274328 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 164/325] 10.222.0.91 () {60 vars in 1134 bytes} [Tue Aug 30 04:13:56 2022] POST /identity/v3/groups => generated 226 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:13:57.337355 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:57.397591 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad7f54e-bb6f-47c5-ad72-e0450cb612ed None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:57.444154 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e0b8ed-0c86-4172-a1d4-d616a2e6c7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:57.444692 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0b8ed-0c86-4172-a1d4-d616a2e6c7c3 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:57.444968 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0b8ed-0c86-4172-a1d4-d616a2e6c7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:57.445240 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0b8ed-0c86-4172-a1d4-d616a2e6c7c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:57.445959 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e0b8ed-0c86-4172-a1d4-d616a2e6c7c3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:57.446256 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e0b8ed-0c86-4172-a1d4-d616a2e6c7c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:57.447907 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e0b8ed-0c86-4172-a1d4-d616a2e6c7c3 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:57.460006 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 162/326] 10.222.0.91 () {56 vars in 1101 bytes} [Tue Aug 30 04:13:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:13:57.466091 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87662b9a-aef8-4ef6-bf4f-d73f619cf12b None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:57.538397 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:57.653928 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87662b9a-aef8-4ef6-bf4f-d73f619cf12b None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:57.723091 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76410307-af28-4093-beec-903417e4ecb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:57.724135 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76410307-af28-4093-beec-903417e4ecb7 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:57.724685 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76410307-af28-4093-beec-903417e4ecb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:57.725083 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76410307-af28-4093-beec-903417e4ecb7 None admin] PATH_INFO: `/v3/users/b03efae67e4545db80c6f88c70640c73` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:57.727466 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76410307-af28-4093-beec-903417e4ecb7 None admin] RBAC: Authorizing `identity:get_user(user_id=b03efae67e4545db80c6f88c70640c73)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:57.730447 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76410307-af28-4093-beec-903417e4ecb7 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:57.733803 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 165/327] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 30 04:13:57 2022] GET /identity/v3/users/b03efae67e4545db80c6f88c70640c73 => generated 293 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:13:57.743844 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e0b8ed-0c86-4172-a1d4-d616a2e6c7c3 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:57.962241 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e0b8ed-0c86-4172-a1d4-d616a2e6c7c3 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:58.010747 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:58.023539 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddbaef0-5498-42ba-9306-ff4665e35884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:58.024284 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddbaef0-5498-42ba-9306-ff4665e35884 None admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:58.024558 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddbaef0-5498-42ba-9306-ff4665e35884 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:58.024833 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddbaef0-5498-42ba-9306-ff4665e35884 None admin] PATH_INFO: `/v3/system/users/b03efae67e4545db80c6f88c70640c73/roles/643830a05faa4c2898407ace9a43df40` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:58.026658 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddbaef0-5498-42ba-9306-ff4665e35884 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b03efae67e4545db80c6f88c70640c73, role_id=643830a05faa4c2898407ace9a43df40)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:58.028136 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddbaef0-5498-42ba-9306-ff4665e35884 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:58.044455 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 163/328] 10.222.0.91 () {58 vars in 1334 bytes} [Tue Aug 30 04:13:57 2022] PUT /identity/v3/system/users/b03efae67e4545db80c6f88c70640c73/roles/643830a05faa4c2898407ace9a43df40 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:13:58.427101 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0da5c0-2291-4a3b-ab97-9cbb3ec236a1 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:58.427881 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0da5c0-2291-4a3b-ab97-9cbb3ec236a1 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:58.427881 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0da5c0-2291-4a3b-ab97-9cbb3ec236a1 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:58.429412 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 166/329] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:13:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:13:58.437112 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4b86a-4d66-447b-abed-b4525d9a00ac None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:58.437903 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4b86a-4d66-447b-abed-b4525d9a00ac None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:58.437903 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4b86a-4d66-447b-abed-b4525d9a00ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:58.464196 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-6df4b86a-4d66-447b-abed-b4525d9a00ac None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:58.465522 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-6df4b86a-4d66-447b-abed-b4525d9a00ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:58.554661 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 164/330] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:13:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:13:58.997861 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0da5c0-2291-4a3b-ab97-9cbb3ec236a1 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:59.141839 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0da5c0-2291-4a3b-ab97-9cbb3ec236a1 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:59.163280 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:59.199085 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33676e8a-3b8f-4fe1-aa93-cd1c5ffff600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:59.199787 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33676e8a-3b8f-4fe1-aa93-cd1c5ffff600 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:59.200119 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33676e8a-3b8f-4fe1-aa93-cd1c5ffff600 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:59.200370 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33676e8a-3b8f-4fe1-aa93-cd1c5ffff600 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:59.222303 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33676e8a-3b8f-4fe1-aa93-cd1c5ffff600 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:13:59.227582 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-33676e8a-3b8f-4fe1-aa93-cd1c5ffff600 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:13:59.227582 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:13:59.227582 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:13:59.227582 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:13:59.227582 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:13:59.227582 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:13:59.227582 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:13:59.227582 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:13:59.227582 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:13:59.227582 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:13:59.227582 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:13:59.227582 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:13:59.227582 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:13:59.227582 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:13:59.227582 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:13:59.227582 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:13:59.229485 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:13:59.229485 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:13:59.229485 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:13:59.229485 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:13:59.229485 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:13:59.229485 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:13:59.229485 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:13:59.229485 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:13:59.229485 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:13:59.229485 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:13:59.229485 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:13:59.229485 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:13:59.229485 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:13:59.229485 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:13:59.229485 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:13:59.229485 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:13:59.231113 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:13:59.231113 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:13:59.231113 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:13:59.231113 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:13:59.231113 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:13:59.231113 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:13:59.231113 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:13:59.231113 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:13:59.231113 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:13:59.231113 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:13:59.231113 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:13:59.231113 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:13:59.231113 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 167/331] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 30 04:13:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:13:59.235151 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df4b86a-4d66-447b-abed-b4525d9a00ac None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:59.413367 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df4b86a-4d66-447b-abed-b4525d9a00ac None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:59.447848 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:59.468199 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d4ab8-7ec3-4a91-81cd-34c57d18f9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:59.468835 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d4ab8-7ec3-4a91-81cd-34c57d18f9d7 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:59.469095 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d4ab8-7ec3-4a91-81cd-34c57d18f9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:59.469363 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d4ab8-7ec3-4a91-81cd-34c57d18f9d7 None admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:59.470058 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44d4ab8-7ec3-4a91-81cd-34c57d18f9d7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:59.470355 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44d4ab8-7ec3-4a91-81cd-34c57d18f9d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:59.471787 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44d4ab8-7ec3-4a91-81cd-34c57d18f9d7 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:59.489332 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 165/332] 10.222.0.91 () {56 vars in 1101 bytes} [Tue Aug 30 04:13:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:59.497399 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33676e8a-3b8f-4fe1-aa93-cd1c5ffff600 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:59.699734 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33676e8a-3b8f-4fe1-aa93-cd1c5ffff600 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:59.749712 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778e25ae-d092-45c3-b401-258faa09cd5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:59.750388 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e25ae-d092-45c3-b401-258faa09cd5f None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:59.750663 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e25ae-d092-45c3-b401-258faa09cd5f None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:59.750932 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e25ae-d092-45c3-b401-258faa09cd5f None admin] PATH_INFO: `/v3/users/92ec18c2add9425ca044194fb3616e7a` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:59.752303 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778e25ae-d092-45c3-b401-258faa09cd5f None admin] RBAC: Authorizing `identity:get_user(user_id=92ec18c2add9425ca044194fb3616e7a)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:59.753873 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778e25ae-d092-45c3-b401-258faa09cd5f None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:59.755955 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 168/333] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 30 04:13:59 2022] GET /identity/v3/users/92ec18c2add9425ca044194fb3616e7a => generated 293 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:59.767669 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d4ab8-7ec3-4a91-81cd-34c57d18f9d7 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:00.012287 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d4ab8-7ec3-4a91-81cd-34c57d18f9d7 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:00.090395 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ff4507-d9da-40a1-8643-ea341049b0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:00.091498 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff4507-d9da-40a1-8643-ea341049b0b8 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:00.092025 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff4507-d9da-40a1-8643-ea341049b0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:00.092495 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff4507-d9da-40a1-8643-ea341049b0b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:00.093928 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ff4507-d9da-40a1-8643-ea341049b0b8 None admin] RBAC: Adding query filter params (role.id=1aaf128d062240b28b37771b36f6b38b, user.id=92ec18c2add9425ca044194fb3616e7a, scope.system=all) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:00.094480 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ff4507-d9da-40a1-8643-ea341049b0b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:00.097251 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ff4507-d9da-40a1-8643-ea341049b0b8 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:00.125175 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 166/334] 10.222.0.91 () {56 vars in 1308 bytes} [Tue Aug 30 04:13:59 2022] GET /identity/v3/role_assignments?user.id=92ec18c2add9425ca044194fb3616e7a&scope.system=all&role.id=1aaf128d062240b28b37771b36f6b38b => generated 510 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:00.743743 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf0934-fdb0-4af4-98d5-59429e85842b None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:00.744787 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf0934-fdb0-4af4-98d5-59429e85842b None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:00.744787 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf0934-fdb0-4af4-98d5-59429e85842b None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:00.748460 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 169/335] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:14:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:14:00.757926 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf2fb59-ba99-4c1d-8cd5-1df4fc9572aa None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:00.758722 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf2fb59-ba99-4c1d-8cd5-1df4fc9572aa None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:00.758875 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf2fb59-ba99-4c1d-8cd5-1df4fc9572aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:00.804723 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-ddf2fb59-ba99-4c1d-8cd5-1df4fc9572aa None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:00.806852 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-ddf2fb59-ba99-4c1d-8cd5-1df4fc9572aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:00.895306 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:00.979777 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 167/336] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:14:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 04:14:01.837126 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2a4e9-e40f-460c-9c8b-c8c93bad57fc None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:01.837948 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2a4e9-e40f-460c-9c8b-c8c93bad57fc None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:01.837948 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2a4e9-e40f-460c-9c8b-c8c93bad57fc None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:01.841043 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 170/337] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:14:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:14:01.850349 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e988e3-1129-4228-9de1-a168a5789e4f None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:01.851171 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e988e3-1129-4228-9de1-a168a5789e4f None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:01.851307 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e988e3-1129-4228-9de1-a168a5789e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:01.890493 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-18e988e3-1129-4228-9de1-a168a5789e4f None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:01.892632 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-18e988e3-1129-4228-9de1-a168a5789e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:01.951819 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c2a4e9-e40f-460c-9c8b-c8c93bad57fc None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:02.057128 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:02.113106 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 168/338] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:14:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:14:02.208430 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c2a4e9-e40f-460c-9c8b-c8c93bad57fc None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:02.259618 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab392842-91e9-4e36-bcb9-cde48ad628a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:02.260419 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab392842-91e9-4e36-bcb9-cde48ad628a2 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:02.260961 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab392842-91e9-4e36-bcb9-cde48ad628a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:02.261229 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab392842-91e9-4e36-bcb9-cde48ad628a2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:02.274034 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab392842-91e9-4e36-bcb9-cde48ad628a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:14:02.280641 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-ab392842-91e9-4e36-bcb9-cde48ad628a2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:14:02.280641 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:02.280641 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:02.280641 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:02.280641 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:02.280641 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:02.280641 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:02.280641 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:02.280641 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:02.280641 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:02.280641 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:02.280641 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:02.280641 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:14:02.280641 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:14:02.280641 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:14:02.280641 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:14:02.282829 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:14:02.282829 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:14:02.282829 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:14:02.282829 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:14:02.282829 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:02.282829 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:02.282829 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:02.282829 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:02.282829 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:02.282829 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:02.282829 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:02.282829 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:02.282829 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:02.282829 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:02.282829 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:02.282829 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:02.285011 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:02.285011 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:02.285011 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:02.285011 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:02.285011 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:14:02.285011 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:14:02.285011 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:14:02.285011 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:14:02.285011 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:14:02.285011 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:14:02.285011 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:14:02.285011 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:14:02.285011 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 171/339] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 30 04:14:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:02.292050 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e988e3-1129-4228-9de1-a168a5789e4f None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:02.304002 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c66fc-1efb-4c93-9631-3492420d5009 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:02.304002 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c66fc-1efb-4c93-9631-3492420d5009 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:02.304002 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c66fc-1efb-4c93-9631-3492420d5009 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:02.305108 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 172/340] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:14:02.324780 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03982d-8ec5-4ea6-9406-b41d4127581b None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:02.325224 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03982d-8ec5-4ea6-9406-b41d4127581b None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:02.325384 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03982d-8ec5-4ea6-9406-b41d4127581b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:02.363350 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-ce03982d-8ec5-4ea6-9406-b41d4127581b None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:02.364749 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-ce03982d-8ec5-4ea6-9406-b41d4127581b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:02.512384 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 173/341] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:14:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:14:02.658032 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:02.665242 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e988e3-1129-4228-9de1-a168a5789e4f None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:02.749928 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9f5dbb-32fa-4628-8683-cc3b46626bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:02.750968 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f5dbb-32fa-4628-8683-cc3b46626bb0 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:02.751433 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f5dbb-32fa-4628-8683-cc3b46626bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:02.751897 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f5dbb-32fa-4628-8683-cc3b46626bb0 None admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:02.753167 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9f5dbb-32fa-4628-8683-cc3b46626bb0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:02.753698 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9f5dbb-32fa-4628-8683-cc3b46626bb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:02.756401 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9f5dbb-32fa-4628-8683-cc3b46626bb0 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:02.770087 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce03982d-8ec5-4ea6-9406-b41d4127581b None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:02.778799 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 169/342] 10.222.0.91 () {56 vars in 1101 bytes} [Tue Aug 30 04:14:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 488 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:02.788362 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9f5dbb-32fa-4628-8683-cc3b46626bb0 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:02.840731 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:03.014585 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce03982d-8ec5-4ea6-9406-b41d4127581b None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:03.097967 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a52ec-cf76-406f-88a8-a8640e195a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:03.098917 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a52ec-cf76-406f-88a8-a8640e195a84 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:03.099389 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a52ec-cf76-406f-88a8-a8640e195a84 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:03.099868 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a52ec-cf76-406f-88a8-a8640e195a84 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:03.129192 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22a52ec-cf76-406f-88a8-a8640e195a84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:14:03.138961 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-d22a52ec-cf76-406f-88a8-a8640e195a84 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:14:03.138961 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:03.138961 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:03.138961 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:03.138961 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:03.138961 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:03.138961 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:03.138961 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:03.138961 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:03.138961 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:03.138961 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:03.138961 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:03.138961 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:14:03.138961 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:14:03.138961 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:14:03.138961 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:14:03.140774 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:14:03.140774 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:14:03.140774 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:14:03.140774 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:14:03.140774 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:03.140774 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:03.140774 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:03.140774 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:03.140774 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:03.140774 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:03.140774 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:03.140774 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:03.140774 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:03.140774 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:03.140774 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:03.140774 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:03.143257 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:03.143257 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:03.143257 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:03.143257 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:03.143257 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:14:03.143257 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:14:03.143257 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:14:03.143257 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:14:03.143257 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:14:03.143257 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:14:03.143257 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:14:03.143257 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:14:03.149579 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 174/343] 10.222.0.91 () {56 vars in 1114 bytes} [Tue Aug 30 04:14:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:03.162438 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a52ec-cf76-406f-88a8-a8640e195a84 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:03.271284 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9f5dbb-32fa-4628-8683-cc3b46626bb0 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:03.346851 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4437f1eb-93cf-4e51-a89a-a8534bfaa126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:03.348817 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437f1eb-93cf-4e51-a89a-a8534bfaa126 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:03.349749 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437f1eb-93cf-4e51-a89a-a8534bfaa126 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:03.350712 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437f1eb-93cf-4e51-a89a-a8534bfaa126 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:03.371781 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:03.386984 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a52ec-cf76-406f-88a8-a8640e195a84 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:03.429421 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c35e2-c8e0-4168-bd4d-cee64ec4a9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:03.430063 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c35e2-c8e0-4168-bd4d-cee64ec4a9c2 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:03.430344 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c35e2-c8e0-4168-bd4d-cee64ec4a9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:03.430604 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c35e2-c8e0-4168-bd4d-cee64ec4a9c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:03.431288 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105c35e2-c8e0-4168-bd4d-cee64ec4a9c2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:03.431590 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105c35e2-c8e0-4168-bd4d-cee64ec4a9c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:03.433145 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:03.434375 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105c35e2-c8e0-4168-bd4d-cee64ec4a9c2 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:03.444653 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 175/344] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 30 04:14:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:14:03.445912 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c35e2-c8e0-4168-bd4d-cee64ec4a9c2 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:03.515035 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4437f1eb-93cf-4e51-a89a-a8534bfaa126 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:03.518158 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4437f1eb-93cf-4e51-a89a-a8534bfaa126 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:03.685989 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c35e2-c8e0-4168-bd4d-cee64ec4a9c2 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:03.721194 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 170/345] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 30 04:14:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 934 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 04:14:03.723959 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ac01c-2ad5-46c4-9979-97f257f1d84a None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:03.724404 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ac01c-2ad5-46c4-9979-97f257f1d84a None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:03.724860 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ac01c-2ad5-46c4-9979-97f257f1d84a None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:03.727340 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 171/346] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:14:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:14:03.729371 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ac01c-2ad5-46c4-9979-97f257f1d84a None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:03.768963 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b4f85e-b8ef-4ba2-9054-7c93ec67641a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:03.770791 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b4f85e-b8ef-4ba2-9054-7c93ec67641a None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:03.772109 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b4f85e-b8ef-4ba2-9054-7c93ec67641a None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:03.772817 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b4f85e-b8ef-4ba2-9054-7c93ec67641a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:03.798837 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b4f85e-b8ef-4ba2-9054-7c93ec67641a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:14:03.805104 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-85b4f85e-b8ef-4ba2-9054-7c93ec67641a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:14:03.805104 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:03.805104 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:03.805104 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:03.805104 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:03.805104 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:03.805104 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:03.805104 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:03.805104 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:03.805104 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:03.805104 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:03.805104 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:03.805104 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:14:03.805104 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:14:03.805104 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:14:03.805104 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:14:03.806874 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:14:03.806874 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:14:03.806874 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:14:03.806874 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:14:03.806874 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:03.806874 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:03.806874 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:03.806874 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:03.806874 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:03.806874 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:03.806874 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:03.806874 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:03.806874 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:03.806874 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:03.806874 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:03.806874 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:03.809540 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:03.809540 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:03.809540 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:03.809540 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:03.809540 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:14:03.809540 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:14:03.809540 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:14:03.809540 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:14:03.809540 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:14:03.809540 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:14:03.809540 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:14:03.809540 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:14:03.809540 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 176/347] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 30 04:14:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:03.809540 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b4f85e-b8ef-4ba2-9054-7c93ec67641a None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:03.838816 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:03.880957 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:03.967008 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ac01c-2ad5-46c4-9979-97f257f1d84a None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:04.029582 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b4f85e-b8ef-4ba2-9054-7c93ec67641a None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:04.030325 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e752daf-031b-4c6c-bdaa-eb159018fbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:04.030863 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e752daf-031b-4c6c-bdaa-eb159018fbcd None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:04.031139 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e752daf-031b-4c6c-bdaa-eb159018fbcd None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:04.031409 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e752daf-031b-4c6c-bdaa-eb159018fbcd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:04.084738 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2162e96c-4699-4703-a546-730d7dfe62cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:04.085406 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2162e96c-4699-4703-a546-730d7dfe62cb None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:04.085685 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2162e96c-4699-4703-a546-730d7dfe62cb None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:04.085956 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2162e96c-4699-4703-a546-730d7dfe62cb None admin] PATH_INFO: `/v3/projects/dd52e349f605416891993a08a2251fcc` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:04.087218 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2162e96c-4699-4703-a546-730d7dfe62cb None admin] RBAC: Authorizing `identity:get_project(project_id=dd52e349f605416891993a08a2251fcc)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:04.089134 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2162e96c-4699-4703-a546-730d7dfe62cb None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:04.091381 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 177/348] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 30 04:14:03 2022] GET /identity/v3/projects/dd52e349f605416891993a08a2251fcc => generated 298 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:04.093906 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c4820-c0d2-4358-ba9c-603cb3517541 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:04.094276 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c4820-c0d2-4358-ba9c-603cb3517541 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:04.094450 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c4820-c0d2-4358-ba9c-603cb3517541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:04.122320 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-d57c4820-c0d2-4358-ba9c-603cb3517541 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:04.124471 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-d57c4820-c0d2-4358-ba9c-603cb3517541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:04.143588 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e752daf-031b-4c6c-bdaa-eb159018fbcd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:04.145272 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e752daf-031b-4c6c-bdaa-eb159018fbcd None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:04.237402 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 178/349] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:14:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:14:04.238879 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c4820-c0d2-4358-ba9c-603cb3517541 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:04.252736 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:04.266743 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:04.319606 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 172/350] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 30 04:14:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:04.322383 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b98b62-f992-4b1d-9560-a98d11586ce3 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:04.323543 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b98b62-f992-4b1d-9560-a98d11586ce3 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:04.324205 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b98b62-f992-4b1d-9560-a98d11586ce3 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:04.327104 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 173/351] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:14:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:14:04.329787 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a7f0b-f4c1-4e48-9dc0-3a2edbb3fa5e None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:04.330704 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a7f0b-f4c1-4e48-9dc0-3a2edbb3fa5e None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:04.331771 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a7f0b-f4c1-4e48-9dc0-3a2edbb3fa5e None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:04.334513 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 174/352] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:14:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:14:04.335943 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685a7f0b-f4c1-4e48-9dc0-3a2edbb3fa5e None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:04.438651 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c4820-c0d2-4358-ba9c-603cb3517541 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:04.521147 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245fa3ee-a121-49a7-ae6c-aa53ab36bbfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:04.522587 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245fa3ee-a121-49a7-ae6c-aa53ab36bbfb None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:04.523243 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245fa3ee-a121-49a7-ae6c-aa53ab36bbfb None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:04.523994 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245fa3ee-a121-49a7-ae6c-aa53ab36bbfb None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:04.525408 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245fa3ee-a121-49a7-ae6c-aa53ab36bbfb None admin] RBAC: Adding query filter params (name=member) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:04.526265 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245fa3ee-a121-49a7-ae6c-aa53ab36bbfb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:04.527290 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685a7f0b-f4c1-4e48-9dc0-3a2edbb3fa5e None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:04.529288 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245fa3ee-a121-49a7-ae6c-aa53ab36bbfb None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:04.546028 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 179/353] 10.222.0.91 () {56 vars in 1101 bytes} [Tue Aug 30 04:14:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:04.548152 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02943393-3694-450d-a7bc-399c87c0ec0a None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:04.548660 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02943393-3694-450d-a7bc-399c87c0ec0a None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:04.548940 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02943393-3694-450d-a7bc-399c87c0ec0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:04.570894 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-02943393-3694-450d-a7bc-399c87c0ec0a None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:04.572287 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-02943393-3694-450d-a7bc-399c87c0ec0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:04.595323 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae8372-5cde-4343-8708-f25473da066d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:04.596431 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae8372-5cde-4343-8708-f25473da066d None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:04.596708 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae8372-5cde-4343-8708-f25473da066d None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:04.596969 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae8372-5cde-4343-8708-f25473da066d None admin] PATH_INFO: `/v3/groups/155d7023022b4e438b16db3e17e0c6cc` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:04.608066 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ae8372-5cde-4343-8708-f25473da066d None admin] RBAC: Authorizing `identity:get_group(group_id=155d7023022b4e438b16db3e17e0c6cc)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:04.609760 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ae8372-5cde-4343-8708-f25473da066d None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:04.611648 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 175/354] 10.222.0.91 () {56 vars in 1180 bytes} [Tue Aug 30 04:14:04 2022] GET /identity/v3/groups/155d7023022b4e438b16db3e17e0c6cc => generated 226 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:04.614338 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae8372-5cde-4343-8708-f25473da066d None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:04.662867 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:04.684142 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 180/355] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:14:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:14:04.686379 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23595e-8025-495b-8606-6f9c60bdb869 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:04.686758 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23595e-8025-495b-8606-6f9c60bdb869 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:04.687274 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23595e-8025-495b-8606-6f9c60bdb869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:04.700593 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:04.718877 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-4c23595e-8025-495b-8606-6f9c60bdb869 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:04.719988 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-4c23595e-8025-495b-8606-6f9c60bdb869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:04.806668 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae8372-5cde-4343-8708-f25473da066d None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:04.844163 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 181/356] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:14:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:14:04.844575 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c23595e-8025-495b-8606-6f9c60bdb869 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:04.879248 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd6b8be-a933-4639-bcd6-f498d7cad2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:04.880158 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6b8be-a933-4639-bcd6-f498d7cad2f6 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:04.880477 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6b8be-a933-4639-bcd6-f498d7cad2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:04.880787 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6b8be-a933-4639-bcd6-f498d7cad2f6 None admin] PATH_INFO: `/v3/projects/dd52e349f605416891993a08a2251fcc` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:04.882494 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd6b8be-a933-4639-bcd6-f498d7cad2f6 None admin] RBAC: Authorizing `identity:get_project(project_id=dd52e349f605416891993a08a2251fcc)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:04.884067 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd6b8be-a933-4639-bcd6-f498d7cad2f6 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:04.886511 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 176/357] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 30 04:14:04 2022] GET /identity/v3/projects/dd52e349f605416891993a08a2251fcc => generated 298 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:04.887472 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd6b8be-a933-4639-bcd6-f498d7cad2f6 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:04.976928 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c23595e-8025-495b-8606-6f9c60bdb869 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:05.016461 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:05.017290 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:05.024881 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d080a2-6647-4cdd-80b3-56695ee82285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:05.025541 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d080a2-6647-4cdd-80b3-56695ee82285 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:05.025822 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd6b8be-a933-4639-bcd6-f498d7cad2f6 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:05.025973 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d080a2-6647-4cdd-80b3-56695ee82285 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:05.026106 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d080a2-6647-4cdd-80b3-56695ee82285 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:05.044873 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d080a2-6647-4cdd-80b3-56695ee82285 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:14:05.052588 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-e3d080a2-6647-4cdd-80b3-56695ee82285 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 04:14:05.052588 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:05.052588 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:05.052588 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:05.052588 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:05.052588 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:05.052588 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:05.052588 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:05.052588 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:05.052588 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:05.052588 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:05.052588 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:05.052588 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:14:05.052588 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:14:05.052588 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:14:05.052588 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:14:05.054094 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:14:05.054094 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:14:05.054094 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:14:05.054094 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:14:05.054094 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:05.054094 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:05.054094 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:05.054094 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:05.054094 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:05.054094 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:05.054094 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:05.054094 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:05.054094 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:05.054094 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:05.054094 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:05.054094 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:05.055478 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:05.055478 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:05.055478 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:05.055478 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:05.055478 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:14:05.055478 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:14:05.055478 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:14:05.055478 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:14:05.055478 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:14:05.055478 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:14:05.055478 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 04:14:05.055478 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:14:05.055478 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 182/358] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 30 04:14:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:05.060458 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d080a2-6647-4cdd-80b3-56695ee82285 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:05.082361 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc51dd-7601-4c05-878a-cb5c9378e6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:05.083024 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc51dd-7601-4c05-878a-cb5c9378e6a7 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:05.083610 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc51dd-7601-4c05-878a-cb5c9378e6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:05.083974 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc51dd-7601-4c05-878a-cb5c9378e6a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:05.227865 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebc51dd-7601-4c05-878a-cb5c9378e6a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:05.232149 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebc51dd-7601-4c05-878a-cb5c9378e6a7 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:05.277047 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d080a2-6647-4cdd-80b3-56695ee82285 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:05.339632 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7c2df-4b16-46b8-9637-7e5442b42b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:05.340755 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7c2df-4b16-46b8-9637-7e5442b42b23 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:05.341205 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7c2df-4b16-46b8-9637-7e5442b42b23 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:05.341652 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7c2df-4b16-46b8-9637-7e5442b42b23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:05.342912 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb7c2df-4b16-46b8-9637-7e5442b42b23 None admin] RBAC: Adding query filter params (group.id=155d7023022b4e438b16db3e17e0c6cc, role.id=1aaf128d062240b28b37771b36f6b38b, scope.project.id=dd52e349f605416891993a08a2251fcc) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:05.343450 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb7c2df-4b16-46b8-9637-7e5442b42b23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:05.345970 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb7c2df-4b16-46b8-9637-7e5442b42b23 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:05.360652 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 183/359] 10.222.0.91 () {56 vars in 1376 bytes} [Tue Aug 30 04:14:05 2022] GET /identity/v3/role_assignments?group.id=155d7023022b4e438b16db3e17e0c6cc&scope.project.id=dd52e349f605416891993a08a2251fcc&role.id=1aaf128d062240b28b37771b36f6b38b => generated 260 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:05.365499 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7c2df-4b16-46b8-9637-7e5442b42b23 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:05.398545 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:05.412133 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 177/360] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 30 04:14:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:05.413026 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc51dd-7601-4c05-878a-cb5c9378e6a7 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:05.477357 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:05.567657 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7c2df-4b16-46b8-9637-7e5442b42b23 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:05.571392 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc51dd-7601-4c05-878a-cb5c9378e6a7 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:05.623851 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da267b4-ac6c-4b2c-be26-a2ad893ce4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:05.626273 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291c69ca-8df3-453a-9230-549f56d9730b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:05.626273 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c69ca-8df3-453a-9230-549f56d9730b None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:05.626273 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c69ca-8df3-453a-9230-549f56d9730b None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:05.626676 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c69ca-8df3-453a-9230-549f56d9730b None admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:05.627006 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da267b4-ac6c-4b2c-be26-a2ad893ce4bd None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:05.627150 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291c69ca-8df3-453a-9230-549f56d9730b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:05.627274 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da267b4-ac6c-4b2c-be26-a2ad893ce4bd None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:05.627403 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291c69ca-8df3-453a-9230-549f56d9730b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:05.627536 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da267b4-ac6c-4b2c-be26-a2ad893ce4bd None admin] PATH_INFO: `/v3/groups/155d7023022b4e438b16db3e17e0c6cc` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:05.629678 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291c69ca-8df3-453a-9230-549f56d9730b None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:05.629875 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da267b4-ac6c-4b2c-be26-a2ad893ce4bd None admin] RBAC: Authorizing `identity:get_group(group_id=155d7023022b4e438b16db3e17e0c6cc)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:05.630541 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da267b4-ac6c-4b2c-be26-a2ad893ce4bd None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:05.632514 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 184/361] 10.222.0.91 () {56 vars in 1180 bytes} [Tue Aug 30 04:14:05 2022] GET /identity/v3/groups/155d7023022b4e438b16db3e17e0c6cc => generated 226 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:05.639383 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da267b4-ac6c-4b2c-be26-a2ad893ce4bd None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:05.654591 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 178/362] 10.222.0.91 () {56 vars in 1101 bytes} [Tue Aug 30 04:14:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:05.656195 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291c69ca-8df3-453a-9230-549f56d9730b None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:05.748736 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:05.792393 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da267b4-ac6c-4b2c-be26-a2ad893ce4bd None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:05.812808 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291c69ca-8df3-453a-9230-549f56d9730b None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:05.824060 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:05.844143 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c830d5c2-3d02-4803-9805-fe99f12f547e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:05.844984 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830d5c2-3d02-4803-9805-fe99f12f547e None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:05.845269 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830d5c2-3d02-4803-9805-fe99f12f547e None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:05.845537 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830d5c2-3d02-4803-9805-fe99f12f547e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:05.864238 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c830d5c2-3d02-4803-9805-fe99f12f547e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:14:05.871805 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-c830d5c2-3d02-4803-9805-fe99f12f547e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:14:05.871805 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:05.871805 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:05.871805 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:05.871805 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:05.871805 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:05.871805 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:05.871805 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:05.871805 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:05.871805 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:05.871805 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:05.871805 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:05.871805 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:14:05.871805 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:14:05.871805 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:14:05.871805 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:14:05.873837 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:14:05.873837 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:14:05.873837 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:14:05.873837 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:14:05.873837 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:05.873837 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:05.873837 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:05.873837 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:05.873837 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:05.873837 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:05.873837 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:05.873837 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:05.873837 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:05.873837 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:05.873837 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:05.873837 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:05.875479 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:05.875479 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:05.875479 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:05.875479 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:05.875479 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:14:05.875479 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:14:05.875479 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:14:05.875479 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:14:05.875479 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:14:05.875479 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:14:05.875479 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:14:05.875479 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:14:05.875479 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 185/363] 10.222.0.91 () {56 vars in 1096 bytes} [Tue Aug 30 04:14:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:05.878320 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c830d5c2-3d02-4803-9805-fe99f12f547e None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:05.885394 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec4917e-541d-4ff4-a61a-4df416da53ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:05.887049 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4917e-541d-4ff4-a61a-4df416da53ce None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:05.887330 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4917e-541d-4ff4-a61a-4df416da53ce None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:05.887612 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4917e-541d-4ff4-a61a-4df416da53ce None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:05.902430 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec4917e-541d-4ff4-a61a-4df416da53ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:14:05.910032 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-5ec4917e-541d-4ff4-a61a-4df416da53ce None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:14:05.910032 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:05.910032 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:05.910032 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:05.910032 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:05.910032 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:05.910032 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:05.910032 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:05.910032 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:05.910032 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:05.910032 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:05.910032 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:05.910032 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:14:05.910032 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:14:05.910032 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:14:05.910032 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:14:05.911112 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:14:05.911112 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:14:05.911112 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:14:05.911112 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:14:05.911112 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:05.911112 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:05.911112 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:05.911112 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:05.911112 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:05.911112 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:05.911112 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:05.911112 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:05.911112 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:05.911112 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:05.911112 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:05.911112 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:05.911944 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:05.911944 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:05.911944 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:05.911944 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:05.911944 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:14:05.911944 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:14:05.911944 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:14:05.911944 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:14:05.911944 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:14:05.911944 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:14:05.911944 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:14:05.911944 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:14:05.911944 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 179/364] 10.222.0.91 () {56 vars in 1114 bytes} [Tue Aug 30 04:14:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:05.913119 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec4917e-541d-4ff4-a61a-4df416da53ce None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:06.065673 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec4917e-541d-4ff4-a61a-4df416da53ce None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:06.071192 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c830d5c2-3d02-4803-9805-fe99f12f547e None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:06.092192 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:06.114795 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f39fa16-56ee-4581-a4c2-ca76922748ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:06.115497 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39fa16-56ee-4581-a4c2-ca76922748ea None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:06.115777 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39fa16-56ee-4581-a4c2-ca76922748ea None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:06.116132 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39fa16-56ee-4581-a4c2-ca76922748ea None admin] PATH_INFO: `/v3/projects/2013198a52ce4d88a1546ba74e7ab400` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:06.117387 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f39fa16-56ee-4581-a4c2-ca76922748ea None admin] RBAC: Authorizing `identity:get_project(project_id=2013198a52ce4d88a1546ba74e7ab400)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:06.119593 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f39fa16-56ee-4581-a4c2-ca76922748ea None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:06.129921 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51309049-0545-484b-bfdb-0be39b70e760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:06.130212 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 186/365] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 30 04:14:05 2022] GET /identity/v3/projects/2013198a52ce4d88a1546ba74e7ab400 => generated 302 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:06.130365 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51309049-0545-484b-bfdb-0be39b70e760 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:06.130365 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51309049-0545-484b-bfdb-0be39b70e760 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:06.130612 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f39fa16-56ee-4581-a4c2-ca76922748ea None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:06.130733 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51309049-0545-484b-bfdb-0be39b70e760 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:06.130733 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51309049-0545-484b-bfdb-0be39b70e760 None admin] RBAC: Adding query filter params (group.id=155d7023022b4e438b16db3e17e0c6cc, role.id=147a152caf8346259b191a633bb4aee0, scope.project.id=dd52e349f605416891993a08a2251fcc) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:06.130733 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51309049-0545-484b-bfdb-0be39b70e760 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:06.130733 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51309049-0545-484b-bfdb-0be39b70e760 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:06.137149 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 180/366] 10.222.0.91 () {56 vars in 1376 bytes} [Tue Aug 30 04:14:05 2022] GET /identity/v3/role_assignments?group.id=155d7023022b4e438b16db3e17e0c6cc&scope.project.id=dd52e349f605416891993a08a2251fcc&role.id=147a152caf8346259b191a633bb4aee0 => generated 260 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:06.138039 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51309049-0545-484b-bfdb-0be39b70e760 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:06.252320 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:06.360141 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f39fa16-56ee-4581-a4c2-ca76922748ea None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:06.367337 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51309049-0545-484b-bfdb-0be39b70e760 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:06.406637 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4a57be-845a-4045-9893-8aa194d7dff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:06.407198 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a57be-845a-4045-9893-8aa194d7dff0 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:06.407468 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a57be-845a-4045-9893-8aa194d7dff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:06.407738 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a57be-845a-4045-9893-8aa194d7dff0 None admin] PATH_INFO: `/v3/users/b03efae67e4545db80c6f88c70640c73` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:06.409087 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4a57be-845a-4045-9893-8aa194d7dff0 None admin] RBAC: Authorizing `identity:get_user(user_id=b03efae67e4545db80c6f88c70640c73)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:06.410595 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4a57be-845a-4045-9893-8aa194d7dff0 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:06.419964 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 187/367] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 30 04:14:06 2022] GET /identity/v3/users/b03efae67e4545db80c6f88c70640c73 => generated 293 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:06.419964 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4a57be-845a-4045-9893-8aa194d7dff0 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:06.452809 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575631b6-caed-4796-bfbc-b073cff51581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:06.455248 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575631b6-caed-4796-bfbc-b073cff51581 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:06.456081 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575631b6-caed-4796-bfbc-b073cff51581 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:06.456828 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575631b6-caed-4796-bfbc-b073cff51581 None admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:06.458340 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575631b6-caed-4796-bfbc-b073cff51581 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:06.459271 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575631b6-caed-4796-bfbc-b073cff51581 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:06.462339 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575631b6-caed-4796-bfbc-b073cff51581 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:06.484485 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 181/368] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 30 04:14:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:06.486812 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575631b6-caed-4796-bfbc-b073cff51581 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:06.543773 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4a57be-845a-4045-9893-8aa194d7dff0 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:06.571604 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:06.581820 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:06.592081 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5044ecb5-ee56-4fb2-8217-57fec35a6f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:06.592779 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044ecb5-ee56-4fb2-8217-57fec35a6f5d None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:06.593060 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044ecb5-ee56-4fb2-8217-57fec35a6f5d None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:06.593368 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044ecb5-ee56-4fb2-8217-57fec35a6f5d None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:06.594068 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5044ecb5-ee56-4fb2-8217-57fec35a6f5d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:06.594729 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5044ecb5-ee56-4fb2-8217-57fec35a6f5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:06.596221 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5044ecb5-ee56-4fb2-8217-57fec35a6f5d None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:06.608386 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 188/369] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 30 04:14:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:06.612191 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5044ecb5-ee56-4fb2-8217-57fec35a6f5d None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:06.682759 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575631b6-caed-4796-bfbc-b073cff51581 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:06.743108 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d3c56-814d-4aa2-aa9f-ba70df87a591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:06.745361 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d3c56-814d-4aa2-aa9f-ba70df87a591 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:06.746229 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d3c56-814d-4aa2-aa9f-ba70df87a591 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:06.747024 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d3c56-814d-4aa2-aa9f-ba70df87a591 None admin] PATH_INFO: `/v3/groups/155d7023022b4e438b16db3e17e0c6cc` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:06.749933 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84d3c56-814d-4aa2-aa9f-ba70df87a591 None admin] RBAC: Authorizing `identity:get_group(group_id=155d7023022b4e438b16db3e17e0c6cc)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:06.753312 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84d3c56-814d-4aa2-aa9f-ba70df87a591 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:06.757315 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 182/370] 10.222.0.91 () {56 vars in 1180 bytes} [Tue Aug 30 04:14:06 2022] GET /identity/v3/groups/155d7023022b4e438b16db3e17e0c6cc => generated 226 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:06.759401 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d3c56-814d-4aa2-aa9f-ba70df87a591 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:06.781540 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5044ecb5-ee56-4fb2-8217-57fec35a6f5d None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:06.828252 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb847f1-cd78-4e9a-8917-ef17c9a18f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:06.828887 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb847f1-cd78-4e9a-8917-ef17c9a18f8d None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:06.829182 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb847f1-cd78-4e9a-8917-ef17c9a18f8d None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:06.829436 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb847f1-cd78-4e9a-8917-ef17c9a18f8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:06.830177 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb847f1-cd78-4e9a-8917-ef17c9a18f8d None admin] RBAC: Adding query filter params (role.id=643830a05faa4c2898407ace9a43df40, user.id=b03efae67e4545db80c6f88c70640c73, scope.system=all) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:06.830481 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb847f1-cd78-4e9a-8917-ef17c9a18f8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:06.831984 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb847f1-cd78-4e9a-8917-ef17c9a18f8d None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:06.854993 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 189/371] 10.222.0.91 () {56 vars in 1308 bytes} [Tue Aug 30 04:14:06 2022] GET /identity/v3/role_assignments?user.id=b03efae67e4545db80c6f88c70640c73&scope.system=all&role.id=643830a05faa4c2898407ace9a43df40 => generated 510 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:06.854993 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb847f1-cd78-4e9a-8917-ef17c9a18f8d None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:06.912628 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:07.021633 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb847f1-cd78-4e9a-8917-ef17c9a18f8d None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:07.055756 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d3c56-814d-4aa2-aa9f-ba70df87a591 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:07.082072 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8144da-e8b9-44fb-aced-c5bcfa27cd5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:07.083210 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8144da-e8b9-44fb-aced-c5bcfa27cd5f None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:07.083455 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8144da-e8b9-44fb-aced-c5bcfa27cd5f None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:07.087988 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8144da-e8b9-44fb-aced-c5bcfa27cd5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:07.106830 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:07.198628 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5cf00b-9531-4edc-aae1-2ecc1e83571c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:07.199613 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5cf00b-9531-4edc-aae1-2ecc1e83571c None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:07.208231 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5cf00b-9531-4edc-aae1-2ecc1e83571c None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:07.208919 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5cf00b-9531-4edc-aae1-2ecc1e83571c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:07.271600 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8144da-e8b9-44fb-aced-c5bcfa27cd5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:07.274875 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8144da-e8b9-44fb-aced-c5bcfa27cd5f None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:07.362310 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:07.366426 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5cf00b-9531-4edc-aae1-2ecc1e83571c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:07.369142 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5cf00b-9531-4edc-aae1-2ecc1e83571c None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:07.490906 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 190/372] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 30 04:14:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 642 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:07.498256 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8144da-e8b9-44fb-aced-c5bcfa27cd5f None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:07.566463 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 183/373] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 30 04:14:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 808 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:07.567983 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5cf00b-9531-4edc-aae1-2ecc1e83571c None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:07.598892 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:07.739141 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8144da-e8b9-44fb-aced-c5bcfa27cd5f None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:07.809250 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e88719-9dc8-498a-9568-6c04dbd6ad7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:07.810259 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e88719-9dc8-498a-9568-6c04dbd6ad7a None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:07.810737 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e88719-9dc8-498a-9568-6c04dbd6ad7a None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:07.811102 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e88719-9dc8-498a-9568-6c04dbd6ad7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:07.812779 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e88719-9dc8-498a-9568-6c04dbd6ad7a None admin] RBAC: Adding query filter params (group.id=155d7023022b4e438b16db3e17e0c6cc, role.id=1aaf128d062240b28b37771b36f6b38b, scope.project.id=2013198a52ce4d88a1546ba74e7ab400) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:07.812779 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e88719-9dc8-498a-9568-6c04dbd6ad7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:07.818369 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5cf00b-9531-4edc-aae1-2ecc1e83571c None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:07.818619 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e88719-9dc8-498a-9568-6c04dbd6ad7a None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:07.827279 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 191/374] 10.222.0.91 () {56 vars in 1376 bytes} [Tue Aug 30 04:14:07 2022] GET /identity/v3/role_assignments?group.id=155d7023022b4e438b16db3e17e0c6cc&scope.project.id=2013198a52ce4d88a1546ba74e7ab400&role.id=1aaf128d062240b28b37771b36f6b38b => generated 260 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:07.830652 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e88719-9dc8-498a-9568-6c04dbd6ad7a None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:07.837623 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:07.893013 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5da2117-1529-4cac-bbda-c07fd8ade2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:07.894516 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da2117-1529-4cac-bbda-c07fd8ade2a3 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:07.895128 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da2117-1529-4cac-bbda-c07fd8ade2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:07.895704 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da2117-1529-4cac-bbda-c07fd8ade2a3 None admin] PATH_INFO: `/v3/projects/2013198a52ce4d88a1546ba74e7ab400` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:07.899140 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5da2117-1529-4cac-bbda-c07fd8ade2a3 None admin] RBAC: Authorizing `identity:get_project(project_id=2013198a52ce4d88a1546ba74e7ab400)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:07.902510 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5da2117-1529-4cac-bbda-c07fd8ade2a3 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:07.906176 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 184/375] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 30 04:14:07 2022] GET /identity/v3/projects/2013198a52ce4d88a1546ba74e7ab400 => generated 302 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:07.909492 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db5c56-1eec-4cfe-8a28-4ea67e3ca184 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:07.910258 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db5c56-1eec-4cfe-8a28-4ea67e3ca184 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:07.910833 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db5c56-1eec-4cfe-8a28-4ea67e3ca184 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:07.914123 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 185/376] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:14:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:14:07.917754 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db5c56-1eec-4cfe-8a28-4ea67e3ca184 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:08.108730 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e88719-9dc8-498a-9568-6c04dbd6ad7a None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:08.121236 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:08.179253 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db5c56-1eec-4cfe-8a28-4ea67e3ca184 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:08.182382 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a632fd-8762-4373-975f-92418022beec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:08.183628 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a632fd-8762-4373-975f-92418022beec None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:08.184220 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a632fd-8762-4373-975f-92418022beec None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:08.184990 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a632fd-8762-4373-975f-92418022beec None admin] PATH_INFO: `/v3/projects/d17736c99d5e4774b6a5a802cbcd44ca` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:08.187332 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a632fd-8762-4373-975f-92418022beec None admin] RBAC: Authorizing `identity:get_project(project_id=d17736c99d5e4774b6a5a802cbcd44ca)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:08.190565 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a632fd-8762-4373-975f-92418022beec None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:08.193933 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 192/377] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 30 04:14:07 2022] GET /identity/v3/projects/d17736c99d5e4774b6a5a802cbcd44ca => generated 344 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:08.198998 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722990c-937a-4013-950d-4412edb90e44 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:08.198998 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722990c-937a-4013-950d-4412edb90e44 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:08.199615 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722990c-937a-4013-950d-4412edb90e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:08.234414 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-4722990c-937a-4013-950d-4412edb90e44 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:08.236772 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-4722990c-937a-4013-950d-4412edb90e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:08.266238 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c314c-d2a2-4a2b-bd4e-2643751c5553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:08.268247 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c314c-d2a2-4a2b-bd4e-2643751c5553 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:08.270263 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c314c-d2a2-4a2b-bd4e-2643751c5553 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:08.271114 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c314c-d2a2-4a2b-bd4e-2643751c5553 None admin] PATH_INFO: `/v3/groups/155d7023022b4e438b16db3e17e0c6cc` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:08.274195 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483c314c-d2a2-4a2b-bd4e-2643751c5553 None admin] RBAC: Authorizing `identity:get_group(group_id=155d7023022b4e438b16db3e17e0c6cc)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:08.279234 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483c314c-d2a2-4a2b-bd4e-2643751c5553 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:08.283544 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 186/378] 10.222.0.91 () {56 vars in 1180 bytes} [Tue Aug 30 04:14:07 2022] GET /identity/v3/groups/155d7023022b4e438b16db3e17e0c6cc => generated 226 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:08.286535 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c314c-d2a2-4a2b-bd4e-2643751c5553 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:08.406794 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 193/379] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:14:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:14:08.409133 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4722990c-937a-4013-950d-4412edb90e44 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:08.417015 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:08.535730 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c314c-d2a2-4a2b-bd4e-2643751c5553 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:08.609540 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a450cd5-f5ac-4618-9649-deb298cef611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:08.612140 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a450cd5-f5ac-4618-9649-deb298cef611 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:08.612883 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a450cd5-f5ac-4618-9649-deb298cef611 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:08.613635 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a450cd5-f5ac-4618-9649-deb298cef611 None admin] PATH_INFO: `/v3/groups/4c0962fd56704c6eba4d0d040e4f4723` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:08.624443 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a450cd5-f5ac-4618-9649-deb298cef611 None admin] RBAC: Authorizing `identity:get_group(group_id=4c0962fd56704c6eba4d0d040e4f4723)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:08.627854 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a450cd5-f5ac-4618-9649-deb298cef611 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:08.631834 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 187/380] 10.222.0.91 () {56 vars in 1180 bytes} [Tue Aug 30 04:14:08 2022] GET /identity/v3/groups/4c0962fd56704c6eba4d0d040e4f4723 => generated 229 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:08.641157 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a450cd5-f5ac-4618-9649-deb298cef611 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:08.672283 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:08.792115 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4722990c-937a-4013-950d-4412edb90e44 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:08.858350 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4369a1b7-5daf-4b29-b815-754ff654f31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:08.860301 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369a1b7-5daf-4b29-b815-754ff654f31c None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:08.861106 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369a1b7-5daf-4b29-b815-754ff654f31c None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:08.861685 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369a1b7-5daf-4b29-b815-754ff654f31c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:08.863241 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4369a1b7-5daf-4b29-b815-754ff654f31c None admin] RBAC: Adding query filter params (group.id=155d7023022b4e438b16db3e17e0c6cc, role.id=147a152caf8346259b191a633bb4aee0, scope.project.id=2013198a52ce4d88a1546ba74e7ab400) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:08.864487 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4369a1b7-5daf-4b29-b815-754ff654f31c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:08.866528 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4369a1b7-5daf-4b29-b815-754ff654f31c None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:08.879945 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a450cd5-f5ac-4618-9649-deb298cef611 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:08.882833 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 194/381] 10.222.0.91 () {56 vars in 1376 bytes} [Tue Aug 30 04:14:08 2022] GET /identity/v3/role_assignments?group.id=155d7023022b4e438b16db3e17e0c6cc&scope.project.id=2013198a52ce4d88a1546ba74e7ab400&role.id=147a152caf8346259b191a633bb4aee0 => generated 260 bytes in 475 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:08.884424 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4369a1b7-5daf-4b29-b815-754ff654f31c None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:08.951615 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac29f88a-6780-490d-bf0f-549ad1adf602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:08.953018 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29f88a-6780-490d-bf0f-549ad1adf602 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:08.953309 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29f88a-6780-490d-bf0f-549ad1adf602 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:08.953725 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29f88a-6780-490d-bf0f-549ad1adf602 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:08.954969 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac29f88a-6780-490d-bf0f-549ad1adf602 None admin] RBAC: Adding query filter params (group.id=4c0962fd56704c6eba4d0d040e4f4723, role.id=d8f440a82947486ebb20a633ebee736b, scope.project.id=d17736c99d5e4774b6a5a802cbcd44ca) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:08.955559 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac29f88a-6780-490d-bf0f-549ad1adf602 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:08.958311 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac29f88a-6780-490d-bf0f-549ad1adf602 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:08.970914 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 188/382] 10.222.0.91 () {56 vars in 1376 bytes} [Tue Aug 30 04:14:08 2022] GET /identity/v3/role_assignments?group.id=4c0962fd56704c6eba4d0d040e4f4723&scope.project.id=d17736c99d5e4774b6a5a802cbcd44ca&role.id=d8f440a82947486ebb20a633ebee736b => generated 260 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:09.068991 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:09.159523 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4369a1b7-5daf-4b29-b815-754ff654f31c None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:09.243426 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3e030c-020a-4cba-bca7-4785ecbaf87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:09.244711 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e030c-020a-4cba-bca7-4785ecbaf87a None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:09.245209 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e030c-020a-4cba-bca7-4785ecbaf87a None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:09.245659 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e030c-020a-4cba-bca7-4785ecbaf87a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:09.268018 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3e030c-020a-4cba-bca7-4785ecbaf87a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:14:09.279809 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-8f3e030c-020a-4cba-bca7-4785ecbaf87a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:14:09.279809 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:09.279809 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:09.279809 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:09.279809 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:09.279809 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:09.279809 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:09.279809 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:09.279809 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:09.279809 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:09.279809 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:09.279809 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:09.279809 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:14:09.279809 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:14:09.279809 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:14:09.279809 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:14:09.281739 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:14:09.281739 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:14:09.281739 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:14:09.281739 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:14:09.281739 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:09.281739 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:09.281739 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:09.281739 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:09.281739 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:09.281739 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:09.281739 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:09.281739 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:09.281739 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:09.281739 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:09.281739 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:09.281739 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:09.283348 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:09.283348 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:09.283348 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:09.283348 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:09.283348 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:14:09.283348 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:14:09.283348 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:14:09.283348 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:14:09.283348 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:14:09.283348 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:14:09.283348 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:14:09.283348 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:14:09.283348 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 195/383] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 30 04:14:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 399 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:09.288397 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac29f88a-6780-490d-bf0f-549ad1adf602 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:09.462419 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:09.473642 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa5128e-0957-41a3-8932-7fd03ba923f0 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:09.474077 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa5128e-0957-41a3-8932-7fd03ba923f0 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:09.474551 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa5128e-0957-41a3-8932-7fd03ba923f0 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:09.477419 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 196/384] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:14:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:14:09.483495 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa6200-d954-496f-935d-f148aaef308f None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:09.484224 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa6200-d954-496f-935d-f148aaef308f None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:09.484224 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa6200-d954-496f-935d-f148aaef308f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:09.521341 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-6aaa6200-d954-496f-935d-f148aaef308f None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:09.522128 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac29f88a-6780-490d-bf0f-549ad1adf602 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:09.522453 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-6aaa6200-d954-496f-935d-f148aaef308f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:09.592240 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8abfb8-6817-4c0d-ac69-66bb9274f306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:09.593289 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8abfb8-6817-4c0d-ac69-66bb9274f306 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:09.593758 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8abfb8-6817-4c0d-ac69-66bb9274f306 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:09.594226 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8abfb8-6817-4c0d-ac69-66bb9274f306 None admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:09.595491 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8abfb8-6817-4c0d-ac69-66bb9274f306 None admin] RBAC: Adding query filter params (name=member) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:09.596041 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8abfb8-6817-4c0d-ac69-66bb9274f306 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:09.598734 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8abfb8-6817-4c0d-ac69-66bb9274f306 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:09.612006 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 197/385] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:14:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:14:09.618516 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 189/386] 10.222.0.91 () {56 vars in 1101 bytes} [Tue Aug 30 04:14:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:09.623597 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa6200-d954-496f-935d-f148aaef308f None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:09.694506 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:09.752730 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa6200-d954-496f-935d-f148aaef308f None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:09.799369 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9047170-5d9c-4ffc-b478-36c04bac9cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:09.799937 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9047170-5d9c-4ffc-b478-36c04bac9cb1 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:09.800221 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9047170-5d9c-4ffc-b478-36c04bac9cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:09.800496 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9047170-5d9c-4ffc-b478-36c04bac9cb1 None admin] PATH_INFO: `/v3/groups/155d7023022b4e438b16db3e17e0c6cc` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:09.801742 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9047170-5d9c-4ffc-b478-36c04bac9cb1 None admin] RBAC: Authorizing `identity:get_group(group_id=155d7023022b4e438b16db3e17e0c6cc)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:09.803233 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9047170-5d9c-4ffc-b478-36c04bac9cb1 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:09.805286 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 198/387] 10.222.0.91 () {56 vars in 1180 bytes} [Tue Aug 30 04:14:09 2022] GET /identity/v3/groups/155d7023022b4e438b16db3e17e0c6cc => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:09.811891 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8abfb8-6817-4c0d-ac69-66bb9274f306 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:09.945991 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8abfb8-6817-4c0d-ac69-66bb9274f306 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:09.992367 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152aaac3-81ff-4fff-9fb0-a35fcc244aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:09.993100 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152aaac3-81ff-4fff-9fb0-a35fcc244aac None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:09.993403 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152aaac3-81ff-4fff-9fb0-a35fcc244aac None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:09.993659 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152aaac3-81ff-4fff-9fb0-a35fcc244aac None admin] PATH_INFO: `/v3/projects/dd52e349f605416891993a08a2251fcc` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:09.995213 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152aaac3-81ff-4fff-9fb0-a35fcc244aac None admin] RBAC: Authorizing `identity:get_project(project_id=dd52e349f605416891993a08a2251fcc)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:09.997129 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152aaac3-81ff-4fff-9fb0-a35fcc244aac None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:09.999385 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 190/388] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 30 04:14:09 2022] GET /identity/v3/projects/dd52e349f605416891993a08a2251fcc => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:14:10.006626 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9047170-5d9c-4ffc-b478-36c04bac9cb1 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:10.298455 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9047170-5d9c-4ffc-b478-36c04bac9cb1 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:10.309447 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152aaac3-81ff-4fff-9fb0-a35fcc244aac None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:10.317995 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:10.353971 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:10.371663 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac896a0-41af-41e8-9ac3-2b3af6a22726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:10.372929 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac896a0-41af-41e8-9ac3-2b3af6a22726 None admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:10.373447 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac896a0-41af-41e8-9ac3-2b3af6a22726 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:10.373968 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac896a0-41af-41e8-9ac3-2b3af6a22726 None admin] PATH_INFO: `/v3/projects/dd52e349f605416891993a08a2251fcc/groups/155d7023022b4e438b16db3e17e0c6cc/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:10.377601 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac896a0-41af-41e8-9ac3-2b3af6a22726 None admin] RBAC: Authorizing `identity:create_grant(project_id=dd52e349f605416891993a08a2251fcc, group_id=155d7023022b4e438b16db3e17e0c6cc, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:10.380648 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac896a0-41af-41e8-9ac3-2b3af6a22726 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:10.407032 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 199/389] 10.222.0.91 () {58 vars in 1442 bytes} [Tue Aug 30 04:14:10 2022] PUT /identity/v3/projects/dd52e349f605416891993a08a2251fcc/groups/155d7023022b4e438b16db3e17e0c6cc/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:14:10.598145 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152aaac3-81ff-4fff-9fb0-a35fcc244aac None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:10.675205 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fbb1c1-0e5e-4dd1-8808-1b7c1c4492d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:10.676227 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fbb1c1-0e5e-4dd1-8808-1b7c1c4492d7 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:10.676698 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fbb1c1-0e5e-4dd1-8808-1b7c1c4492d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:10.677140 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fbb1c1-0e5e-4dd1-8808-1b7c1c4492d7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:10.704408 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fbb1c1-0e5e-4dd1-8808-1b7c1c4492d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:14:10.717834 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-86fbb1c1-0e5e-4dd1-8808-1b7c1c4492d7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:14:10.717834 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:10.717834 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:10.717834 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:10.717834 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:10.717834 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:10.717834 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:10.717834 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:10.717834 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:10.717834 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:10.717834 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:10.717834 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:10.717834 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:14:10.717834 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:14:10.717834 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:14:10.717834 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:14:10.718812 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:14:10.718812 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:14:10.718812 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:14:10.718812 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:14:10.718812 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:10.718812 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:10.718812 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:10.718812 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:10.718812 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:10.718812 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:10.718812 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:10.718812 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:10.718812 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:10.718812 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:10.718812 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:10.718812 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:10.720406 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:10.720406 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:10.720406 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:10.720406 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:10.720406 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:14:10.720406 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:14:10.720406 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:14:10.720406 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:14:10.720406 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:14:10.720406 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:14:10.720406 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:14:10.720406 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:14:10.720406 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 191/390] 10.222.0.91 () {56 vars in 1114 bytes} [Tue Aug 30 04:14:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 411 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:10.726750 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac896a0-41af-41e8-9ac3-2b3af6a22726 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:10.945264 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac896a0-41af-41e8-9ac3-2b3af6a22726 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:11.017456 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ca8cb-24d4-45b0-a46b-986f9ec4f3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:11.018472 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ca8cb-24d4-45b0-a46b-986f9ec4f3b9 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:11.018959 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ca8cb-24d4-45b0-a46b-986f9ec4f3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:11.019429 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ca8cb-24d4-45b0-a46b-986f9ec4f3b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:11.020220 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0ca8cb-24d4-45b0-a46b-986f9ec4f3b9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:11.020660 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0ca8cb-24d4-45b0-a46b-986f9ec4f3b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:11.023503 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0ca8cb-24d4-45b0-a46b-986f9ec4f3b9 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:11.045103 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 200/391] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 30 04:14:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:11.053543 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fbb1c1-0e5e-4dd1-8808-1b7c1c4492d7 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:11.089360 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bed4ba-1ccb-4753-a69f-52b0fa885bbd None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:11.089360 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bed4ba-1ccb-4753-a69f-52b0fa885bbd None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:11.089798 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bed4ba-1ccb-4753-a69f-52b0fa885bbd None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:11.091573 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 201/392] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:14:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:14:11.114704 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2793c-b398-484e-af3d-2b7d74d24973 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:11.115189 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2793c-b398-484e-af3d-2b7d74d24973 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:11.115673 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2793c-b398-484e-af3d-2b7d74d24973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:11.151747 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:11.185111 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-e8c2793c-b398-484e-af3d-2b7d74d24973 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:11.186339 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-e8c2793c-b398-484e-af3d-2b7d74d24973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:11.203677 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fbb1c1-0e5e-4dd1-8808-1b7c1c4492d7 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:11.263192 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf746cd9-2411-4798-a89a-7cade1238cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:11.264326 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf746cd9-2411-4798-a89a-7cade1238cea None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:11.264833 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf746cd9-2411-4798-a89a-7cade1238cea None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:11.265319 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf746cd9-2411-4798-a89a-7cade1238cea None admin] PATH_INFO: `/v3/groups/155d7023022b4e438b16db3e17e0c6cc` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:11.267535 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf746cd9-2411-4798-a89a-7cade1238cea None admin] RBAC: Authorizing `identity:get_group(group_id=155d7023022b4e438b16db3e17e0c6cc)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:11.270454 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf746cd9-2411-4798-a89a-7cade1238cea None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:11.274284 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 192/393] 10.222.0.91 () {56 vars in 1180 bytes} [Tue Aug 30 04:14:11 2022] GET /identity/v3/groups/155d7023022b4e438b16db3e17e0c6cc => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:11.280543 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf746cd9-2411-4798-a89a-7cade1238cea None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:11.302445 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:11.343141 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 202/394] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:14:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 04:14:11.423349 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf746cd9-2411-4798-a89a-7cade1238cea None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:11.458679 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:11.470221 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d136e2c-41cd-410c-8110-3fb7eb61d9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:11.471272 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d136e2c-41cd-410c-8110-3fb7eb61d9e4 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:11.471750 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d136e2c-41cd-410c-8110-3fb7eb61d9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:11.472249 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d136e2c-41cd-410c-8110-3fb7eb61d9e4 None admin] PATH_INFO: `/v3/projects/dd52e349f605416891993a08a2251fcc` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:11.476760 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d136e2c-41cd-410c-8110-3fb7eb61d9e4 None admin] RBAC: Authorizing `identity:get_project(project_id=dd52e349f605416891993a08a2251fcc)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:11.478670 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d136e2c-41cd-410c-8110-3fb7eb61d9e4 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:11.481526 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 193/395] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 30 04:14:11 2022] GET /identity/v3/projects/dd52e349f605416891993a08a2251fcc => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:11.487557 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c2793c-b398-484e-af3d-2b7d74d24973 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:11.683294 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c2793c-b398-484e-af3d-2b7d74d24973 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:11.693454 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d136e2c-41cd-410c-8110-3fb7eb61d9e4 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:11.734619 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9828cbfa-26cd-4f8d-9598-b868d76fb4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:11.735213 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828cbfa-26cd-4f8d-9598-b868d76fb4c6 None admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:11.735485 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828cbfa-26cd-4f8d-9598-b868d76fb4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:11.735757 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828cbfa-26cd-4f8d-9598-b868d76fb4c6 None admin] PATH_INFO: `/v3/projects/dd52e349f605416891993a08a2251fcc/groups/155d7023022b4e438b16db3e17e0c6cc/roles/147a152caf8346259b191a633bb4aee0` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:11.741905 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9828cbfa-26cd-4f8d-9598-b868d76fb4c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=dd52e349f605416891993a08a2251fcc, group_id=155d7023022b4e438b16db3e17e0c6cc, role_id=147a152caf8346259b191a633bb4aee0)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:11.743407 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9828cbfa-26cd-4f8d-9598-b868d76fb4c6 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:11.772981 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 203/396] 10.222.0.91 () {58 vars in 1442 bytes} [Tue Aug 30 04:14:11 2022] PUT /identity/v3/projects/dd52e349f605416891993a08a2251fcc/groups/155d7023022b4e438b16db3e17e0c6cc/roles/147a152caf8346259b191a633bb4aee0 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:11.856169 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d136e2c-41cd-410c-8110-3fb7eb61d9e4 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:11.902386 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc94e29-9edd-44ee-a7a4-bcada5f6c3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:11.903053 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc94e29-9edd-44ee-a7a4-bcada5f6c3a8 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:11.903328 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc94e29-9edd-44ee-a7a4-bcada5f6c3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:11.903598 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc94e29-9edd-44ee-a7a4-bcada5f6c3a8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:11.917288 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc94e29-9edd-44ee-a7a4-bcada5f6c3a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:14:11.926230 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-cdc94e29-9edd-44ee-a7a4-bcada5f6c3a8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:14:11.926230 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:11.926230 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:11.926230 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:11.926230 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:11.926230 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:11.926230 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:11.926230 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:11.926230 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:11.926230 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:11.926230 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:11.926230 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:11.926230 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:14:11.926230 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:14:11.926230 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:14:11.926230 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:14:11.927218 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:14:11.927218 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:14:11.927218 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:14:11.927218 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:14:11.927218 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:11.927218 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:11.927218 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:11.927218 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:11.927218 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:11.927218 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:11.927218 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:11.927218 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:11.927218 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:11.927218 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:11.927218 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:11.927218 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:11.928076 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:11.928076 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:11.928076 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:11.928076 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:11.928076 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:14:11.928076 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:14:11.928076 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:14:11.928076 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:14:11.928076 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:14:11.928076 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:14:11.928076 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:14:11.928076 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:14:11.928700 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 194/397] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 30 04:14:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:11.937801 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9828cbfa-26cd-4f8d-9598-b868d76fb4c6 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:12.000776 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:12.084659 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9828cbfa-26cd-4f8d-9598-b868d76fb4c6 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:12.112065 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31be20-fabe-48b4-bf24-7673ef3b969c None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:12.112684 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31be20-fabe-48b4-bf24-7673ef3b969c None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:12.113150 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31be20-fabe-48b4-bf24-7673ef3b969c None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:12.114827 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 195/398] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:14:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:14:12.121413 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e17313-6736-4de9-80da-00c21b64160c None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:12.121699 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e17313-6736-4de9-80da-00c21b64160c None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:12.121990 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e17313-6736-4de9-80da-00c21b64160c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:12.157720 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-53e17313-6736-4de9-80da-00c21b64160c None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:12.159853 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-53e17313-6736-4de9-80da-00c21b64160c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:12.162611 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f65bbb3-1e9f-4cb8-82de-271a127cb85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:12.164216 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65bbb3-1e9f-4cb8-82de-271a127cb85b None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:12.165069 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65bbb3-1e9f-4cb8-82de-271a127cb85b None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:12.165865 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65bbb3-1e9f-4cb8-82de-271a127cb85b None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:12.167838 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f65bbb3-1e9f-4cb8-82de-271a127cb85b None admin] RBAC: Adding query filter params (name=member) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:12.168849 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f65bbb3-1e9f-4cb8-82de-271a127cb85b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:12.171310 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f65bbb3-1e9f-4cb8-82de-271a127cb85b None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:12.190779 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 204/399] 10.222.0.91 () {56 vars in 1101 bytes} [Tue Aug 30 04:14:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:12.206190 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f65bbb3-1e9f-4cb8-82de-271a127cb85b None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:12.283801 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:12.308829 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 196/400] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:14:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 04:14:12.313896 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7194251-fdeb-495a-be7e-2cbbdacd8cfe None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:12.314748 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7194251-fdeb-495a-be7e-2cbbdacd8cfe None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:12.315567 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7194251-fdeb-495a-be7e-2cbbdacd8cfe None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:12.319930 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 197/401] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:14:12 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:14:12.329812 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c026a-3879-407c-b28a-2deb1e0ca2b2 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:12.330831 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c026a-3879-407c-b28a-2deb1e0ca2b2 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:12.331583 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c026a-3879-407c-b28a-2deb1e0ca2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:12.371554 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-5c6c026a-3879-407c-b28a-2deb1e0ca2b2 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:12.372802 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-5c6c026a-3879-407c-b28a-2deb1e0ca2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:12.448597 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:12.453027 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f65bbb3-1e9f-4cb8-82de-271a127cb85b None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:12.520760 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945fa33e-b4e7-4dc8-ad9e-828f4a8b362b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:12.522014 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945fa33e-b4e7-4dc8-ad9e-828f4a8b362b None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:12.522493 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945fa33e-b4e7-4dc8-ad9e-828f4a8b362b None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:12.522976 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945fa33e-b4e7-4dc8-ad9e-828f4a8b362b None admin] PATH_INFO: `/v3/groups/155d7023022b4e438b16db3e17e0c6cc` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:12.525053 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945fa33e-b4e7-4dc8-ad9e-828f4a8b362b None admin] RBAC: Authorizing `identity:get_group(group_id=155d7023022b4e438b16db3e17e0c6cc)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:12.528678 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945fa33e-b4e7-4dc8-ad9e-828f4a8b362b None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:12.532755 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 205/402] 10.222.0.91 () {56 vars in 1180 bytes} [Tue Aug 30 04:14:12 2022] GET /identity/v3/groups/155d7023022b4e438b16db3e17e0c6cc => generated 226 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:12.546450 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945fa33e-b4e7-4dc8-ad9e-828f4a8b362b None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:12.584078 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 198/403] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:14:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:14:12.762923 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945fa33e-b4e7-4dc8-ad9e-828f4a8b362b None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:12.812817 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94948af1-8602-493f-bb82-86db8c982f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:12.813387 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94948af1-8602-493f-bb82-86db8c982f0e None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:12.813661 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94948af1-8602-493f-bb82-86db8c982f0e None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:12.813933 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94948af1-8602-493f-bb82-86db8c982f0e None admin] PATH_INFO: `/v3/projects/2013198a52ce4d88a1546ba74e7ab400` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:12.815191 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94948af1-8602-493f-bb82-86db8c982f0e None admin] RBAC: Authorizing `identity:get_project(project_id=2013198a52ce4d88a1546ba74e7ab400)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:12.816667 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94948af1-8602-493f-bb82-86db8c982f0e None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:12.818351 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 206/404] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 30 04:14:12 2022] GET /identity/v3/projects/2013198a52ce4d88a1546ba74e7ab400 => generated 302 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:12.824814 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c026a-3879-407c-b28a-2deb1e0ca2b2 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:12.833846 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94948af1-8602-493f-bb82-86db8c982f0e None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:12.877988 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:13.005777 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94948af1-8602-493f-bb82-86db8c982f0e None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:13.055823 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ecf056-58ab-4a3a-8745-b9071dfa0b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:13.056533 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ecf056-58ab-4a3a-8745-b9071dfa0b8a None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:13.056810 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ecf056-58ab-4a3a-8745-b9071dfa0b8a None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:13.060228 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ecf056-58ab-4a3a-8745-b9071dfa0b8a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:13.068571 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c026a-3879-407c-b28a-2deb1e0ca2b2 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:13.076350 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ecf056-58ab-4a3a-8745-b9071dfa0b8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:14:13.084065 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-b2ecf056-58ab-4a3a-8745-b9071dfa0b8a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:14:13.084065 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:13.084065 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:13.084065 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:13.084065 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:13.084065 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:13.084065 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:13.084065 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:13.084065 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:13.084065 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:13.084065 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:13.084065 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:13.084065 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:14:13.084065 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:14:13.084065 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:14:13.084065 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:14:13.085797 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:14:13.085797 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:14:13.085797 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:14:13.085797 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:14:13.085797 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:13.085797 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:13.085797 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:13.085797 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:13.085797 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:13.085797 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:13.085797 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:13.085797 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:13.085797 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:13.085797 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:13.085797 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:13.085797 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:13.087303 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:13.087303 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:13.087303 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:13.087303 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:13.087303 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:14:13.087303 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:14:13.087303 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:14:13.087303 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:14:13.087303 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:14:13.087303 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:14:13.087303 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:14:13.087303 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:14:13.087303 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 207/405] 10.222.0.91 () {56 vars in 1096 bytes} [Tue Aug 30 04:14:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:14:13.087303 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ecf056-58ab-4a3a-8745-b9071dfa0b8a None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:13.097623 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:13.116340 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1909285-0abf-41bd-bc57-0b50ef211afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:13.117086 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1909285-0abf-41bd-bc57-0b50ef211afd None admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:13.117358 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1909285-0abf-41bd-bc57-0b50ef211afd None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:13.117679 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1909285-0abf-41bd-bc57-0b50ef211afd None admin] PATH_INFO: `/v3/projects/2013198a52ce4d88a1546ba74e7ab400/groups/155d7023022b4e438b16db3e17e0c6cc/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:13.119892 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1909285-0abf-41bd-bc57-0b50ef211afd None admin] RBAC: Authorizing `identity:create_grant(project_id=2013198a52ce4d88a1546ba74e7ab400, group_id=155d7023022b4e438b16db3e17e0c6cc, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:13.121626 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1909285-0abf-41bd-bc57-0b50ef211afd None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:13.142158 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 199/406] 10.222.0.91 () {58 vars in 1442 bytes} [Tue Aug 30 04:14:12 2022] PUT /identity/v3/projects/2013198a52ce4d88a1546ba74e7ab400/groups/155d7023022b4e438b16db3e17e0c6cc/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:13.144900 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1909285-0abf-41bd-bc57-0b50ef211afd None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:13.382421 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:13.393993 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ecf056-58ab-4a3a-8745-b9071dfa0b8a None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:13.436406 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1909285-0abf-41bd-bc57-0b50ef211afd None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:13.458611 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e71d1-a7c6-4966-b1bb-d361d8c4a469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:13.460033 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e71d1-a7c6-4966-b1bb-d361d8c4a469 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:13.460656 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e71d1-a7c6-4966-b1bb-d361d8c4a469 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:13.461263 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e71d1-a7c6-4966-b1bb-d361d8c4a469 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:13.482385 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6e71d1-a7c6-4966-b1bb-d361d8c4a469 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:14:13.491725 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8692eb99-321a-4967-9c29-555ff7242ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:13.492854 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692eb99-321a-4967-9c29-555ff7242ad6 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:13.493176 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-ca6e71d1-a7c6-4966-b1bb-d361d8c4a469 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:14:13.493176 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:13.493176 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:13.493176 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:13.493176 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:13.493176 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:13.493176 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:13.493176 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:13.493176 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:13.493176 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:13.493176 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:13.493176 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:13.493176 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:14:13.493176 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:14:13.493176 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:14:13.493176 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:14:13.494175 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:14:13.494175 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:14:13.494175 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:14:13.494175 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:14:13.494175 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:13.494175 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:13.494175 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:13.494175 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:13.494175 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:13.494175 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:13.494175 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:13.494175 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:13.494175 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:13.494175 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:13.494175 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:13.494175 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:13.496097 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:13.496097 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:13.496097 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:13.496097 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:13.496097 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:14:13.496097 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:14:13.496097 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:14:13.496097 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:14:13.496097 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:14:13.496097 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:14:13.496097 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:14:13.496097 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:14:13.496097 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 208/407] 10.222.0.91 () {56 vars in 1114 bytes} [Tue Aug 30 04:14:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 409 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:13.497538 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda6647-81be-4d45-85fb-faa572cf35fd None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:13.497737 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692eb99-321a-4967-9c29-555ff7242ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:13.498011 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda6647-81be-4d45-85fb-faa572cf35fd None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:13.498477 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692eb99-321a-4967-9c29-555ff7242ad6 None admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:13.498575 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda6647-81be-4d45-85fb-faa572cf35fd None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:13.499496 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8692eb99-321a-4967-9c29-555ff7242ad6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:13.500025 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8692eb99-321a-4967-9c29-555ff7242ad6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:13.501075 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 209/408] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:14:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:14:13.501914 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8692eb99-321a-4967-9c29-555ff7242ad6 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:13.509225 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dda6647-81be-4d45-85fb-faa572cf35fd None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:13.513605 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 200/409] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 30 04:14:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:13.516378 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc540d2b-cb45-4dde-884b-2915fdcfb46f None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:13.516652 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc540d2b-cb45-4dde-884b-2915fdcfb46f None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:13.517153 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc540d2b-cb45-4dde-884b-2915fdcfb46f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:13.549285 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-fc540d2b-cb45-4dde-884b-2915fdcfb46f None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:13.551474 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-fc540d2b-cb45-4dde-884b-2915fdcfb46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:13.664342 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:13.723193 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 201/410] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:14:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:14:13.729407 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc540d2b-cb45-4dde-884b-2915fdcfb46f None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:13.742354 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dda6647-81be-4d45-85fb-faa572cf35fd None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:13.872787 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9774915c-18c6-4732-a298-af127a4c0afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:13.873430 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774915c-18c6-4732-a298-af127a4c0afb None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:13.873707 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774915c-18c6-4732-a298-af127a4c0afb None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:13.873976 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774915c-18c6-4732-a298-af127a4c0afb None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:13.874671 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9774915c-18c6-4732-a298-af127a4c0afb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:13.874972 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9774915c-18c6-4732-a298-af127a4c0afb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:13.875273 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc540d2b-cb45-4dde-884b-2915fdcfb46f None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:13.876491 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9774915c-18c6-4732-a298-af127a4c0afb None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:13.894665 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 210/411] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 30 04:14:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:13.900456 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9774915c-18c6-4732-a298-af127a4c0afb None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:13.927264 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a3b065-6ed6-4e06-ae51-842ddffd68ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:13.927944 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3b065-6ed6-4e06-ae51-842ddffd68ee None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:13.928224 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3b065-6ed6-4e06-ae51-842ddffd68ee None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:13.928498 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3b065-6ed6-4e06-ae51-842ddffd68ee None admin] PATH_INFO: `/v3/groups/4c0962fd56704c6eba4d0d040e4f4723` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:13.929827 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a3b065-6ed6-4e06-ae51-842ddffd68ee None admin] RBAC: Authorizing `identity:get_group(group_id=4c0962fd56704c6eba4d0d040e4f4723)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:13.931328 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a3b065-6ed6-4e06-ae51-842ddffd68ee None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:13.933333 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 202/412] 10.222.0.91 () {56 vars in 1180 bytes} [Tue Aug 30 04:14:13 2022] GET /identity/v3/groups/4c0962fd56704c6eba4d0d040e4f4723 => generated 229 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:13.942042 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a3b065-6ed6-4e06-ae51-842ddffd68ee None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:13.950188 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:14.064414 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:14.098296 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9774915c-18c6-4732-a298-af127a4c0afb None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:14.165304 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2540487-43c2-4a21-81b6-9bbd4338c9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:14.166460 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2540487-43c2-4a21-81b6-9bbd4338c9db None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:14.166952 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2540487-43c2-4a21-81b6-9bbd4338c9db None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:14.167461 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2540487-43c2-4a21-81b6-9bbd4338c9db None admin] PATH_INFO: `/v3/groups/155d7023022b4e438b16db3e17e0c6cc` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:14.169647 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2540487-43c2-4a21-81b6-9bbd4338c9db None admin] RBAC: Authorizing `identity:get_group(group_id=155d7023022b4e438b16db3e17e0c6cc)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:14.172397 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2540487-43c2-4a21-81b6-9bbd4338c9db None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:14.180067 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 211/413] 10.222.0.91 () {56 vars in 1180 bytes} [Tue Aug 30 04:14:13 2022] GET /identity/v3/groups/155d7023022b4e438b16db3e17e0c6cc => generated 226 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:14:14.185609 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2540487-43c2-4a21-81b6-9bbd4338c9db None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:14.235637 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a3b065-6ed6-4e06-ae51-842ddffd68ee None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:14.329581 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be156917-33a8-4d14-8bdd-546fb3508382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:14.331226 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be156917-33a8-4d14-8bdd-546fb3508382 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:14.331994 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be156917-33a8-4d14-8bdd-546fb3508382 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:14.332514 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be156917-33a8-4d14-8bdd-546fb3508382 None admin] PATH_INFO: `/v3/projects/d17736c99d5e4774b6a5a802cbcd44ca` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:14.334069 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be156917-33a8-4d14-8bdd-546fb3508382 None admin] RBAC: Authorizing `identity:get_project(project_id=d17736c99d5e4774b6a5a802cbcd44ca)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:14.335784 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be156917-33a8-4d14-8bdd-546fb3508382 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:14.342923 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 203/414] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 30 04:14:13 2022] GET /identity/v3/projects/d17736c99d5e4774b6a5a802cbcd44ca => generated 344 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:14.342923 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be156917-33a8-4d14-8bdd-546fb3508382 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:14.359051 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:14.384361 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2540487-43c2-4a21-81b6-9bbd4338c9db None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:14.435309 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a3b77-6fb5-4067-b239-5fa61803b2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:14.437138 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a3b77-6fb5-4067-b239-5fa61803b2a0 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:14.437879 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a3b77-6fb5-4067-b239-5fa61803b2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:14.438529 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a3b77-6fb5-4067-b239-5fa61803b2a0 None admin] PATH_INFO: `/v3/projects/2013198a52ce4d88a1546ba74e7ab400` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:14.442541 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6a3b77-6fb5-4067-b239-5fa61803b2a0 None admin] RBAC: Authorizing `identity:get_project(project_id=2013198a52ce4d88a1546ba74e7ab400)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:14.446522 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6a3b77-6fb5-4067-b239-5fa61803b2a0 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:14.451650 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 212/415] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 30 04:14:14 2022] GET /identity/v3/projects/2013198a52ce4d88a1546ba74e7ab400 => generated 302 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:14:14.453509 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a3b77-6fb5-4067-b239-5fa61803b2a0 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:14.563563 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be156917-33a8-4d14-8bdd-546fb3508382 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:14.586267 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:14.653380 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e779e662-58b4-4291-a2da-e91376bfcdc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:14.655421 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779e662-58b4-4291-a2da-e91376bfcdc7 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:14.656139 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779e662-58b4-4291-a2da-e91376bfcdc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:14.656836 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779e662-58b4-4291-a2da-e91376bfcdc7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:14.682327 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e779e662-58b4-4291-a2da-e91376bfcdc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:14:14.688179 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a3b77-6fb5-4067-b239-5fa61803b2a0 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:14.695313 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-e779e662-58b4-4291-a2da-e91376bfcdc7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:14:14.695313 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:14.695313 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:14.695313 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:14.695313 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:14.695313 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:14.695313 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:14.695313 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:14.695313 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:14.695313 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:14.695313 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:14.695313 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:14.695313 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:14:14.695313 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:14:14.695313 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:14:14.695313 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:14:14.697361 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:14:14.697361 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:14:14.697361 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:14:14.697361 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:14:14.697361 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:14.697361 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:14.697361 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:14.697361 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:14.697361 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:14.697361 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:14.697361 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:14.697361 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:14.697361 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:14.697361 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:14.697361 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:14.697361 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:14.699333 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:14.699333 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:14.699333 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:14.699333 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:14.699333 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:14:14.699333 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:14:14.699333 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:14:14.699333 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:14:14.699333 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:14:14.699333 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:14:14.699333 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:14:14.699333 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:14:14.704228 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 204/416] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 30 04:14:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:14.706038 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e779e662-58b4-4291-a2da-e91376bfcdc7 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:14.745200 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a6139-f3f4-4eea-8f49-24191bbf425c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:14.745813 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a6139-f3f4-4eea-8f49-24191bbf425c None admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:14.746137 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a6139-f3f4-4eea-8f49-24191bbf425c None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:14.746421 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a6139-f3f4-4eea-8f49-24191bbf425c None admin] PATH_INFO: `/v3/projects/d17736c99d5e4774b6a5a802cbcd44ca/groups/4c0962fd56704c6eba4d0d040e4f4723/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:14.748804 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533a6139-f3f4-4eea-8f49-24191bbf425c None admin] RBAC: Authorizing `identity:create_grant(project_id=d17736c99d5e4774b6a5a802cbcd44ca, group_id=4c0962fd56704c6eba4d0d040e4f4723, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:14.750326 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533a6139-f3f4-4eea-8f49-24191bbf425c None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:14.766800 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 213/417] 10.222.0.91 () {58 vars in 1442 bytes} [Tue Aug 30 04:14:14 2022] PUT /identity/v3/projects/d17736c99d5e4774b6a5a802cbcd44ca/groups/4c0962fd56704c6eba4d0d040e4f4723/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:14.767806 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a6139-f3f4-4eea-8f49-24191bbf425c None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:14.794307 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:14.875543 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e779e662-58b4-4291-a2da-e91376bfcdc7 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:14.916769 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a6139-f3f4-4eea-8f49-24191bbf425c None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:14.919896 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fa1237-8e39-480f-bb89-83f3587a8732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:14.921003 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa1237-8e39-480f-bb89-83f3587a8732 None admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:14.921563 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa1237-8e39-480f-bb89-83f3587a8732 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:14.922041 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa1237-8e39-480f-bb89-83f3587a8732 None admin] PATH_INFO: `/v3/projects/2013198a52ce4d88a1546ba74e7ab400/groups/155d7023022b4e438b16db3e17e0c6cc/roles/147a152caf8346259b191a633bb4aee0` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:14.924700 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fa1237-8e39-480f-bb89-83f3587a8732 None admin] RBAC: Authorizing `identity:create_grant(project_id=2013198a52ce4d88a1546ba74e7ab400, group_id=155d7023022b4e438b16db3e17e0c6cc, role_id=147a152caf8346259b191a633bb4aee0)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:14.926831 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fa1237-8e39-480f-bb89-83f3587a8732 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:14.943217 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 205/418] 10.222.0.91 () {58 vars in 1442 bytes} [Tue Aug 30 04:14:14 2022] PUT /identity/v3/projects/2013198a52ce4d88a1546ba74e7ab400/groups/155d7023022b4e438b16db3e17e0c6cc/roles/147a152caf8346259b191a633bb4aee0 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:14.944919 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974078d-c5a9-4767-b851-998be4bdfaca None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:14.945461 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974078d-c5a9-4767-b851-998be4bdfaca None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:14.945935 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974078d-c5a9-4767-b851-998be4bdfaca None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:14.952355 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 206/419] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:14:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:14:14.955029 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049dbb0-87c1-4f82-9422-4464eb9904fc None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:14.955641 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049dbb0-87c1-4f82-9422-4464eb9904fc None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:14.956156 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049dbb0-87c1-4f82-9422-4464eb9904fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:14.969795 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3acf42-3752-4515-be23-922fe7ff4a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:14.970480 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3acf42-3752-4515-be23-922fe7ff4a73 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:14.970769 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3acf42-3752-4515-be23-922fe7ff4a73 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:14.971102 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3acf42-3752-4515-be23-922fe7ff4a73 None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:14.971831 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3acf42-3752-4515-be23-922fe7ff4a73 None admin] RBAC: Adding query filter params (name=member) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:14.972258 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3acf42-3752-4515-be23-922fe7ff4a73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:14.973744 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3acf42-3752-4515-be23-922fe7ff4a73 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:14.982678 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-3049dbb0-87c1-4f82-9422-4464eb9904fc None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:14.984416 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-3049dbb0-87c1-4f82-9422-4464eb9904fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:14.987705 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 214/420] 10.222.0.91 () {56 vars in 1101 bytes} [Tue Aug 30 04:14:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:14.997669 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3acf42-3752-4515-be23-922fe7ff4a73 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:15.021048 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:15.090383 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 207/421] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:14:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 04:14:15.144170 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:15.186699 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3acf42-3752-4515-be23-922fe7ff4a73 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:15.252989 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc842602-22c6-447c-9386-7f616ffeac45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:15.253533 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc842602-22c6-447c-9386-7f616ffeac45 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:15.253809 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc842602-22c6-447c-9386-7f616ffeac45 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:15.254081 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc842602-22c6-447c-9386-7f616ffeac45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:15.387942 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc842602-22c6-447c-9386-7f616ffeac45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:15.393507 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc842602-22c6-447c-9386-7f616ffeac45 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:15.472460 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3049dbb0-87c1-4f82-9422-4464eb9904fc None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:15.579857 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:15.659173 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 215/422] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 30 04:14:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 663 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:15.671898 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc842602-22c6-447c-9386-7f616ffeac45 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:15.715323 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3049dbb0-87c1-4f82-9422-4464eb9904fc None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:15.796357 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e5f8be-3a52-4e95-82be-ccdb6ca32486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:15.797470 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5f8be-3a52-4e95-82be-ccdb6ca32486 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:15.797935 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5f8be-3a52-4e95-82be-ccdb6ca32486 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:15.798481 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5f8be-3a52-4e95-82be-ccdb6ca32486 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:15.837568 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e5f8be-3a52-4e95-82be-ccdb6ca32486 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:14:15.847449 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-b6e5f8be-3a52-4e95-82be-ccdb6ca32486 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:14:15.847449 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:15.847449 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:15.847449 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:15.847449 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:15.847449 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:15.847449 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:15.847449 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:15.847449 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:15.847449 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:15.847449 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:15.847449 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:15.847449 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:14:15.847449 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:14:15.847449 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:14:15.847449 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:14:15.848501 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:14:15.848501 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:14:15.848501 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:14:15.848501 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:14:15.848501 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:15.848501 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:15.848501 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:15.848501 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:15.848501 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:15.848501 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:15.848501 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:15.848501 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:15.848501 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:15.848501 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:15.848501 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:15.848501 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:15.849312 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:15.849312 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:15.849312 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:15.849312 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:15.849312 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:14:15.849312 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:14:15.849312 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:14:15.849312 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:14:15.849312 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:14:15.849312 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:14:15.849312 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:14:15.849312 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:14:15.858162 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 208/423] 10.222.0.91 () {56 vars in 1114 bytes} [Tue Aug 30 04:14:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:15.869703 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e5f8be-3a52-4e95-82be-ccdb6ca32486 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:15.930661 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:15.955475 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc842602-22c6-447c-9386-7f616ffeac45 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:16.053488 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e5f8be-3a52-4e95-82be-ccdb6ca32486 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:16.059184 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e75b1fb-8e7f-442f-832a-76a1298d1a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:16.060314 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75b1fb-8e7f-442f-832a-76a1298d1a14 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:16.060795 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75b1fb-8e7f-442f-832a-76a1298d1a14 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:16.061264 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75b1fb-8e7f-442f-832a-76a1298d1a14 None admin] PATH_INFO: `/v3/projects/dd52e349f605416891993a08a2251fcc` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:16.063462 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e75b1fb-8e7f-442f-832a-76a1298d1a14 None admin] RBAC: Authorizing `identity:get_project(project_id=dd52e349f605416891993a08a2251fcc)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:16.066426 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e75b1fb-8e7f-442f-832a-76a1298d1a14 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:16.070294 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 216/424] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 30 04:14:15 2022] GET /identity/v3/projects/dd52e349f605416891993a08a2251fcc => generated 298 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:16.079364 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea5a51-e9cc-419d-9479-5429b478a961 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:16.079843 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea5a51-e9cc-419d-9479-5429b478a961 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:16.080497 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea5a51-e9cc-419d-9479-5429b478a961 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:16.083558 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 217/425] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:14:16 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:14:16.086039 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aea5a51-e9cc-419d-9479-5429b478a961 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:16.113620 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407dcc6-3757-4661-8669-cdca28318845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:16.114250 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407dcc6-3757-4661-8669-cdca28318845 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:16.114525 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407dcc6-3757-4661-8669-cdca28318845 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:16.114795 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407dcc6-3757-4661-8669-cdca28318845 None admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:16.115483 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0407dcc6-3757-4661-8669-cdca28318845 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:16.115779 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0407dcc6-3757-4661-8669-cdca28318845 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:16.117282 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0407dcc6-3757-4661-8669-cdca28318845 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:16.130892 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 209/426] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 30 04:14:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:14:16.137710 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9c177-dccc-4810-95c0-f70009a792a5 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:16.138032 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9c177-dccc-4810-95c0-f70009a792a5 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:16.138271 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9c177-dccc-4810-95c0-f70009a792a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:16.162418 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-6fd9c177-dccc-4810-95c0-f70009a792a5 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:16.164474 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-6fd9c177-dccc-4810-95c0-f70009a792a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:16.183813 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:16.284040 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 210/427] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:14:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:14:16.285560 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd9c177-dccc-4810-95c0-f70009a792a5 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:16.310375 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aea5a51-e9cc-419d-9479-5429b478a961 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:16.317561 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:16.456094 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db662997-00c7-4c73-bffe-64f8c790fd25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:16.457425 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db662997-00c7-4c73-bffe-64f8c790fd25 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:16.457938 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db662997-00c7-4c73-bffe-64f8c790fd25 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:16.458424 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db662997-00c7-4c73-bffe-64f8c790fd25 None admin] PATH_INFO: `/v3/groups/155d7023022b4e438b16db3e17e0c6cc` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:16.472869 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db662997-00c7-4c73-bffe-64f8c790fd25 None admin] RBAC: Authorizing `identity:get_group(group_id=155d7023022b4e438b16db3e17e0c6cc)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:16.474788 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db662997-00c7-4c73-bffe-64f8c790fd25 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:16.482640 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 218/428] 10.222.0.91 () {56 vars in 1180 bytes} [Tue Aug 30 04:14:16 2022] GET /identity/v3/groups/155d7023022b4e438b16db3e17e0c6cc => generated 226 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:16.487040 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd9c177-dccc-4810-95c0-f70009a792a5 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:16.488497 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db662997-00c7-4c73-bffe-64f8c790fd25 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:16.532383 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b5d310-7575-49a6-8bbd-69d1b9a59d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:16.533023 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5d310-7575-49a6-8bbd-69d1b9a59d2a None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:16.533308 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5d310-7575-49a6-8bbd-69d1b9a59d2a None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:16.533580 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5d310-7575-49a6-8bbd-69d1b9a59d2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:16.623327 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b5d310-7575-49a6-8bbd-69d1b9a59d2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:16.626028 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b5d310-7575-49a6-8bbd-69d1b9a59d2a None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:16.668941 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:16.761374 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 211/429] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 30 04:14:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:16.768841 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b5d310-7575-49a6-8bbd-69d1b9a59d2a None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:16.827587 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db662997-00c7-4c73-bffe-64f8c790fd25 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:16.841281 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:16.877330 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423f026-71ba-4088-ba96-03f18f6e9a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:16.878137 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423f026-71ba-4088-ba96-03f18f6e9a19 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:16.878774 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423f026-71ba-4088-ba96-03f18f6e9a19 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:16.879155 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423f026-71ba-4088-ba96-03f18f6e9a19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:16.880054 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4423f026-71ba-4088-ba96-03f18f6e9a19 None admin] RBAC: Adding query filter params (group.id=155d7023022b4e438b16db3e17e0c6cc, role.id=1aaf128d062240b28b37771b36f6b38b, scope.project.id=dd52e349f605416891993a08a2251fcc) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:16.880473 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4423f026-71ba-4088-ba96-03f18f6e9a19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:16.882885 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4423f026-71ba-4088-ba96-03f18f6e9a19 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:16.891803 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 219/430] 10.222.0.91 () {56 vars in 1376 bytes} [Tue Aug 30 04:14:16 2022] GET /identity/v3/role_assignments?group.id=155d7023022b4e438b16db3e17e0c6cc&scope.project.id=dd52e349f605416891993a08a2251fcc&role.id=1aaf128d062240b28b37771b36f6b38b => generated 611 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:16.892789 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423f026-71ba-4088-ba96-03f18f6e9a19 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:16.920904 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b5d310-7575-49a6-8bbd-69d1b9a59d2a None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:16.948494 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:16.969304 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c959208-ab3e-4dd3-b888-f8e95b993e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:16.970600 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c959208-ab3e-4dd3-b888-f8e95b993e19 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:16.970600 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c959208-ab3e-4dd3-b888-f8e95b993e19 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:16.970825 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c959208-ab3e-4dd3-b888-f8e95b993e19 None admin] PATH_INFO: `/v3/projects/dd52e349f605416891993a08a2251fcc` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:16.977299 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c959208-ab3e-4dd3-b888-f8e95b993e19 None admin] RBAC: Authorizing `identity:get_project(project_id=dd52e349f605416891993a08a2251fcc)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:16.979143 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c959208-ab3e-4dd3-b888-f8e95b993e19 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:16.982357 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 212/431] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 30 04:14:16 2022] GET /identity/v3/projects/dd52e349f605416891993a08a2251fcc => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:14:16.988537 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c959208-ab3e-4dd3-b888-f8e95b993e19 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:17.168781 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423f026-71ba-4088-ba96-03f18f6e9a19 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:17.195241 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c959208-ab3e-4dd3-b888-f8e95b993e19 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:17.234126 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c30ee5-ae5e-4164-86b0-e1fbd2167d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:17.235625 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c30ee5-ae5e-4164-86b0-e1fbd2167d77 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:17.236416 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c30ee5-ae5e-4164-86b0-e1fbd2167d77 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:17.237053 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c30ee5-ae5e-4164-86b0-e1fbd2167d77 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:17.240411 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c769c8-920b-4540-ba7d-abe78273b7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:17.241201 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c769c8-920b-4540-ba7d-abe78273b7d9 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:17.241487 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c769c8-920b-4540-ba7d-abe78273b7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:17.241758 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c769c8-920b-4540-ba7d-abe78273b7d9 None admin] PATH_INFO: `/v3/groups/155d7023022b4e438b16db3e17e0c6cc` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:17.243758 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c769c8-920b-4540-ba7d-abe78273b7d9 None admin] RBAC: Authorizing `identity:get_group(group_id=155d7023022b4e438b16db3e17e0c6cc)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:17.246191 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c769c8-920b-4540-ba7d-abe78273b7d9 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:17.248425 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 213/432] 10.222.0.91 () {56 vars in 1180 bytes} [Tue Aug 30 04:14:16 2022] GET /identity/v3/groups/155d7023022b4e438b16db3e17e0c6cc => generated 226 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:17.255322 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c769c8-920b-4540-ba7d-abe78273b7d9 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:17.259260 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c30ee5-ae5e-4164-86b0-e1fbd2167d77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:14:17.264884 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-f7c30ee5-ae5e-4164-86b0-e1fbd2167d77 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:14:17.264884 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:17.264884 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:17.264884 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:17.264884 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:17.264884 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:17.264884 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:17.264884 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:17.264884 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:17.264884 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:17.264884 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:17.264884 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:17.264884 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:14:17.264884 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:14:17.264884 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:14:17.264884 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:14:17.265894 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:14:17.265894 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:14:17.265894 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:14:17.265894 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:14:17.265894 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:17.265894 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:17.265894 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:17.265894 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:17.265894 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:17.265894 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:17.265894 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:17.265894 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:17.265894 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:17.265894 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:17.265894 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:17.265894 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:17.267194 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:17.267194 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:17.267194 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:17.267194 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:17.267194 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:14:17.267194 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:14:17.267194 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:14:17.267194 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:14:17.267194 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:14:17.267194 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:14:17.267194 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:14:17.267194 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:14:17.267194 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 220/433] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 30 04:14:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:17.273663 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c30ee5-ae5e-4164-86b0-e1fbd2167d77 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:17.325896 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:17.333563 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:17.417617 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c769c8-920b-4540-ba7d-abe78273b7d9 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:17.461675 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c30ee5-ae5e-4164-86b0-e1fbd2167d77 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:17.473884 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e89da3-ad62-4a5d-95c5-217883c24b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:17.474653 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e89da3-ad62-4a5d-95c5-217883c24b16 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:17.475000 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e89da3-ad62-4a5d-95c5-217883c24b16 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:17.475346 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e89da3-ad62-4a5d-95c5-217883c24b16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:17.476204 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e89da3-ad62-4a5d-95c5-217883c24b16 None admin] RBAC: Adding query filter params (group.id=155d7023022b4e438b16db3e17e0c6cc, role.id=147a152caf8346259b191a633bb4aee0, scope.project.id=dd52e349f605416891993a08a2251fcc) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:17.476615 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e89da3-ad62-4a5d-95c5-217883c24b16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:17.478643 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e89da3-ad62-4a5d-95c5-217883c24b16 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:17.491961 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 214/434] 10.222.0.91 () {56 vars in 1376 bytes} [Tue Aug 30 04:14:17 2022] GET /identity/v3/role_assignments?group.id=155d7023022b4e438b16db3e17e0c6cc&scope.project.id=dd52e349f605416891993a08a2251fcc&role.id=147a152caf8346259b191a633bb4aee0 => generated 611 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:17.521608 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0710f442-3523-427c-94ac-2bed1ac98b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:17.522317 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710f442-3523-427c-94ac-2bed1ac98b74 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:17.522606 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710f442-3523-427c-94ac-2bed1ac98b74 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:17.522887 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710f442-3523-427c-94ac-2bed1ac98b74 None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:17.523598 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0710f442-3523-427c-94ac-2bed1ac98b74 None admin] RBAC: Adding query filter params (name=member) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:17.523979 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0710f442-3523-427c-94ac-2bed1ac98b74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:17.525473 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0710f442-3523-427c-94ac-2bed1ac98b74 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:17.549639 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 221/435] 10.222.0.91 () {56 vars in 1101 bytes} [Tue Aug 30 04:14:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:17.559027 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e89da3-ad62-4a5d-95c5-217883c24b16 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:17.733029 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e89da3-ad62-4a5d-95c5-217883c24b16 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:17.747291 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:17.781500 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3855254b-ed62-483e-b58c-d5ca549cfa81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:17.782141 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855254b-ed62-483e-b58c-d5ca549cfa81 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:17.782417 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855254b-ed62-483e-b58c-d5ca549cfa81 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:17.782687 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855254b-ed62-483e-b58c-d5ca549cfa81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:17.893063 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3855254b-ed62-483e-b58c-d5ca549cfa81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:17.894599 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3855254b-ed62-483e-b58c-d5ca549cfa81 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:18.023805 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef45a42b-3357-48e3-af74-700b4128371a None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:18.024154 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef45a42b-3357-48e3-af74-700b4128371a None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:18.024406 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef45a42b-3357-48e3-af74-700b4128371a None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:18.026106 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 222/436] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:14:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:14:18.032823 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751b622-56e6-420e-bc7a-3725a9337b72 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:18.033108 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751b622-56e6-420e-bc7a-3725a9337b72 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:18.033387 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751b622-56e6-420e-bc7a-3725a9337b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:18.036153 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 215/437] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 30 04:14:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:18.043620 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3855254b-ed62-483e-b58c-d5ca549cfa81 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:18.055408 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-e751b622-56e6-420e-bc7a-3725a9337b72 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:18.056747 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-e751b622-56e6-420e-bc7a-3725a9337b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:18.059574 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:18.172079 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 223/438] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:14:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 04:14:18.174227 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e22c5-e011-4c41-973e-7365f03f87c9 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:18.174692 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e22c5-e011-4c41-973e-7365f03f87c9 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:18.175138 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e22c5-e011-4c41-973e-7365f03f87c9 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:18.177042 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 224/439] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:14:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:14:18.186219 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8463b8-277e-4cd6-8dcc-e84152666cb5 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:18.186693 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8463b8-277e-4cd6-8dcc-e84152666cb5 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:18.187172 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8463b8-277e-4cd6-8dcc-e84152666cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:18.190749 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3855254b-ed62-483e-b58c-d5ca549cfa81 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:18.217808 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-fd8463b8-277e-4cd6-8dcc-e84152666cb5 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:18.219882 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-fd8463b8-277e-4cd6-8dcc-e84152666cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:18.230382 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e54ae30-ff61-4867-bf25-4182912a70d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:18.231042 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e54ae30-ff61-4867-bf25-4182912a70d9 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:18.231324 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e54ae30-ff61-4867-bf25-4182912a70d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:18.231645 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e54ae30-ff61-4867-bf25-4182912a70d9 None admin] PATH_INFO: `/v3/projects/2013198a52ce4d88a1546ba74e7ab400` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:18.232918 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e54ae30-ff61-4867-bf25-4182912a70d9 None admin] RBAC: Authorizing `identity:get_project(project_id=2013198a52ce4d88a1546ba74e7ab400)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:18.234483 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e54ae30-ff61-4867-bf25-4182912a70d9 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:18.236414 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 216/440] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 30 04:14:18 2022] GET /identity/v3/projects/2013198a52ce4d88a1546ba74e7ab400 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:18.242739 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e54ae30-ff61-4867-bf25-4182912a70d9 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:18.255970 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:18.318771 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 225/441] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:14:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 04:14:18.400255 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:18.440132 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8463b8-277e-4cd6-8dcc-e84152666cb5 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:18.446052 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e54ae30-ff61-4867-bf25-4182912a70d9 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:18.502448 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64006245-fdd2-4441-a37e-2aebff966459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:18.503112 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64006245-fdd2-4441-a37e-2aebff966459 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:18.503385 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64006245-fdd2-4441-a37e-2aebff966459 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:18.503655 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64006245-fdd2-4441-a37e-2aebff966459 None admin] PATH_INFO: `/v3/groups/155d7023022b4e438b16db3e17e0c6cc` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:18.504976 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64006245-fdd2-4441-a37e-2aebff966459 None admin] RBAC: Authorizing `identity:get_group(group_id=155d7023022b4e438b16db3e17e0c6cc)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:18.506574 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64006245-fdd2-4441-a37e-2aebff966459 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:18.513850 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 217/442] 10.222.0.91 () {56 vars in 1180 bytes} [Tue Aug 30 04:14:18 2022] GET /identity/v3/groups/155d7023022b4e438b16db3e17e0c6cc => generated 226 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:18.516712 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64006245-fdd2-4441-a37e-2aebff966459 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:18.595881 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8463b8-277e-4cd6-8dcc-e84152666cb5 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:18.642045 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3b0f6-4468-4343-83ee-9aae220a99cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:18.642520 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3b0f6-4468-4343-83ee-9aae220a99cb None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:18.642795 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3b0f6-4468-4343-83ee-9aae220a99cb None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:18.643063 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3b0f6-4468-4343-83ee-9aae220a99cb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:18.653437 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64006245-fdd2-4441-a37e-2aebff966459 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:18.655384 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af3b0f6-4468-4343-83ee-9aae220a99cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:14:18.660482 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-5af3b0f6-4468-4343-83ee-9aae220a99cb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:14:18.660482 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:18.660482 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:18.660482 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:18.660482 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:18.660482 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:18.660482 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:18.660482 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:18.660482 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:18.660482 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:18.660482 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:18.660482 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:18.660482 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:14:18.660482 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:14:18.660482 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:14:18.660482 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:14:18.661528 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:14:18.661528 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:14:18.661528 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:14:18.661528 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:14:18.661528 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:18.661528 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:18.661528 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:18.661528 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:18.661528 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:18.661528 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:18.661528 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:18.661528 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:18.661528 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:18.661528 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:18.661528 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:18.661528 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:18.664023 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:18.664023 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:18.664023 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:18.664023 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:18.664023 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:14:18.664023 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:14:18.664023 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:14:18.664023 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:14:18.664023 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:14:18.664023 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:14:18.664023 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:14:18.664023 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:14:18.664023 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 226/443] 10.222.0.91 () {56 vars in 1114 bytes} [Tue Aug 30 04:14:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:14:18.664023 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3b0f6-4468-4343-83ee-9aae220a99cb None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:18.687192 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:18.697774 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef861e4c-214c-4d3a-8cbf-a05404ba9a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:18.698492 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef861e4c-214c-4d3a-8cbf-a05404ba9a6a None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:18.698764 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef861e4c-214c-4d3a-8cbf-a05404ba9a6a None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:18.699029 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef861e4c-214c-4d3a-8cbf-a05404ba9a6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:18.699759 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef861e4c-214c-4d3a-8cbf-a05404ba9a6a None admin] RBAC: Adding query filter params (group.id=155d7023022b4e438b16db3e17e0c6cc, role.id=1aaf128d062240b28b37771b36f6b38b, scope.project.id=2013198a52ce4d88a1546ba74e7ab400) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:18.700130 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef861e4c-214c-4d3a-8cbf-a05404ba9a6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:18.701686 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef861e4c-214c-4d3a-8cbf-a05404ba9a6a None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:18.708292 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 218/444] 10.222.0.91 () {56 vars in 1376 bytes} [Tue Aug 30 04:14:18 2022] GET /identity/v3/role_assignments?group.id=155d7023022b4e438b16db3e17e0c6cc&scope.project.id=2013198a52ce4d88a1546ba74e7ab400&role.id=1aaf128d062240b28b37771b36f6b38b => generated 611 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:14:18.709269 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef861e4c-214c-4d3a-8cbf-a05404ba9a6a None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:18.728333 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:18.806367 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3b0f6-4468-4343-83ee-9aae220a99cb None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:18.851594 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef861e4c-214c-4d3a-8cbf-a05404ba9a6a None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:18.852737 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14819615-9855-4469-a5a8-e6c4a6c260e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:18.853432 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14819615-9855-4469-a5a8-e6c4a6c260e2 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:18.853718 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14819615-9855-4469-a5a8-e6c4a6c260e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:18.854364 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14819615-9855-4469-a5a8-e6c4a6c260e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:18.867584 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14819615-9855-4469-a5a8-e6c4a6c260e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:14:18.873031 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-14819615-9855-4469-a5a8-e6c4a6c260e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:14:18.873031 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:18.873031 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:18.873031 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:18.873031 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:18.873031 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:18.873031 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:18.873031 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:18.873031 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:18.873031 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:18.873031 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:18.873031 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:18.873031 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:14:18.873031 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:14:18.873031 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:14:18.873031 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:14:18.874033 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:14:18.874033 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:14:18.874033 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:14:18.874033 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:14:18.874033 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:18.874033 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:18.874033 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:18.874033 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:18.874033 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:18.874033 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:18.874033 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:18.874033 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:18.874033 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:18.874033 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:18.874033 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:18.874033 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:18.874868 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:18.874868 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:18.874868 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:18.874868 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:18.874868 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:14:18.874868 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:14:18.874868 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:14:18.874868 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:14:18.874868 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:14:18.874868 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:14:18.874868 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:14:18.874868 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:14:18.879546 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 227/445] 10.222.0.91 () {56 vars in 1096 bytes} [Tue Aug 30 04:14:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:18.880586 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14819615-9855-4469-a5a8-e6c4a6c260e2 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:18.911112 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6cd8a-d2c4-48e2-a501-05f57f8c8a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:18.911751 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6cd8a-d2c4-48e2-a501-05f57f8c8a00 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:18.912099 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6cd8a-d2c4-48e2-a501-05f57f8c8a00 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:18.912381 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6cd8a-d2c4-48e2-a501-05f57f8c8a00 None admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:18.913069 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e6cd8a-d2c4-48e2-a501-05f57f8c8a00 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:18.913374 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e6cd8a-d2c4-48e2-a501-05f57f8c8a00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:18.914800 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e6cd8a-d2c4-48e2-a501-05f57f8c8a00 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:18.924829 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 219/446] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 30 04:14:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:18.930583 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6cd8a-d2c4-48e2-a501-05f57f8c8a00 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:19.013690 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:19.044566 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14819615-9855-4469-a5a8-e6c4a6c260e2 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:19.071119 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:19.105497 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4aee5-f80e-43e5-a7f3-54ad0706e103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:19.106503 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4aee5-f80e-43e5-a7f3-54ad0706e103 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:19.107020 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4aee5-f80e-43e5-a7f3-54ad0706e103 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:19.107355 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4aee5-f80e-43e5-a7f3-54ad0706e103 None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:19.108101 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d4aee5-f80e-43e5-a7f3-54ad0706e103 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:19.108409 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d4aee5-f80e-43e5-a7f3-54ad0706e103 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:19.109958 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d4aee5-f80e-43e5-a7f3-54ad0706e103 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:19.120218 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 228/447] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 30 04:14:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:19.121169 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6cd8a-d2c4-48e2-a501-05f57f8c8a00 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:19.125881 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4aee5-f80e-43e5-a7f3-54ad0706e103 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:19.168480 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ecb174-67d3-42d7-b58e-987f85ac5ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:19.169117 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ecb174-67d3-42d7-b58e-987f85ac5ffe None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:19.169398 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ecb174-67d3-42d7-b58e-987f85ac5ffe None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:19.169669 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ecb174-67d3-42d7-b58e-987f85ac5ffe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:19.247859 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ecb174-67d3-42d7-b58e-987f85ac5ffe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:19.249389 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ecb174-67d3-42d7-b58e-987f85ac5ffe None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:19.271717 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4aee5-f80e-43e5-a7f3-54ad0706e103 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:19.311010 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092e34fc-8c79-4821-9184-0d0caeb0ce48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:19.311643 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e34fc-8c79-4821-9184-0d0caeb0ce48 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:19.311954 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e34fc-8c79-4821-9184-0d0caeb0ce48 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:19.312222 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e34fc-8c79-4821-9184-0d0caeb0ce48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:19.322100 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:19.351983 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:19.391316 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092e34fc-8c79-4821-9184-0d0caeb0ce48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:19.392936 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092e34fc-8c79-4821-9184-0d0caeb0ce48 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:19.404275 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 220/448] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 30 04:14:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 04:14:19.410566 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ecb174-67d3-42d7-b58e-987f85ac5ffe None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:19.517815 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 229/449] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 30 04:14:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 04:14:19.524174 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092e34fc-8c79-4821-9184-0d0caeb0ce48 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:19.550165 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ecb174-67d3-42d7-b58e-987f85ac5ffe None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:19.592240 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0beadf5-b50a-460f-8fe8-fe4c522ec36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:19.592903 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0beadf5-b50a-460f-8fe8-fe4c522ec36e None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:19.593182 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0beadf5-b50a-460f-8fe8-fe4c522ec36e None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:19.593455 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0beadf5-b50a-460f-8fe8-fe4c522ec36e None admin] PATH_INFO: `/v3/projects/2013198a52ce4d88a1546ba74e7ab400` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:19.594873 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0beadf5-b50a-460f-8fe8-fe4c522ec36e None admin] RBAC: Authorizing `identity:get_project(project_id=2013198a52ce4d88a1546ba74e7ab400)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:19.595530 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:19.596490 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0beadf5-b50a-460f-8fe8-fe4c522ec36e None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:19.598376 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 221/450] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 30 04:14:19 2022] GET /identity/v3/projects/2013198a52ce4d88a1546ba74e7ab400 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:14:19.607427 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0beadf5-b50a-460f-8fe8-fe4c522ec36e None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:19.669036 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:19.676194 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092e34fc-8c79-4821-9184-0d0caeb0ce48 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:19.717379 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96ff42-f64d-4d79-863f-164176bf2e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:19.718241 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96ff42-f64d-4d79-863f-164176bf2e4e None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:19.718571 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96ff42-f64d-4d79-863f-164176bf2e4e None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:19.718885 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96ff42-f64d-4d79-863f-164176bf2e4e None admin] PATH_INFO: `/v3/projects/d17736c99d5e4774b6a5a802cbcd44ca` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:19.720265 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf96ff42-f64d-4d79-863f-164176bf2e4e None admin] RBAC: Authorizing `identity:get_project(project_id=d17736c99d5e4774b6a5a802cbcd44ca)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:19.722056 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf96ff42-f64d-4d79-863f-164176bf2e4e None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:19.724129 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 230/451] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 30 04:14:19 2022] GET /identity/v3/projects/d17736c99d5e4774b6a5a802cbcd44ca => generated 344 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:14:19.732628 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96ff42-f64d-4d79-863f-164176bf2e4e None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:19.743661 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0beadf5-b50a-460f-8fe8-fe4c522ec36e None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:19.804958 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34776bbf-29e4-43fa-bd7e-c573cb7944bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:19.805904 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34776bbf-29e4-43fa-bd7e-c573cb7944bd None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:19.806380 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34776bbf-29e4-43fa-bd7e-c573cb7944bd None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:19.806917 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34776bbf-29e4-43fa-bd7e-c573cb7944bd None admin] PATH_INFO: `/v3/groups/155d7023022b4e438b16db3e17e0c6cc` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:19.809028 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34776bbf-29e4-43fa-bd7e-c573cb7944bd None admin] RBAC: Authorizing `identity:get_group(group_id=155d7023022b4e438b16db3e17e0c6cc)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:19.811879 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34776bbf-29e4-43fa-bd7e-c573cb7944bd None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:19.814949 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 222/452] 10.222.0.91 () {56 vars in 1180 bytes} [Tue Aug 30 04:14:19 2022] GET /identity/v3/groups/155d7023022b4e438b16db3e17e0c6cc => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:14:19.821777 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34776bbf-29e4-43fa-bd7e-c573cb7944bd None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:19.851640 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96ff42-f64d-4d79-863f-164176bf2e4e None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:19.860823 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:19.893541 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de2763e-77d2-44b9-8feb-f89cc0088123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:19.894079 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2763e-77d2-44b9-8feb-f89cc0088123 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:19.894359 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2763e-77d2-44b9-8feb-f89cc0088123 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:19.894680 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2763e-77d2-44b9-8feb-f89cc0088123 None admin] PATH_INFO: `/v3/groups/4c0962fd56704c6eba4d0d040e4f4723` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:19.896051 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de2763e-77d2-44b9-8feb-f89cc0088123 None admin] RBAC: Authorizing `identity:get_group(group_id=4c0962fd56704c6eba4d0d040e4f4723)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:19.897548 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de2763e-77d2-44b9-8feb-f89cc0088123 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:19.899204 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 231/453] 10.222.0.91 () {56 vars in 1180 bytes} [Tue Aug 30 04:14:19 2022] GET /identity/v3/groups/4c0962fd56704c6eba4d0d040e4f4723 => generated 229 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:14:19.908219 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de2763e-77d2-44b9-8feb-f89cc0088123 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:19.974838 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34776bbf-29e4-43fa-bd7e-c573cb7944bd None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:19.988388 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:20.018182 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9656c465-a177-4eeb-bf3d-42e6be1471da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:20.018798 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9656c465-a177-4eeb-bf3d-42e6be1471da None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:20.019075 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9656c465-a177-4eeb-bf3d-42e6be1471da None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:20.019344 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9656c465-a177-4eeb-bf3d-42e6be1471da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:20.020119 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9656c465-a177-4eeb-bf3d-42e6be1471da None admin] RBAC: Adding query filter params (group.id=155d7023022b4e438b16db3e17e0c6cc, role.id=147a152caf8346259b191a633bb4aee0, scope.project.id=2013198a52ce4d88a1546ba74e7ab400) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:20.020427 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9656c465-a177-4eeb-bf3d-42e6be1471da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:20.021914 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9656c465-a177-4eeb-bf3d-42e6be1471da None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:20.029433 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 223/454] 10.222.0.91 () {56 vars in 1376 bytes} [Tue Aug 30 04:14:19 2022] GET /identity/v3/role_assignments?group.id=155d7023022b4e438b16db3e17e0c6cc&scope.project.id=2013198a52ce4d88a1546ba74e7ab400&role.id=147a152caf8346259b191a633bb4aee0 => generated 611 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:14:20.057820 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de2763e-77d2-44b9-8feb-f89cc0088123 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:20.128137 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc66bf-38df-4f22-82e5-ad4f26a7e5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:20.129222 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc66bf-38df-4f22-82e5-ad4f26a7e5cc None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:20.129707 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc66bf-38df-4f22-82e5-ad4f26a7e5cc None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:20.130178 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc66bf-38df-4f22-82e5-ad4f26a7e5cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:20.131559 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fc66bf-38df-4f22-82e5-ad4f26a7e5cc None admin] RBAC: Adding query filter params (group.id=4c0962fd56704c6eba4d0d040e4f4723, role.id=d8f440a82947486ebb20a633ebee736b, scope.project.id=d17736c99d5e4774b6a5a802cbcd44ca) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:20.132142 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fc66bf-38df-4f22-82e5-ad4f26a7e5cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:20.134943 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fc66bf-38df-4f22-82e5-ad4f26a7e5cc None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:20.156097 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 232/455] 10.222.0.91 () {56 vars in 1376 bytes} [Tue Aug 30 04:14:19 2022] GET /identity/v3/role_assignments?group.id=4c0962fd56704c6eba4d0d040e4f4723&scope.project.id=d17736c99d5e4774b6a5a802cbcd44ca&role.id=d8f440a82947486ebb20a633ebee736b => generated 611 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:14:23.357088 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a896e-e533-4a26-9219-faf6d9bdd6e8 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:23.357636 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a896e-e533-4a26-9219-faf6d9bdd6e8 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:23.357894 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a896e-e533-4a26-9219-faf6d9bdd6e8 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:23.359881 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 224/456] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:14:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:14:23.373560 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1fc36-bd4d-4be9-880b-b22349a26e17 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:23.374143 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1fc36-bd4d-4be9-880b-b22349a26e17 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:23.374512 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1fc36-bd4d-4be9-880b-b22349a26e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:23.403389 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-c4e1fc36-bd4d-4be9-880b-b22349a26e17 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:23.405085 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-c4e1fc36-bd4d-4be9-880b-b22349a26e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:23.472787 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:23.525629 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 233/457] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:14:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 30 04:14:23.678645 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a130fa-c08a-4df3-b9b4-f9dd265d31c3 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:23.680771 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a130fa-c08a-4df3-b9b4-f9dd265d31c3 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:23.680771 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a130fa-c08a-4df3-b9b4-f9dd265d31c3 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:23.681256 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 225/458] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:14:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:14:23.687602 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa77296e-3462-4ff2-89d5-84e0a1269755 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:23.688278 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa77296e-3462-4ff2-89d5-84e0a1269755 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:23.688754 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa77296e-3462-4ff2-89d5-84e0a1269755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:23.716662 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-fa77296e-3462-4ff2-89d5-84e0a1269755 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:23.718262 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-fa77296e-3462-4ff2-89d5-84e0a1269755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:23.822634 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 234/459] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:14:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:14:23.880646 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a130fa-c08a-4df3-b9b4-f9dd265d31c3 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:24.008122 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48d337-e1a3-40b6-a24f-b61cf6921968 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:24.008735 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48d337-e1a3-40b6-a24f-b61cf6921968 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:24.009199 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48d337-e1a3-40b6-a24f-b61cf6921968 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:24.011843 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 235/460] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:14:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:14:24.017994 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ae585-d2f8-439a-a75e-564f8656a573 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:24.018977 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ae585-d2f8-439a-a75e-564f8656a573 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:24.019452 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ae585-d2f8-439a-a75e-564f8656a573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:24.046662 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a130fa-c08a-4df3-b9b4-f9dd265d31c3 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:24.088595 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-a13ae585-d2f8-439a-a75e-564f8656a573 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:24.090645 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-a13ae585-d2f8-439a-a75e-564f8656a573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:24.146931 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4841891a-d0f3-4d17-b232-d2fc3c8a0156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:24.148415 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4841891a-d0f3-4d17-b232-d2fc3c8a0156 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:24.149106 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4841891a-d0f3-4d17-b232-d2fc3c8a0156 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:24.149813 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4841891a-d0f3-4d17-b232-d2fc3c8a0156 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:24.171377 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4841891a-d0f3-4d17-b232-d2fc3c8a0156 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:24.174549 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4841891a-d0f3-4d17-b232-d2fc3c8a0156 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:24.197745 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-4841891a-d0f3-4d17-b232-d2fc3c8a0156 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:24.197745 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:24.197745 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:24.197745 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:24.197745 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:24.197745 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:24.197745 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:24.197745 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:24.197745 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:24.197745 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:24.197745 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:24.197745 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:24.197745 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:14:24.197745 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:14:24.197745 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:14:24.197745 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:14:24.199442 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:24.199442 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:24.199442 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:24.199442 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:24.199442 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:24.199442 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:24.199442 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:24.199442 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:24.199442 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:24.199442 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:24.199442 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:24.199442 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:24.199442 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:24.199442 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:24.199442 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:24.199442 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:24.199442 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:14:24.200723 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:14:24.200723 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:24.200723 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:14:24.202374 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 236/461] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:14:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:14:24.203346 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13ae585-d2f8-439a-a75e-564f8656a573 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:24.203890 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 226/462] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:14:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:24.209860 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4841891a-d0f3-4d17-b232-d2fc3c8a0156 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:24.267764 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:24.273545 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:24.406345 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13ae585-d2f8-439a-a75e-564f8656a573 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:24.468614 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c797660-1c68-4251-aca7-429466e2aa8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:24.470222 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c797660-1c68-4251-aca7-429466e2aa8d None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:24.470977 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c797660-1c68-4251-aca7-429466e2aa8d None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:24.471712 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c797660-1c68-4251-aca7-429466e2aa8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:24.477101 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4841891a-d0f3-4d17-b232-d2fc3c8a0156 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:24.492148 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c797660-1c68-4251-aca7-429466e2aa8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:24.495806 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c797660-1c68-4251-aca7-429466e2aa8d None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:24.525622 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-1c797660-1c68-4251-aca7-429466e2aa8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:24.525622 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:24.525622 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:24.525622 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:24.525622 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:24.525622 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:24.525622 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:24.525622 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:24.525622 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:24.525622 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:24.525622 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:24.525622 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:24.525622 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:14:24.525622 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:14:24.525622 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:14:24.525622 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:14:24.527184 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:24.527184 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:24.527184 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:24.527184 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:24.527184 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:24.527184 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:24.527184 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:24.527184 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:24.527184 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:24.527184 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:24.527184 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:24.527184 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:24.527184 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:24.527184 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:24.527184 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:24.527184 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:24.527184 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:14:24.528762 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:14:24.528762 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:24.528762 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:14:24.532731 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 237/463] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:14:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:24.539017 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c797660-1c68-4251-aca7-429466e2aa8d None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:24.552394 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc23fad-bc1b-4529-9fba-3d908f67fb4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:24.554084 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc23fad-bc1b-4529-9fba-3d908f67fb4f None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:24.561256 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc23fad-bc1b-4529-9fba-3d908f67fb4f None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:24.561649 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc23fad-bc1b-4529-9fba-3d908f67fb4f None admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:24.562255 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc23fad-bc1b-4529-9fba-3d908f67fb4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:24.562565 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc23fad-bc1b-4529-9fba-3d908f67fb4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:24.564063 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc23fad-bc1b-4529-9fba-3d908f67fb4f None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:24.599750 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 227/464] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:14:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:14:24.600732 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc23fad-bc1b-4529-9fba-3d908f67fb4f None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:24.702943 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:24.733325 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c797660-1c68-4251-aca7-429466e2aa8d None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:24.746960 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:24.767432 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc23fad-bc1b-4529-9fba-3d908f67fb4f None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:24.792618 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c9cc23-6cec-489f-873d-7b30c377b3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:24.794337 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9cc23-6cec-489f-873d-7b30c377b3e9 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:24.794850 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9cc23-6cec-489f-873d-7b30c377b3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:24.795327 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9cc23-6cec-489f-873d-7b30c377b3e9 None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:24.797159 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c9cc23-6cec-489f-873d-7b30c377b3e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:24.797736 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c9cc23-6cec-489f-873d-7b30c377b3e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:24.799998 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c9cc23-6cec-489f-873d-7b30c377b3e9 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:24.810231 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb0945-48e7-4a2e-a7c2-7b7ee1842448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:24.810897 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb0945-48e7-4a2e-a7c2-7b7ee1842448 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:24.811174 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb0945-48e7-4a2e-a7c2-7b7ee1842448 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:24.811443 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb0945-48e7-4a2e-a7c2-7b7ee1842448 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:24.826906 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 238/465] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:14:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:24.826906 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c9cc23-6cec-489f-873d-7b30c377b3e9 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:24.828840 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb0945-48e7-4a2e-a7c2-7b7ee1842448 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:24.830373 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb0945-48e7-4a2e-a7c2-7b7ee1842448 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:24.848936 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-34cb0945-48e7-4a2e-a7c2-7b7ee1842448 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:24.848936 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:24.848936 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:24.848936 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:24.848936 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:24.848936 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:24.848936 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:24.848936 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:24.848936 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:24.848936 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:24.848936 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:24.848936 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:24.848936 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:14:24.848936 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:14:24.848936 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:14:24.848936 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:14:24.850830 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:24.850830 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:24.850830 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:24.850830 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:24.850830 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:24.850830 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:24.850830 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:24.850830 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:24.850830 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:24.850830 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:24.850830 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:24.850830 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:24.850830 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:24.850830 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:24.850830 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:24.850830 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:24.850830 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:14:24.852552 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:14:24.852552 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:24.852552 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:14:24.852552 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 228/466] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:14:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:24.852552 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb0945-48e7-4a2e-a7c2-7b7ee1842448 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:24.971038 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c9cc23-6cec-489f-873d-7b30c377b3e9 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:24.983806 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb0945-48e7-4a2e-a7c2-7b7ee1842448 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:25.020812 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce85d69c-33f5-4c1c-8754-f4729a9fcb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:25.021442 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce85d69c-33f5-4c1c-8754-f4729a9fcb27 None admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:25.021736 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce85d69c-33f5-4c1c-8754-f4729a9fcb27 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:25.021972 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce85d69c-33f5-4c1c-8754-f4729a9fcb27 None admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:25.022644 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce85d69c-33f5-4c1c-8754-f4729a9fcb27 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:25.024151 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce85d69c-33f5-4c1c-8754-f4729a9fcb27 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:25.031498 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8168a283-b28b-427d-bf87-7e22f4186bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:25.032161 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168a283-b28b-427d-bf87-7e22f4186bb8 None admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:25.032440 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168a283-b28b-427d-bf87-7e22f4186bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:25.032712 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168a283-b28b-427d-bf87-7e22f4186bb8 None admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:25.033499 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8168a283-b28b-427d-bf87-7e22f4186bb8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:25.035007 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8168a283-b28b-427d-bf87-7e22f4186bb8 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:25.036863 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:25.046753 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:25.052772 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 239/467] 10.222.0.91 () {60 vars in 1132 bytes} [Tue Aug 30 04:14:24 2022] POST /identity/v3/users => generated 246 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:14:25.054075 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152337e-5613-4f61-97e0-65cf6d4f9102 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:25.054408 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152337e-5613-4f61-97e0-65cf6d4f9102 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:25.054631 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152337e-5613-4f61-97e0-65cf6d4f9102 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:25.061092 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 240/468] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:14:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:14:25.061092 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f152337e-5613-4f61-97e0-65cf6d4f9102 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:25.076219 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 229/469] 10.222.0.91 () {60 vars in 1132 bytes} [Tue Aug 30 04:14:24 2022] POST /identity/v3/users => generated 248 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:14:25.078120 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0596c4c-5aec-45dd-94d2-c877627030ae None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:25.078615 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0596c4c-5aec-45dd-94d2-c877627030ae None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:25.079032 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0596c4c-5aec-45dd-94d2-c877627030ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:25.126081 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-b0596c4c-5aec-45dd-94d2-c877627030ae None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:25.129381 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-b0596c4c-5aec-45dd-94d2-c877627030ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:25.242026 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 230/470] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:14:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:14:25.309502 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f152337e-5613-4f61-97e0-65cf6d4f9102 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:25.352037 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a97f8-2303-483b-bfd9-b884548151d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:25.352749 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a97f8-2303-483b-bfd9-b884548151d3 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:25.353071 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a97f8-2303-483b-bfd9-b884548151d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:25.353340 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a97f8-2303-483b-bfd9-b884548151d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:25.354181 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2a97f8-2303-483b-bfd9-b884548151d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:25.354483 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2a97f8-2303-483b-bfd9-b884548151d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:25.356307 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2a97f8-2303-483b-bfd9-b884548151d3 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:25.375430 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 241/471] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:14:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:25.389022 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0596c4c-5aec-45dd-94d2-c877627030ae None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:25.583653 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a97f8-2303-483b-bfd9-b884548151d3 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:25.594711 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0596c4c-5aec-45dd-94d2-c877627030ae None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:25.625562 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:25.656873 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc0a0b-aaef-45cd-863f-ff50b51b861d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:25.657533 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc0a0b-aaef-45cd-863f-ff50b51b861d None admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:25.657810 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc0a0b-aaef-45cd-863f-ff50b51b861d None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:25.658077 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc0a0b-aaef-45cd-863f-ff50b51b861d None admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:25.658920 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afc0a0b-aaef-45cd-863f-ff50b51b861d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:25.660578 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afc0a0b-aaef-45cd-863f-ff50b51b861d None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:25.699428 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 231/472] 10.222.0.91 () {60 vars in 1132 bytes} [Tue Aug 30 04:14:25 2022] POST /identity/v3/users => generated 248 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:14:25.701731 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68cf6ea-6be9-4fc9-9154-987ef4fcdfa7 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:25.702164 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68cf6ea-6be9-4fc9-9154-987ef4fcdfa7 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:25.702606 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68cf6ea-6be9-4fc9-9154-987ef4fcdfa7 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:25.706249 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 232/473] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:14:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:14:25.715242 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f1627-b227-4a75-a4ef-34ddadfa1980 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:25.715753 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f1627-b227-4a75-a4ef-34ddadfa1980 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:25.716219 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f1627-b227-4a75-a4ef-34ddadfa1980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:25.737899 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:25.746708 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-d96f1627-b227-4a75-a4ef-34ddadfa1980 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:25.748676 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-d96f1627-b227-4a75-a4ef-34ddadfa1980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:25.825403 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a97f8-2303-483b-bfd9-b884548151d3 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:25.884252 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 233/474] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:14:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 04:14:25.938815 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faac9b8-6427-4da7-9df7-1208eecedaa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:25.939894 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faac9b8-6427-4da7-9df7-1208eecedaa9 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:25.940390 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faac9b8-6427-4da7-9df7-1208eecedaa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:25.940851 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faac9b8-6427-4da7-9df7-1208eecedaa9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:25.966410 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faac9b8-6427-4da7-9df7-1208eecedaa9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:25.969271 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faac9b8-6427-4da7-9df7-1208eecedaa9 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:26.000300 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-0faac9b8-6427-4da7-9df7-1208eecedaa9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:26.000300 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:26.000300 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:26.000300 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:26.000300 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:26.000300 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:26.000300 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:26.000300 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:26.000300 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:26.000300 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:26.000300 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:26.000300 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:26.000300 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:14:26.000300 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:14:26.000300 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:14:26.000300 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:14:26.001273 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:26.001273 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:26.001273 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:26.001273 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:26.001273 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:26.001273 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:26.001273 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:26.001273 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:26.001273 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:26.001273 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:26.001273 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:26.001273 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:26.001273 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:26.001273 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:26.001273 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:26.001273 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:26.001273 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:14:26.002119 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:14:26.002119 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:26.002119 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:14:26.002794 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 242/475] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:14:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 420 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:26.011324 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f1627-b227-4a75-a4ef-34ddadfa1980 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:26.216674 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f1627-b227-4a75-a4ef-34ddadfa1980 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:26.233771 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:26.266428 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faac9b8-6427-4da7-9df7-1208eecedaa9 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:26.284140 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb06c7-4a9a-4f24-9e27-5539f7f3e7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:26.285413 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb06c7-4a9a-4f24-9e27-5539f7f3e7a4 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:26.285887 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb06c7-4a9a-4f24-9e27-5539f7f3e7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:26.286358 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb06c7-4a9a-4f24-9e27-5539f7f3e7a4 None admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:26.288597 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcb06c7-4a9a-4f24-9e27-5539f7f3e7a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:26.289133 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcb06c7-4a9a-4f24-9e27-5539f7f3e7a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:26.292570 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcb06c7-4a9a-4f24-9e27-5539f7f3e7a4 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:26.323967 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 234/476] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:14:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:26.331237 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb06c7-4a9a-4f24-9e27-5539f7f3e7a4 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:26.499330 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faac9b8-6427-4da7-9df7-1208eecedaa9 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:26.527476 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:26.572813 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb06c7-4a9a-4f24-9e27-5539f7f3e7a4 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:26.645119 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231c5361-f6c9-4c33-a479-24355caad601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:26.646596 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c5361-f6c9-4c33-a479-24355caad601 None admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:26.647072 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c5361-f6c9-4c33-a479-24355caad601 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:26.647551 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c5361-f6c9-4c33-a479-24355caad601 None admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:26.648458 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231c5361-f6c9-4c33-a479-24355caad601 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:26.650182 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231c5361-f6c9-4c33-a479-24355caad601 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:26.653903 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4af5ed-1a1b-48db-97c6-0a1929c7157a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:26.654705 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4af5ed-1a1b-48db-97c6-0a1929c7157a None admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:26.654837 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4af5ed-1a1b-48db-97c6-0a1929c7157a None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:26.655153 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4af5ed-1a1b-48db-97c6-0a1929c7157a None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:26.655767 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4af5ed-1a1b-48db-97c6-0a1929c7157a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:26.657370 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4af5ed-1a1b-48db-97c6-0a1929c7157a None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:26.676497 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.sql.core [None req-3d4af5ed-1a1b-48db-97c6-0a1929c7157a None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 30 04:14:26.676497 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 30 04:14:26.676497 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [parameters: {'id': '2e95ef7e64414d509d3209399cd81a36', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 30 04:14:26.676497 dv-cinder-854265-2-smb devstack@keystone.service[81546]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81546) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 30 04:14:26.699217 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 235/477] 10.222.0.91 () {60 vars in 1132 bytes} [Tue Aug 30 04:14:26 2022] POST /identity/v3/users => generated 249 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:14:26.717819 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-3d4af5ed-1a1b-48db-97c6-0a1929c7157a None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 30 04:14:26.717819 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:26.717819 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 04:14:26.717819 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 04:14:26.717819 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 04:14:26.717819 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 04:14:26.717819 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 04:14:26.717819 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 04:14:26.717819 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 04:14:26.717819 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application conn.query(q) Aug 30 04:14:26.717819 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 04:14:26.717819 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 04:14:26.717819 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 04:14:26.717819 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application result.read() Aug 30 04:14:26.717819 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 04:14:26.719220 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 04:14:26.719220 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 04:14:26.719220 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 04:14:26.719220 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 04:14:26.719220 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 04:14:26.719220 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 04:14:26.719220 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 04:14:26.719220 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 30 04:14:26.719220 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:14:26.719220 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 30 04:14:26.719220 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:14:26.719220 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:26.719220 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 30 04:14:26.719220 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 30 04:14:26.719220 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 30 04:14:26.719220 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return ref.to_dict() Aug 30 04:14:26.719220 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 04:14:26.719220 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application next(self.gen) Aug 30 04:14:26.721005 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 30 04:14:26.721005 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application yield resource Aug 30 04:14:26.721005 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 04:14:26.721005 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application next(self.gen) Aug 30 04:14:26.721005 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 30 04:14:26.721005 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self.session.rollback() Aug 30 04:14:26.721005 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 04:14:26.721005 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self.force_reraise() Aug 30 04:14:26.721005 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 04:14:26.721005 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise self.value Aug 30 04:14:26.721005 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 30 04:14:26.721005 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 30 04:14:26.721005 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 30 04:14:26.721005 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application session.commit() Aug 30 04:14:26.721005 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 30 04:14:26.721005 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 30 04:14:26.721005 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 30 04:14:26.722295 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._prepare_impl() Aug 30 04:14:26.722295 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 30 04:14:26.722295 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self.session.flush() Aug 30 04:14:26.722295 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 30 04:14:26.722295 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._flush(objects) Aug 30 04:14:26.722295 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 30 04:14:26.722295 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 30 04:14:26.722295 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 30 04:14:26.722295 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application compat.raise_( Aug 30 04:14:26.722295 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 04:14:26.722295 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception Aug 30 04:14:26.722295 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 30 04:14:26.722295 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application flush_context.execute() Aug 30 04:14:26.722295 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 30 04:14:26.722295 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rec.execute(self) Aug 30 04:14:26.722295 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 30 04:14:26.722295 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 30 04:14:26.726005 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 30 04:14:26.726005 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 30 04:14:26.726005 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 30 04:14:26.726005 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 30 04:14:26.726005 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 30 04:14:26.726005 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 30 04:14:26.726005 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 30 04:14:26.726005 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 30 04:14:26.726005 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 30 04:14:26.726005 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 30 04:14:26.726005 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 30 04:14:26.726005 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 30 04:14:26.726005 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 30 04:14:26.726005 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 30 04:14:26.726005 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 04:14:26.726005 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception Aug 30 04:14:26.729023 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 04:14:26.729023 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 04:14:26.729023 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 04:14:26.729023 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 04:14:26.729023 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 04:14:26.729023 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 04:14:26.729023 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 04:14:26.729023 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application conn.query(q) Aug 30 04:14:26.729023 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 04:14:26.729023 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 04:14:26.729023 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 04:14:26.729023 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application result.read() Aug 30 04:14:26.729023 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 04:14:26.729023 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 04:14:26.729023 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 04:14:26.729023 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 04:14:26.734132 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 04:14:26.734132 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 04:14:26.734132 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 04:14:26.734132 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 04:14:26.734132 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 30 04:14:26.734132 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 30 04:14:26.734132 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [parameters: {'id': '2e95ef7e64414d509d3209399cd81a36', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 30 04:14:26.734132 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 30 04:14:26.734132 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:14:26.734132 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:14:26.734132 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:14:26.734132 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:26.734132 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:26.734132 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:26.734132 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:26.734132 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:26.736710 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:26.736710 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:26.736710 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:26.736710 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:26.736710 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:26.736710 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:26.736710 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 30 04:14:26.736710 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 30 04:14:26.736710 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:26.736710 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:26.736710 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 30 04:14:26.736710 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 30 04:14:26.736710 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 30 04:14:26.736710 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 30 04:14:26.736710 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 30 04:14:26.736710 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:14:26.741597 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 243/478] 10.222.0.91 () {60 vars in 1131 bytes} [Tue Aug 30 04:14:26 2022] POST /identity/v3/roles => generated 144 bytes in 467 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:26.741827 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231c5361-f6c9-4c33-a479-24355caad601 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:26.802933 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:26.965034 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231c5361-f6c9-4c33-a479-24355caad601 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:27.027103 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425d3448-9ad5-4379-9173-6881a01d21fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:27.027955 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d3448-9ad5-4379-9173-6881a01d21fb None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:27.028357 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d3448-9ad5-4379-9173-6881a01d21fb None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:27.028357 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d3448-9ad5-4379-9173-6881a01d21fb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:27.045861 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425d3448-9ad5-4379-9173-6881a01d21fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:14:27.051390 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-425d3448-9ad5-4379-9173-6881a01d21fb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:14:27.051390 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:27.051390 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:27.051390 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:27.051390 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:27.051390 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:27.051390 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:27.051390 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:27.051390 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:27.051390 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:27.051390 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:27.051390 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:27.051390 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:14:27.051390 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:14:27.051390 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:14:27.051390 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:14:27.053264 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:14:27.053264 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:14:27.053264 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:14:27.053264 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:14:27.053264 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:27.053264 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:27.053264 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:27.053264 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:27.053264 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:27.053264 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:27.053264 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:27.053264 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:27.053264 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:27.053264 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:27.053264 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:27.053264 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:27.054534 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:27.054534 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:27.054534 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:27.054534 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:27.054534 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:14:27.054534 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:14:27.054534 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:14:27.054534 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:14:27.054534 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:14:27.054534 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:14:27.054534 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:14:27.054534 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:14:27.054534 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 236/479] 10.222.0.91 () {56 vars in 1114 bytes} [Tue Aug 30 04:14:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:27.063939 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4af5ed-1a1b-48db-97c6-0a1929c7157a None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:27.220999 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4af5ed-1a1b-48db-97c6-0a1929c7157a None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:27.296790 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234245f2-5948-496c-84e7-bc81fec49e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:27.298488 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234245f2-5948-496c-84e7-bc81fec49e11 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:27.299273 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234245f2-5948-496c-84e7-bc81fec49e11 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:27.300116 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234245f2-5948-496c-84e7-bc81fec49e11 None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:27.301694 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234245f2-5948-496c-84e7-bc81fec49e11 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:27.302495 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234245f2-5948-496c-84e7-bc81fec49e11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:27.305505 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234245f2-5948-496c-84e7-bc81fec49e11 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:27.323163 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 244/480] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 30 04:14:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:27.556447 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be3178-861b-4979-a3bc-30ea99bc9556 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:27.556684 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be3178-861b-4979-a3bc-30ea99bc9556 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:27.557111 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be3178-861b-4979-a3bc-30ea99bc9556 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:27.559821 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 237/481] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:14:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:14:27.566693 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d2575-1090-42f9-b741-fc5337be5341 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:27.567649 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d2575-1090-42f9-b741-fc5337be5341 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:27.568452 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d2575-1090-42f9-b741-fc5337be5341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:27.609136 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-458d2575-1090-42f9-b741-fc5337be5341 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:27.610384 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-458d2575-1090-42f9-b741-fc5337be5341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:27.653708 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:27.717096 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 245/482] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:14:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:14:28.001085 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26be3178-861b-4979-a3bc-30ea99bc9556 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:28.137797 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:28.165892 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26be3178-861b-4979-a3bc-30ea99bc9556 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:28.234004 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c239f8e6-3c41-4040-a3d1-f98df12391a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:28.235683 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239f8e6-3c41-4040-a3d1-f98df12391a2 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:28.236629 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239f8e6-3c41-4040-a3d1-f98df12391a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:28.237471 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239f8e6-3c41-4040-a3d1-f98df12391a2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:28.267143 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca2a66-45cd-492c-889c-b88518595666 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:28.267374 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca2a66-45cd-492c-889c-b88518595666 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:28.267668 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca2a66-45cd-492c-889c-b88518595666 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:28.268237 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c239f8e6-3c41-4040-a3d1-f98df12391a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:14:28.269286 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 246/483] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:14:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:14:28.275210 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648863d6-c929-4cbb-80c7-d05f42aa4626 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:28.275642 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648863d6-c929-4cbb-80c7-d05f42aa4626 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:28.276111 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648863d6-c929-4cbb-80c7-d05f42aa4626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:28.279454 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-c239f8e6-3c41-4040-a3d1-f98df12391a2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:14:28.279454 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:28.279454 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:28.279454 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:28.279454 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:28.279454 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:28.279454 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:28.279454 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:28.279454 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:28.279454 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:28.279454 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:28.279454 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:28.279454 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:14:28.279454 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:14:28.279454 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:14:28.279454 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:14:28.281207 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:14:28.281207 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:14:28.281207 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:14:28.281207 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:14:28.281207 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:28.281207 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:28.281207 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:28.281207 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:28.281207 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:28.281207 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:28.281207 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:28.281207 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:28.281207 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:28.281207 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:28.281207 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:28.281207 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:28.282783 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:28.282783 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:28.282783 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:28.282783 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:28.282783 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:14:28.282783 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:14:28.282783 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:14:28.282783 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:14:28.282783 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:14:28.282783 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:14:28.282783 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:14:28.282783 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:14:28.287681 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 238/484] 10.222.0.91 () {56 vars in 1102 bytes} [Tue Aug 30 04:14:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:28.310056 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-648863d6-c929-4cbb-80c7-d05f42aa4626 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:28.311291 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-648863d6-c929-4cbb-80c7-d05f42aa4626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:28.311624 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c239f8e6-3c41-4040-a3d1-f98df12391a2 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:28.455966 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 247/485] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:14:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:14:28.493267 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c239f8e6-3c41-4040-a3d1-f98df12391a2 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:28.539766 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35febb6e-d4c1-4110-882c-3c9321bc060c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:28.540344 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35febb6e-d4c1-4110-882c-3c9321bc060c None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:28.540627 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35febb6e-d4c1-4110-882c-3c9321bc060c None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:28.540892 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35febb6e-d4c1-4110-882c-3c9321bc060c None admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:28.541727 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35febb6e-d4c1-4110-882c-3c9321bc060c None admin] RBAC: Adding query filter params (name=service) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:28.542030 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35febb6e-d4c1-4110-882c-3c9321bc060c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:28.543881 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35febb6e-d4c1-4110-882c-3c9321bc060c None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:28.558702 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 239/486] 10.222.0.91 () {56 vars in 1103 bytes} [Tue Aug 30 04:14:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:14:28.560251 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648863d6-c929-4cbb-80c7-d05f42aa4626 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:28.735125 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:28.743148 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648863d6-c929-4cbb-80c7-d05f42aa4626 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:28.808825 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78745e08-13dc-4e88-83e3-6a4d3495f0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:28.809659 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78745e08-13dc-4e88-83e3-6a4d3495f0a8 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:28.810067 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78745e08-13dc-4e88-83e3-6a4d3495f0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:28.810469 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78745e08-13dc-4e88-83e3-6a4d3495f0a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:28.837351 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78745e08-13dc-4e88-83e3-6a4d3495f0a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:28.839878 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78745e08-13dc-4e88-83e3-6a4d3495f0a8 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:28.865032 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-78745e08-13dc-4e88-83e3-6a4d3495f0a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:28.865032 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:28.865032 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:28.865032 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:28.865032 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:28.865032 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:28.865032 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:28.865032 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:28.865032 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:28.865032 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:28.865032 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:28.865032 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:28.865032 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:14:28.865032 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:14:28.865032 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:14:28.865032 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:14:28.866022 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:28.866022 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:28.866022 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:28.866022 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:28.866022 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:28.866022 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:28.866022 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:28.866022 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:28.866022 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:28.866022 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:28.866022 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:28.866022 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:28.866022 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:28.866022 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:28.866022 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:28.866022 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:28.866022 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:14:28.866875 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:14:28.866875 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:28.866875 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:14:28.866875 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 248/487] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:14:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:28.873563 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35febb6e-d4c1-4110-882c-3c9321bc060c None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:28.905387 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:28.924225 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b7a55-bb97-4a27-a566-f432daa458a5 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:28.924518 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b7a55-bb97-4a27-a566-f432daa458a5 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:28.924796 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b7a55-bb97-4a27-a566-f432daa458a5 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:28.926472 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 249/488] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:14:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:14:28.950612 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85817219-a348-4e09-8e68-82fb8e4e521a None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:28.950881 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85817219-a348-4e09-8e68-82fb8e4e521a None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:28.951056 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85817219-a348-4e09-8e68-82fb8e4e521a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:28.993138 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-85817219-a348-4e09-8e68-82fb8e4e521a None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:28.994457 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-85817219-a348-4e09-8e68-82fb8e4e521a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:29.102623 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35febb6e-d4c1-4110-882c-3c9321bc060c None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:29.145756 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 250/489] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:14:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 04:14:29.147504 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85817219-a348-4e09-8e68-82fb8e4e521a None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:29.189921 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaaa667-b738-45a0-82b4-d6290e3d058c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:29.190409 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaaa667-b738-45a0-82b4-d6290e3d058c None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:29.190770 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaaa667-b738-45a0-82b4-d6290e3d058c None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:29.191956 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaaa667-b738-45a0-82b4-d6290e3d058c None admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:29.195948 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaaa667-b738-45a0-82b4-d6290e3d058c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:29.195948 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaaa667-b738-45a0-82b4-d6290e3d058c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:29.195948 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaaa667-b738-45a0-82b4-d6290e3d058c None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:29.248985 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 240/490] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:14:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:29.254259 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaaa667-b738-45a0-82b4-d6290e3d058c None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:29.417854 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:29.426941 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:29.466487 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaaa667-b738-45a0-82b4-d6290e3d058c None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:29.514472 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ab58f-47d8-49f2-bf16-45ec6daad12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:29.515609 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ab58f-47d8-49f2-bf16-45ec6daad12c None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:29.516138 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ab58f-47d8-49f2-bf16-45ec6daad12c None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:29.516982 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ab58f-47d8-49f2-bf16-45ec6daad12c None admin] PATH_INFO: `/v3/users/glance` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:29.527334 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868ab58f-47d8-49f2-bf16-45ec6daad12c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:29.529576 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868ab58f-47d8-49f2-bf16-45ec6daad12c None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:29.533346 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85817219-a348-4e09-8e68-82fb8e4e521a None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:29.547251 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-868ab58f-47d8-49f2-bf16-45ec6daad12c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 30 04:14:29.547251 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:29.547251 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:29.547251 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:29.547251 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:29.547251 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:29.547251 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:29.547251 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:29.547251 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:29.547251 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:29.547251 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:29.547251 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:29.547251 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:14:29.547251 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:14:29.547251 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:14:29.547251 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:14:29.548360 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:29.548360 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:29.548360 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:14:29.548360 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:14:29.548360 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:14:29.548360 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:14:29.548360 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:29.548360 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:29.548360 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:29.548360 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:29.548360 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:29.548360 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:29.548360 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:29.548360 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:29.548360 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:29.548360 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:29.548360 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:29.548360 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:29.549321 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:29.549321 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:29.549321 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:14:29.549321 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:14:29.549321 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:14:29.549321 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:14:29.549321 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:14:29.549321 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:14:29.549321 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 30 04:14:29.549321 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:14:29.552197 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 241/491] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 30 04:14:29 2022] GET /identity/v3/users/glance => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:29.563254 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ab58f-47d8-49f2-bf16-45ec6daad12c None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:29.656624 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f48842-ef0c-4da3-9725-7c3840262f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:29.657615 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f48842-ef0c-4da3-9725-7c3840262f2b None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:29.658004 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f48842-ef0c-4da3-9725-7c3840262f2b None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:29.658392 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f48842-ef0c-4da3-9725-7c3840262f2b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:29.678418 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f48842-ef0c-4da3-9725-7c3840262f2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:14:29.688615 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-a3f48842-ef0c-4da3-9725-7c3840262f2b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:14:29.688615 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:29.688615 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:29.688615 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:29.688615 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:29.688615 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:29.688615 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:29.688615 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:29.688615 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:29.688615 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:29.688615 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:29.688615 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:29.688615 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:14:29.688615 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:14:29.688615 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:14:29.688615 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:14:29.689635 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:14:29.689635 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:14:29.689635 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:14:29.689635 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:14:29.689635 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:29.689635 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:29.689635 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:29.689635 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:29.689635 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:29.689635 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:29.689635 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:29.689635 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:29.689635 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:29.689635 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:29.689635 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:29.689635 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:29.690447 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:29.690447 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:29.690447 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:29.690447 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:29.690447 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:14:29.690447 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:14:29.690447 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:14:29.690447 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:14:29.690447 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:14:29.690447 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:14:29.690447 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:14:29.690447 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:14:29.691103 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 251/492] 10.222.0.91 () {56 vars in 1102 bytes} [Tue Aug 30 04:14:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 544 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:29.696911 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f48842-ef0c-4da3-9725-7c3840262f2b None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:29.811072 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ab58f-47d8-49f2-bf16-45ec6daad12c None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:29.854827 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:29.856809 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f48842-ef0c-4da3-9725-7c3840262f2b None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:29.877649 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6787742d-f719-4ae0-9c25-ccd959519b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:29.878288 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787742d-f719-4ae0-9c25-ccd959519b13 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:29.878564 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787742d-f719-4ae0-9c25-ccd959519b13 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:29.878837 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787742d-f719-4ae0-9c25-ccd959519b13 None admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:29.879591 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6787742d-f719-4ae0-9c25-ccd959519b13 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:29.879897 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6787742d-f719-4ae0-9c25-ccd959519b13 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:29.881990 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6787742d-f719-4ae0-9c25-ccd959519b13 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:29.930915 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66845be7-0eb6-48f4-b25a-fab1d450b624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:29.931957 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66845be7-0eb6-48f4-b25a-fab1d450b624 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:29.932453 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66845be7-0eb6-48f4-b25a-fab1d450b624 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:29.932941 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66845be7-0eb6-48f4-b25a-fab1d450b624 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:29.938555 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:29.951464 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66845be7-0eb6-48f4-b25a-fab1d450b624 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:14:29.962355 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 242/493] 10.222.0.91 () {56 vars in 1137 bytes} [Tue Aug 30 04:14:29 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:29.963215 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-66845be7-0eb6-48f4-b25a-fab1d450b624 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:14:29.963215 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:29.963215 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:29.963215 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:29.963215 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:29.963215 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:29.963215 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:29.963215 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:29.963215 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:29.963215 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:29.963215 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:29.963215 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:29.963215 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:14:29.963215 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:14:29.963215 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:14:29.963215 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:14:29.964879 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:14:29.964879 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:14:29.964879 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:14:29.964879 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:14:29.964879 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:29.964879 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:29.964879 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:29.964879 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:29.964879 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:29.964879 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:29.964879 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:29.964879 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:29.964879 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:29.964879 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:29.964879 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:29.964879 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:29.967379 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:29.967379 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:29.967379 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:29.967379 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:29.967379 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:14:29.967379 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:14:29.967379 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:14:29.967379 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:14:29.967379 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:14:29.967379 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:14:29.967379 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:14:29.967379 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:14:29.969505 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6787742d-f719-4ae0-9c25-ccd959519b13 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:29.972368 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 252/494] 10.222.0.91 () {56 vars in 1102 bytes} [Tue Aug 30 04:14:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:29.972368 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84f373-1fe0-445c-a370-ab2e4f003bf7 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:29.972368 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84f373-1fe0-445c-a370-ab2e4f003bf7 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:29.972368 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84f373-1fe0-445c-a370-ab2e4f003bf7 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:29.972368 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 253/495] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:14:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:14:29.972368 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b84f373-1fe0-445c-a370-ab2e4f003bf7 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:30.105255 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6787742d-f719-4ae0-9c25-ccd959519b13 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:30.111545 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b84f373-1fe0-445c-a370-ab2e4f003bf7 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:30.149278 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e488f4-a8bd-4f0d-8060-5b0cecfa578d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:30.149907 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e488f4-a8bd-4f0d-8060-5b0cecfa578d None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:30.150191 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e488f4-a8bd-4f0d-8060-5b0cecfa578d None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:30.150932 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e488f4-a8bd-4f0d-8060-5b0cecfa578d None admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:30.151976 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e488f4-a8bd-4f0d-8060-5b0cecfa578d None admin] RBAC: Adding query filter params (name=service) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:30.152289 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e488f4-a8bd-4f0d-8060-5b0cecfa578d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:30.153753 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e488f4-a8bd-4f0d-8060-5b0cecfa578d None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:30.157127 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043cc58-ce7c-4ec6-aa3c-5e6683df081c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:30.157759 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043cc58-ce7c-4ec6-aa3c-5e6683df081c None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:30.158022 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043cc58-ce7c-4ec6-aa3c-5e6683df081c None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:30.158296 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043cc58-ce7c-4ec6-aa3c-5e6683df081c None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:30.158975 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2043cc58-ce7c-4ec6-aa3c-5e6683df081c None admin] RBAC: Adding query filter params (name=service) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:30.159277 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2043cc58-ce7c-4ec6-aa3c-5e6683df081c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:30.160735 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2043cc58-ce7c-4ec6-aa3c-5e6683df081c None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:30.163581 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 243/496] 10.222.0.91 () {56 vars in 1103 bytes} [Tue Aug 30 04:14:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:30.164935 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269b5ae-e068-4b48-b9d2-952020689dc2 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:30.165213 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269b5ae-e068-4b48-b9d2-952020689dc2 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:30.165486 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269b5ae-e068-4b48-b9d2-952020689dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:30.176771 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 254/497] 10.222.0.91 () {56 vars in 1103 bytes} [Tue Aug 30 04:14:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:30.177669 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043cc58-ce7c-4ec6-aa3c-5e6683df081c None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:30.198331 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-7269b5ae-e068-4b48-b9d2-952020689dc2 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:30.200571 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-7269b5ae-e068-4b48-b9d2-952020689dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:30.267565 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:30.287766 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:30.328252 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043cc58-ce7c-4ec6-aa3c-5e6683df081c None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:30.339962 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 244/498] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:14:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:14:30.340634 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7269b5ae-e068-4b48-b9d2-952020689dc2 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:30.377885 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f500b-c4f0-41f7-a7c3-503479931847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:30.378791 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f500b-c4f0-41f7-a7c3-503479931847 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:30.379303 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f500b-c4f0-41f7-a7c3-503479931847 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:30.381470 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f500b-c4f0-41f7-a7c3-503479931847 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:30.467623 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30f500b-c4f0-41f7-a7c3-503479931847 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:30.469556 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30f500b-c4f0-41f7-a7c3-503479931847 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:30.545402 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7269b5ae-e068-4b48-b9d2-952020689dc2 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:30.548331 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:30.611747 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 255/499] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 30 04:14:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:30.612998 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f500b-c4f0-41f7-a7c3-503479931847 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:30.621021 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3558015b-effe-402b-94b8-1ae601715fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:30.622336 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558015b-effe-402b-94b8-1ae601715fca None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:30.623059 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558015b-effe-402b-94b8-1ae601715fca None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:30.623792 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558015b-effe-402b-94b8-1ae601715fca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:30.642470 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3558015b-effe-402b-94b8-1ae601715fca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:30.644606 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3558015b-effe-402b-94b8-1ae601715fca None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:30.662868 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-3558015b-effe-402b-94b8-1ae601715fca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:30.662868 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:30.662868 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:30.662868 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:30.662868 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:30.662868 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:30.662868 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:30.662868 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:30.662868 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:30.662868 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:30.662868 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:30.662868 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:30.662868 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:14:30.662868 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:14:30.662868 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:14:30.662868 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:14:30.664737 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:30.664737 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:30.664737 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:30.664737 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:30.664737 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:30.664737 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:30.664737 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:30.664737 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:30.664737 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:30.664737 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:30.664737 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:30.664737 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:30.664737 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:30.664737 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:30.664737 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:30.664737 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:30.664737 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:14:30.666516 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:14:30.666516 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:30.666516 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:14:30.666516 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 245/500] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:14:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:30.666516 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe83890-5dff-470a-b776-a5e829d041d4 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:30.666516 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe83890-5dff-470a-b776-a5e829d041d4 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:30.666516 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe83890-5dff-470a-b776-a5e829d041d4 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:30.668935 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 246/501] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:14:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:14:30.671521 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe83890-5dff-470a-b776-a5e829d041d4 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:30.709721 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:30.780739 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f500b-c4f0-41f7-a7c3-503479931847 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:30.800159 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe83890-5dff-470a-b776-a5e829d041d4 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:30.826984 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f8ec3-ed89-420b-88a8-df1ece38c4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:30.828088 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f8ec3-ed89-420b-88a8-df1ece38c4c6 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:30.828574 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f8ec3-ed89-420b-88a8-df1ece38c4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:30.829025 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f8ec3-ed89-420b-88a8-df1ece38c4c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:30.840708 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7411bd-87cb-4adc-bad5-e35a2023d8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:30.841358 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7411bd-87cb-4adc-bad5-e35a2023d8e1 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:30.841635 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7411bd-87cb-4adc-bad5-e35a2023d8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:30.841906 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7411bd-87cb-4adc-bad5-e35a2023d8e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:30.846939 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7f8ec3-ed89-420b-88a8-df1ece38c4c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:30.848720 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7f8ec3-ed89-420b-88a8-df1ece38c4c6 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:30.854516 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7411bd-87cb-4adc-bad5-e35a2023d8e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:30.856056 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7411bd-87cb-4adc-bad5-e35a2023d8e1 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:30.866367 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-8e7f8ec3-ed89-420b-88a8-df1ece38c4c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:30.866367 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:30.866367 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:30.866367 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:30.866367 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:30.866367 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:30.866367 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:30.866367 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:30.866367 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:30.866367 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:30.866367 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:30.866367 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:30.866367 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:14:30.866367 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:14:30.866367 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:14:30.866367 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:14:30.868662 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:30.868662 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:30.868662 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:30.868662 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:30.868662 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:30.868662 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:30.868662 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:30.868662 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:30.868662 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:30.868662 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:30.868662 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:30.868662 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:30.868662 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:30.868662 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:30.868662 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:30.868662 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:30.868662 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:14:30.870373 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:14:30.870373 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:30.870373 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:14:30.870373 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 256/502] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:14:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:30.870373 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f8ec3-ed89-420b-88a8-df1ece38c4c6 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:30.872821 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-0a7411bd-87cb-4adc-bad5-e35a2023d8e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:30.872821 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:30.872821 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:30.872821 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:30.872821 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:30.872821 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:30.872821 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:30.872821 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:30.872821 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:30.872821 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:30.872821 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:30.872821 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:30.872821 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:14:30.872821 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:14:30.872821 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:14:30.872821 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:14:30.876343 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:30.876343 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:30.876343 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:30.876343 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:30.876343 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:30.876343 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:30.876343 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:30.876343 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:30.876343 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:30.876343 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:30.876343 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:30.876343 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:30.876343 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:30.876343 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:30.876343 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:30.876343 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:30.876343 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:14:30.878511 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:14:30.878511 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:30.878511 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:14:30.878511 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 247/503] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:14:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:30.878511 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7411bd-87cb-4adc-bad5-e35a2023d8e1 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:30.892242 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:30.973361 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:30.999101 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7411bd-87cb-4adc-bad5-e35a2023d8e1 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:31.009148 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f8ec3-ed89-420b-88a8-df1ece38c4c6 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:31.037978 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca69ee5-654a-4df4-afdb-4864c405b95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:31.038517 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca69ee5-654a-4df4-afdb-4864c405b95a None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:31.038790 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca69ee5-654a-4df4-afdb-4864c405b95a None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:31.039070 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca69ee5-654a-4df4-afdb-4864c405b95a None admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:31.039837 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca69ee5-654a-4df4-afdb-4864c405b95a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:31.040113 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca69ee5-654a-4df4-afdb-4864c405b95a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:31.041675 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca69ee5-654a-4df4-afdb-4864c405b95a None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:31.055544 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 248/504] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:14:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:31.057147 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e667f-5714-424d-ab7f-a4d7eae52bbe None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:31.057475 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e667f-5714-424d-ab7f-a4d7eae52bbe None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:31.057934 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e667f-5714-424d-ab7f-a4d7eae52bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:31.071183 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1174af5e-c998-4688-a45e-77116ca58504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:31.072001 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174af5e-c998-4688-a45e-77116ca58504 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:31.072428 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174af5e-c998-4688-a45e-77116ca58504 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:31.073658 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174af5e-c998-4688-a45e-77116ca58504 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:31.081038 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-ae7e667f-5714-424d-ab7f-a4d7eae52bbe None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:31.082324 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-ae7e667f-5714-424d-ab7f-a4d7eae52bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:31.088326 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1174af5e-c998-4688-a45e-77116ca58504 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:14:31.094408 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-1174af5e-c998-4688-a45e-77116ca58504 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:14:31.094408 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:31.094408 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:31.094408 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:31.094408 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:31.094408 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:31.094408 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:31.094408 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:31.094408 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:31.094408 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:31.094408 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:31.094408 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:31.094408 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:14:31.094408 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:14:31.094408 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:14:31.094408 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:14:31.096542 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:14:31.096542 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:14:31.096542 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:14:31.096542 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:14:31.096542 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:31.096542 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:31.096542 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:31.096542 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:31.096542 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:31.096542 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:31.096542 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:31.096542 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:31.096542 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:31.096542 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:31.096542 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:31.096542 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:31.099679 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:31.099679 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:31.099679 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:31.099679 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:31.099679 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:14:31.099679 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:14:31.099679 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:14:31.099679 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:14:31.099679 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:14:31.099679 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:14:31.099679 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:14:31.099679 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:14:31.099679 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 257/505] 10.222.0.91 () {56 vars in 1102 bytes} [Tue Aug 30 04:14:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:31.099679 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1174af5e-c998-4688-a45e-77116ca58504 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:31.169888 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 249/506] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:14:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:14:31.170879 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e667f-5714-424d-ab7f-a4d7eae52bbe None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:31.191107 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:31.240040 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1174af5e-c998-4688-a45e-77116ca58504 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:31.279775 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:31.290787 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8255a0c-3394-4ed6-bfa9-709bcfc56d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:31.291588 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8255a0c-3394-4ed6-bfa9-709bcfc56d90 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:31.292072 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8255a0c-3394-4ed6-bfa9-709bcfc56d90 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:31.292531 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8255a0c-3394-4ed6-bfa9-709bcfc56d90 None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:31.294422 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8255a0c-3394-4ed6-bfa9-709bcfc56d90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:31.294996 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8255a0c-3394-4ed6-bfa9-709bcfc56d90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:31.297707 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8255a0c-3394-4ed6-bfa9-709bcfc56d90 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:31.320304 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e667f-5714-424d-ab7f-a4d7eae52bbe None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:31.323099 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 258/507] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:14:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:31.324888 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8255a0c-3394-4ed6-bfa9-709bcfc56d90 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:31.372168 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c574b-27f8-4e9f-a281-7d2b67eb6b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:31.373437 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c574b-27f8-4e9f-a281-7d2b67eb6b96 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:31.374078 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c574b-27f8-4e9f-a281-7d2b67eb6b96 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:31.374723 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c574b-27f8-4e9f-a281-7d2b67eb6b96 None admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:31.375886 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816c574b-27f8-4e9f-a281-7d2b67eb6b96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:31.376614 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816c574b-27f8-4e9f-a281-7d2b67eb6b96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:31.379352 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816c574b-27f8-4e9f-a281-7d2b67eb6b96 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:31.399875 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 250/508] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:14:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:31.401607 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c574b-27f8-4e9f-a281-7d2b67eb6b96 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:31.505102 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8255a0c-3394-4ed6-bfa9-709bcfc56d90 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:31.558757 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:31.562618 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c574b-27f8-4e9f-a281-7d2b67eb6b96 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:31.566207 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d9625-8d86-424a-9a84-4ea264ba9620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:31.567800 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d9625-8d86-424a-9a84-4ea264ba9620 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:31.568135 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d9625-8d86-424a-9a84-4ea264ba9620 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:31.568412 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d9625-8d86-424a-9a84-4ea264ba9620 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:31.578446 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457d9625-8d86-424a-9a84-4ea264ba9620 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:31.579967 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457d9625-8d86-424a-9a84-4ea264ba9620 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:31.595950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-457d9625-8d86-424a-9a84-4ea264ba9620 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 04:14:31.595950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:31.595950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:31.595950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:31.595950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:31.595950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:31.595950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:31.595950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:31.595950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:31.595950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:31.595950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:31.595950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:31.595950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:14:31.595950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:14:31.595950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:14:31.595950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:14:31.596926 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:31.596926 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:31.596926 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:14:31.596926 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:14:31.596926 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:14:31.596926 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:14:31.596926 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:31.596926 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:31.596926 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:31.596926 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:31.596926 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:31.596926 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:31.596926 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:31.596926 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:31.596926 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:31.596926 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:31.596926 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:31.596926 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:31.597840 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:31.597840 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:31.597840 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:14:31.597840 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:14:31.597840 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:14:31.597840 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:14:31.597840 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:14:31.597840 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:14:31.597840 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 04:14:31.597840 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:14:31.602230 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 259/509] 10.222.0.91 () {56 vars in 1093 bytes} [Tue Aug 30 04:14:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:31.603103 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d9625-8d86-424a-9a84-4ea264ba9620 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:31.622884 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:31.632948 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aa1600-f910-4ebf-9528-aeb9f313d345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:31.633942 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa1600-f910-4ebf-9528-aeb9f313d345 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:31.634470 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa1600-f910-4ebf-9528-aeb9f313d345 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:31.634936 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa1600-f910-4ebf-9528-aeb9f313d345 None admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:31.638842 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aa1600-f910-4ebf-9528-aeb9f313d345 None admin] RBAC: Adding query filter params (name=service) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:31.638842 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aa1600-f910-4ebf-9528-aeb9f313d345 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:31.639383 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aa1600-f910-4ebf-9528-aeb9f313d345 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:31.659649 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 251/510] 10.222.0.91 () {56 vars in 1103 bytes} [Tue Aug 30 04:14:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:31.659649 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aa1600-f910-4ebf-9528-aeb9f313d345 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:31.733353 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d9625-8d86-424a-9a84-4ea264ba9620 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:31.774187 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc920f-d417-4e9b-a8e3-77dbaccafa0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:31.774836 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc920f-d417-4e9b-a8e3-77dbaccafa0a None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:31.775105 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc920f-d417-4e9b-a8e3-77dbaccafa0a None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:31.775375 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc920f-d417-4e9b-a8e3-77dbaccafa0a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:31.784597 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfc920f-d417-4e9b-a8e3-77dbaccafa0a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:31.786090 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfc920f-d417-4e9b-a8e3-77dbaccafa0a None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:31.800005 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-6cfc920f-d417-4e9b-a8e3-77dbaccafa0a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 04:14:31.800005 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:31.800005 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:31.800005 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:31.800005 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:31.800005 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:31.800005 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:31.800005 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:31.800005 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:31.800005 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:31.800005 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:31.800005 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:31.800005 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:14:31.800005 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:14:31.800005 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:14:31.800005 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:14:31.801014 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:31.801014 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:31.801014 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:14:31.801014 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:14:31.801014 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:14:31.801014 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:14:31.801014 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:31.801014 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:31.801014 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:31.801014 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:31.801014 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:31.801014 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:31.801014 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:31.801014 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:31.801014 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:31.801014 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:31.801014 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:31.801014 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:31.801913 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:31.801913 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:31.801913 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:14:31.801913 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:14:31.801913 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:14:31.801913 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:14:31.801913 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:14:31.801913 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:14:31.801913 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 04:14:31.801913 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:14:31.801913 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 260/511] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 30 04:14:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:31.802508 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc920f-d417-4e9b-a8e3-77dbaccafa0a None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:31.826771 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aa1600-f910-4ebf-9528-aeb9f313d345 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:31.860669 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:31.895754 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c57ab-4898-4990-9a2e-759cb5093759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:31.896952 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c57ab-4898-4990-9a2e-759cb5093759 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:31.897457 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c57ab-4898-4990-9a2e-759cb5093759 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:31.897863 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c57ab-4898-4990-9a2e-759cb5093759 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:31.909417 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05c57ab-4898-4990-9a2e-759cb5093759 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:31.911257 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05c57ab-4898-4990-9a2e-759cb5093759 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:31.922866 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc920f-d417-4e9b-a8e3-77dbaccafa0a None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:31.928502 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-a05c57ab-4898-4990-9a2e-759cb5093759 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:14:31.928502 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:31.928502 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:31.928502 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:31.928502 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:31.928502 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:31.928502 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:31.928502 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:31.928502 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:31.928502 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:31.928502 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:31.928502 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:31.928502 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:14:31.928502 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:14:31.928502 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:14:31.930446 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:14:31.930446 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:31.930446 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:31.930446 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:31.930446 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:31.930446 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:31.930446 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:31.930446 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:31.930446 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:31.930446 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:31.930446 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:31.930446 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:31.930446 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:31.930446 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:31.930446 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:31.930446 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:31.930446 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:31.942374 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:14:31.942374 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:14:31.942374 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:14:31.942374 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:14:31.942374 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:14:31.942374 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:14:31.942374 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:14:31.942374 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:14:31.942374 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 252/512] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 30 04:14:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:31.942374 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c57ab-4898-4990-9a2e-759cb5093759 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:31.966183 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb20190-bf70-4cea-ab6d-f07e4ed8f7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:31.966818 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb20190-bf70-4cea-ab6d-f07e4ed8f7ef None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:31.967104 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb20190-bf70-4cea-ab6d-f07e4ed8f7ef None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:31.967389 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb20190-bf70-4cea-ab6d-f07e4ed8f7ef None admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:31.968199 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb20190-bf70-4cea-ab6d-f07e4ed8f7ef None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:31.968505 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb20190-bf70-4cea-ab6d-f07e4ed8f7ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:31.970100 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb20190-bf70-4cea-ab6d-f07e4ed8f7ef None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:32.008546 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:32.014518 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 261/513] 10.222.0.91 () {56 vars in 1133 bytes} [Tue Aug 30 04:14:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:32.015422 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb20190-bf70-4cea-ab6d-f07e4ed8f7ef None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:32.076336 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c57ab-4898-4990-9a2e-759cb5093759 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:32.130608 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b503b-caa8-4eff-83af-228d88d27e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:32.131697 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b503b-caa8-4eff-83af-228d88d27e13 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:32.132121 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b503b-caa8-4eff-83af-228d88d27e13 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:32.132483 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b503b-caa8-4eff-83af-228d88d27e13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:32.144733 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb20190-bf70-4cea-ab6d-f07e4ed8f7ef None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:32.147395 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3b503b-caa8-4eff-83af-228d88d27e13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:32.149551 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3b503b-caa8-4eff-83af-228d88d27e13 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:32.156783 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:32.170422 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-ec3b503b-caa8-4eff-83af-228d88d27e13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:32.170422 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:32.170422 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:32.170422 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:32.170422 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:32.170422 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:32.170422 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:32.170422 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:32.170422 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:32.170422 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:32.170422 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:32.170422 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:32.170422 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:14:32.170422 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:14:32.170422 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:14:32.170422 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:14:32.172748 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:32.172748 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:32.172748 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:32.172748 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:32.172748 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:32.172748 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:32.172748 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:32.172748 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:32.172748 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:32.172748 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:32.172748 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:32.172748 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:32.172748 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:32.172748 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:32.172748 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:32.172748 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:32.172748 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:14:32.174299 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:14:32.174299 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:32.174299 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:14:32.174299 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 253/514] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:14:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:32.174299 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b503b-caa8-4eff-83af-228d88d27e13 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:32.196263 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f470e68-0c79-4eba-b98e-383e6183bb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:32.197266 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f470e68-0c79-4eba-b98e-383e6183bb90 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:32.197844 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f470e68-0c79-4eba-b98e-383e6183bb90 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:32.198059 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f470e68-0c79-4eba-b98e-383e6183bb90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:32.216183 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f470e68-0c79-4eba-b98e-383e6183bb90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:32.218762 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f470e68-0c79-4eba-b98e-383e6183bb90 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:32.243844 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-7f470e68-0c79-4eba-b98e-383e6183bb90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:32.243844 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:32.243844 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:32.243844 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:32.243844 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:32.243844 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:32.243844 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:32.243844 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:32.243844 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:32.243844 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:32.243844 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:32.243844 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:32.243844 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:14:32.243844 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:14:32.243844 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:14:32.243844 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:14:32.245864 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:32.245864 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:32.245864 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:32.245864 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:32.245864 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:32.245864 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:32.245864 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:32.245864 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:32.245864 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:32.245864 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:32.245864 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:32.245864 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:32.245864 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:32.245864 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:32.245864 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:32.245864 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:32.245864 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:14:32.246859 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:14:32.246859 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:32.246859 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:14:32.246859 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 262/515] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:14:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:32.247453 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f470e68-0c79-4eba-b98e-383e6183bb90 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:32.318331 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b503b-caa8-4eff-83af-228d88d27e13 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:32.321715 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:32.373600 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8945a32d-bf1d-4483-ba34-6ba5303351af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:32.373600 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8945a32d-bf1d-4483-ba34-6ba5303351af None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:32.373600 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8945a32d-bf1d-4483-ba34-6ba5303351af None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:32.373600 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8945a32d-bf1d-4483-ba34-6ba5303351af None admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:32.376303 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8945a32d-bf1d-4483-ba34-6ba5303351af None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:32.376303 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8945a32d-bf1d-4483-ba34-6ba5303351af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:32.378683 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8945a32d-bf1d-4483-ba34-6ba5303351af None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:32.380566 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f470e68-0c79-4eba-b98e-383e6183bb90 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:32.410108 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 254/516] 10.222.0.91 () {56 vars in 1137 bytes} [Tue Aug 30 04:14:32 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:32.410986 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8945a32d-bf1d-4483-ba34-6ba5303351af None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:32.428993 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6189b9c4-25df-4154-8a8b-8113b1dd56ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:32.430062 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6189b9c4-25df-4154-8a8b-8113b1dd56ec None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:32.430695 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6189b9c4-25df-4154-8a8b-8113b1dd56ec None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:32.431158 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6189b9c4-25df-4154-8a8b-8113b1dd56ec None admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:32.432833 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6189b9c4-25df-4154-8a8b-8113b1dd56ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:32.433332 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6189b9c4-25df-4154-8a8b-8113b1dd56ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:32.435990 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6189b9c4-25df-4154-8a8b-8113b1dd56ec None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:32.469603 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 263/517] 10.222.0.91 () {56 vars in 1148 bytes} [Tue Aug 30 04:14:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:32.471098 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6189b9c4-25df-4154-8a8b-8113b1dd56ec None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:32.502589 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:32.547335 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8945a32d-bf1d-4483-ba34-6ba5303351af None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:32.587855 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1df398c-6527-4824-b198-b4e14c1e777a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:32.588599 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1df398c-6527-4824-b198-b4e14c1e777a None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:32.588866 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1df398c-6527-4824-b198-b4e14c1e777a None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:32.589122 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1df398c-6527-4824-b198-b4e14c1e777a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:32.625696 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:32.635768 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6189b9c4-25df-4154-8a8b-8113b1dd56ec None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:32.686000 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1df398c-6527-4824-b198-b4e14c1e777a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:32.687846 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1df398c-6527-4824-b198-b4e14c1e777a None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:32.699858 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79203ad-67bc-4325-98d4-f043cd883a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:32.700898 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79203ad-67bc-4325-98d4-f043cd883a72 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:32.701393 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79203ad-67bc-4325-98d4-f043cd883a72 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:32.701856 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79203ad-67bc-4325-98d4-f043cd883a72 None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:32.703041 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79203ad-67bc-4325-98d4-f043cd883a72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:32.703571 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79203ad-67bc-4325-98d4-f043cd883a72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:32.706228 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79203ad-67bc-4325-98d4-f043cd883a72 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:32.733547 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 264/518] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:14:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:32.733547 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79203ad-67bc-4325-98d4-f043cd883a72 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:32.817508 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 255/519] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 30 04:14:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:32.818512 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1df398c-6527-4824-b198-b4e14c1e777a None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:32.851427 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:32.887830 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79203ad-67bc-4325-98d4-f043cd883a72 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:32.892395 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:32.942575 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1df398c-6527-4824-b198-b4e14c1e777a None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:32.948117 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206bc9d1-bef6-4a85-8848-7d6ea777d77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:32.948994 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206bc9d1-bef6-4a85-8848-7d6ea777d77f None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:32.949148 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206bc9d1-bef6-4a85-8848-7d6ea777d77f None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:32.949497 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206bc9d1-bef6-4a85-8848-7d6ea777d77f None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:32.950241 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206bc9d1-bef6-4a85-8848-7d6ea777d77f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:32.950606 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206bc9d1-bef6-4a85-8848-7d6ea777d77f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:32.952821 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206bc9d1-bef6-4a85-8848-7d6ea777d77f None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:32.968735 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 265/520] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:14:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:32.969663 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206bc9d1-bef6-4a85-8848-7d6ea777d77f None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:32.987904 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b811c9-412e-4154-aef5-1b6d7b6fc9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:32.988647 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b811c9-412e-4154-aef5-1b6d7b6fc9db None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:32.988927 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b811c9-412e-4154-aef5-1b6d7b6fc9db None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:32.989195 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b811c9-412e-4154-aef5-1b6d7b6fc9db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:33.072431 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b811c9-412e-4154-aef5-1b6d7b6fc9db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:33.074407 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b811c9-412e-4154-aef5-1b6d7b6fc9db None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:33.124817 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206bc9d1-bef6-4a85-8848-7d6ea777d77f None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:33.160514 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:33.170961 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ed900-918d-4588-8ea3-223033640f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:33.171595 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ed900-918d-4588-8ea3-223033640f73 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:33.172011 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ed900-918d-4588-8ea3-223033640f73 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:33.172293 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ed900-918d-4588-8ea3-223033640f73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:33.173116 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649ed900-918d-4588-8ea3-223033640f73 None admin] RBAC: Adding query filter params (role.id=c3eef5523b7a407082ffaa23a9753410, scope.project.id=4e05769361674c8fa995050150ad4cfa, user.id=2af2e1344bc54bf388e5ec025ab94c2d) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:33.173496 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649ed900-918d-4588-8ea3-223033640f73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:33.175181 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649ed900-918d-4588-8ea3-223033640f73 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:33.182910 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 266/521] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 30 04:14:32 2022] GET /identity/v3/role_assignments?user.id=2af2e1344bc54bf388e5ec025ab94c2d&scope.project.id=4e05769361674c8fa995050150ad4cfa&role.id=c3eef5523b7a407082ffaa23a9753410 => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:33.184134 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ed900-918d-4588-8ea3-223033640f73 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:33.196289 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:33.233848 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 256/522] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 30 04:14:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:33.237391 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b811c9-412e-4154-aef5-1b6d7b6fc9db None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:33.388743 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ed900-918d-4588-8ea3-223033640f73 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:33.443807 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bad058b-8256-4063-876e-b45a7216173a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:33.444478 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad058b-8256-4063-876e-b45a7216173a None admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:33.444764 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad058b-8256-4063-876e-b45a7216173a None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:33.445035 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad058b-8256-4063-876e-b45a7216173a None admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:33.445712 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bad058b-8256-4063-876e-b45a7216173a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:33.447347 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bad058b-8256-4063-876e-b45a7216173a None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:33.449748 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b811c9-412e-4154-aef5-1b6d7b6fc9db None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:33.473745 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 267/523] 10.222.0.91 () {60 vars in 1132 bytes} [Tue Aug 30 04:14:33 2022] POST /identity/v3/users => generated 247 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:14:33.474684 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bad058b-8256-4063-876e-b45a7216173a None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:33.534916 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4993f49-6771-4d80-82f9-d1840379eae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:33.536478 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4993f49-6771-4d80-82f9-d1840379eae3 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:33.537046 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4993f49-6771-4d80-82f9-d1840379eae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:33.537592 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4993f49-6771-4d80-82f9-d1840379eae3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:33.564865 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4993f49-6771-4d80-82f9-d1840379eae3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:33.568114 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4993f49-6771-4d80-82f9-d1840379eae3 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:33.601552 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-b4993f49-6771-4d80-82f9-d1840379eae3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:33.601552 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:33.601552 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:33.601552 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:33.601552 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:33.601552 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:33.601552 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:33.601552 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:33.601552 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:33.601552 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:33.601552 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:33.601552 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:33.601552 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:14:33.601552 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:14:33.601552 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:14:33.601552 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:14:33.602558 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:33.602558 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:33.602558 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:33.602558 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:33.602558 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:33.602558 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:33.602558 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:33.602558 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:33.602558 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:33.602558 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:33.602558 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:33.602558 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:33.602558 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:33.602558 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:33.602558 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:33.602558 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:33.602558 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:14:33.603414 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:14:33.603414 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:33.603414 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:14:33.603671 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:33.604911 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 257/524] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:14:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:33.606334 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4993f49-6771-4d80-82f9-d1840379eae3 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:33.647565 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:33.681555 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bad058b-8256-4063-876e-b45a7216173a None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:33.739760 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993bd005-2adb-4a51-a4a1-bb7d32a55a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:33.740418 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993bd005-2adb-4a51-a4a1-bb7d32a55a23 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:33.740751 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993bd005-2adb-4a51-a4a1-bb7d32a55a23 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:33.741056 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993bd005-2adb-4a51-a4a1-bb7d32a55a23 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:33.758232 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993bd005-2adb-4a51-a4a1-bb7d32a55a23 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:33.760462 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993bd005-2adb-4a51-a4a1-bb7d32a55a23 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:33.794359 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-993bd005-2adb-4a51-a4a1-bb7d32a55a23 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 04:14:33.794359 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:33.794359 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:33.794359 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:33.794359 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:33.794359 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:33.794359 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:33.794359 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:33.794359 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:33.794359 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:33.794359 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:33.794359 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:33.794359 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:14:33.794359 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:14:33.794359 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:14:33.794359 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:14:33.796288 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:33.796288 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:33.796288 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:14:33.796288 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:14:33.796288 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:14:33.796288 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:14:33.796288 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:33.796288 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:33.796288 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:33.796288 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:33.796288 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:33.796288 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:33.796288 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:33.796288 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:33.796288 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:33.796288 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:33.796288 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:33.796288 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:33.797856 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:33.797856 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:33.797856 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:14:33.797856 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:14:33.797856 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:14:33.797856 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:14:33.797856 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:14:33.797856 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:14:33.797856 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 04:14:33.797856 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:14:33.797856 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 268/525] 10.222.0.91 () {56 vars in 1102 bytes} [Tue Aug 30 04:14:33 2022] GET /identity/v3/users/neutron => generated 85 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:33.797856 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993bd005-2adb-4a51-a4a1-bb7d32a55a23 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:33.873235 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4993f49-6771-4d80-82f9-d1840379eae3 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:33.953063 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e23bba6-2db6-4c7f-9c3c-86a96cd1ce0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:33.954297 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e23bba6-2db6-4c7f-9c3c-86a96cd1ce0e None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:33.955577 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e23bba6-2db6-4c7f-9c3c-86a96cd1ce0e None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:33.955577 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e23bba6-2db6-4c7f-9c3c-86a96cd1ce0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:33.982102 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e23bba6-2db6-4c7f-9c3c-86a96cd1ce0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:33.985156 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e23bba6-2db6-4c7f-9c3c-86a96cd1ce0e None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:34.015599 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993bd005-2adb-4a51-a4a1-bb7d32a55a23 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:34.024869 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-6e23bba6-2db6-4c7f-9c3c-86a96cd1ce0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:34.024869 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:34.024869 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:34.024869 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:34.024869 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:34.024869 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:34.024869 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:34.024869 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:34.024869 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:34.024869 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:34.024869 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:34.024869 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:34.024869 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:14:34.024869 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:14:34.024869 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:14:34.024869 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:14:34.027284 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:34.027284 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:34.027284 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:34.027284 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:34.027284 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:34.027284 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:34.027284 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:34.027284 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:34.027284 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:34.027284 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:34.027284 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:34.027284 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:34.027284 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:34.027284 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:34.027284 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:34.027284 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:34.027284 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:14:34.029139 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:14:34.029139 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:34.029139 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:14:34.039794 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 258/526] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:14:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 431 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:34.039794 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e23bba6-2db6-4c7f-9c3c-86a96cd1ce0e None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:34.069146 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:34.101862 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ca0c8-1e73-4a4c-a387-84e02d60cc8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:34.102380 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ca0c8-1e73-4a4c-a387-84e02d60cc8e None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:34.102794 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ca0c8-1e73-4a4c-a387-84e02d60cc8e None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:34.103213 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ca0c8-1e73-4a4c-a387-84e02d60cc8e None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:34.104875 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546ca0c8-1e73-4a4c-a387-84e02d60cc8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:34.105504 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546ca0c8-1e73-4a4c-a387-84e02d60cc8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:34.108230 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546ca0c8-1e73-4a4c-a387-84e02d60cc8e None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:34.135891 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 269/527] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:14:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:34.137522 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ca0c8-1e73-4a4c-a387-84e02d60cc8e None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:34.202824 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:34.291385 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ca0c8-1e73-4a4c-a387-84e02d60cc8e None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:34.301119 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e23bba6-2db6-4c7f-9c3c-86a96cd1ce0e None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:34.342004 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41421fd7-53ad-46b8-9571-8584f31248ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:34.342668 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41421fd7-53ad-46b8-9571-8584f31248ca None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:34.342946 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41421fd7-53ad-46b8-9571-8584f31248ca None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:34.343220 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41421fd7-53ad-46b8-9571-8584f31248ca None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:34.343888 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41421fd7-53ad-46b8-9571-8584f31248ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:34.344288 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41421fd7-53ad-46b8-9571-8584f31248ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:34.345849 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41421fd7-53ad-46b8-9571-8584f31248ca None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:34.364695 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 270/528] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:14:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:34.365819 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41421fd7-53ad-46b8-9571-8584f31248ca None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:34.375166 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a2f0f6-6773-4a9f-a869-32e78f0663b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:34.376595 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2f0f6-6773-4a9f-a869-32e78f0663b1 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:34.377621 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2f0f6-6773-4a9f-a869-32e78f0663b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:34.378330 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2f0f6-6773-4a9f-a869-32e78f0663b1 None admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:34.379941 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a2f0f6-6773-4a9f-a869-32e78f0663b1 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:34.380697 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a2f0f6-6773-4a9f-a869-32e78f0663b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:34.383383 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a2f0f6-6773-4a9f-a869-32e78f0663b1 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:34.428066 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 259/529] 10.222.0.91 () {56 vars in 1139 bytes} [Tue Aug 30 04:14:34 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:34.429169 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:34.431778 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a2f0f6-6773-4a9f-a869-32e78f0663b1 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:34.498351 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41421fd7-53ad-46b8-9571-8584f31248ca None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:34.542657 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cb3049-c762-47b6-8884-efedf530d232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:34.543454 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb3049-c762-47b6-8884-efedf530d232 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:34.543623 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb3049-c762-47b6-8884-efedf530d232 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:34.543928 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb3049-c762-47b6-8884-efedf530d232 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:34.552295 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cb3049-c762-47b6-8884-efedf530d232 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:34.553889 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cb3049-c762-47b6-8884-efedf530d232 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:34.568217 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-98cb3049-c762-47b6-8884-efedf530d232 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:14:34.568217 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:34.568217 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:34.568217 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:34.568217 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:34.568217 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:34.568217 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:34.568217 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:34.568217 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:34.568217 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:34.568217 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:34.568217 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:34.568217 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:14:34.568217 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:14:34.568217 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:14:34.569834 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:14:34.569834 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:34.569834 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:34.569834 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:34.569834 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:34.569834 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:34.569834 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:34.569834 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:34.569834 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:34.569834 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:34.569834 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:34.569834 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:34.569834 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:34.569834 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:34.569834 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:34.569834 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:34.569834 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:34.571411 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:14:34.571411 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:14:34.571411 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:14:34.571411 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:14:34.571411 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:14:34.571411 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:14:34.571411 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:14:34.571411 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:14:34.571411 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 271/530] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 30 04:14:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:34.576490 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cb3049-c762-47b6-8884-efedf530d232 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:34.661509 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a2f0f6-6773-4a9f-a869-32e78f0663b1 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:34.711965 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:34.723686 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:34.726734 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cb3049-c762-47b6-8884-efedf530d232 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:34.737393 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b92b3f-8c61-43a7-986c-1656f4855c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:34.738814 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b92b3f-8c61-43a7-986c-1656f4855c90 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:34.739658 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b92b3f-8c61-43a7-986c-1656f4855c90 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:34.740460 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b92b3f-8c61-43a7-986c-1656f4855c90 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:34.755034 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b92b3f-8c61-43a7-986c-1656f4855c90 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:34.758571 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b92b3f-8c61-43a7-986c-1656f4855c90 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:34.771368 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5089d16-e6bf-4f1c-b802-30b454363ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:34.772161 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5089d16-e6bf-4f1c-b802-30b454363ba4 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:34.772331 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5089d16-e6bf-4f1c-b802-30b454363ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:34.772597 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5089d16-e6bf-4f1c-b802-30b454363ba4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:34.786053 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-48b92b3f-8c61-43a7-986c-1656f4855c90 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:14:34.786053 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:34.786053 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:34.786053 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:34.786053 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:34.786053 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:34.786053 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:34.786053 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:34.786053 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:34.786053 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:34.786053 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:34.786053 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:34.786053 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:14:34.786053 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:14:34.786053 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:14:34.787667 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:14:34.787667 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:34.787667 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:34.787667 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:34.787667 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:34.787667 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:34.787667 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:34.787667 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:34.787667 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:34.787667 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:34.787667 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:34.787667 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:34.787667 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:34.787667 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:34.787667 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:34.787667 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:34.787667 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:34.789293 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:14:34.789293 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:14:34.789293 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:14:34.789293 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:14:34.789293 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:14:34.789293 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:14:34.789293 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:14:34.789293 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:14:34.794161 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 260/531] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 30 04:14:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:34.796106 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b92b3f-8c61-43a7-986c-1656f4855c90 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:34.863620 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5089d16-e6bf-4f1c-b802-30b454363ba4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:34.865221 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5089d16-e6bf-4f1c-b802-30b454363ba4 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:34.988480 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:34.999946 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 272/532] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 30 04:14:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:34.999946 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5089d16-e6bf-4f1c-b802-30b454363ba4 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:35.016994 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b92b3f-8c61-43a7-986c-1656f4855c90 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:35.085610 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a04e5ca-26da-4612-9b95-6799f0d87cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:35.087075 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04e5ca-26da-4612-9b95-6799f0d87cab None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:35.087833 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04e5ca-26da-4612-9b95-6799f0d87cab None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:35.088746 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04e5ca-26da-4612-9b95-6799f0d87cab None admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:35.090327 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a04e5ca-26da-4612-9b95-6799f0d87cab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:35.091132 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a04e5ca-26da-4612-9b95-6799f0d87cab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:35.094188 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a04e5ca-26da-4612-9b95-6799f0d87cab None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:35.118731 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5089d16-e6bf-4f1c-b802-30b454363ba4 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:35.129542 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 261/533] 10.222.0.91 () {56 vars in 1148 bytes} [Tue Aug 30 04:14:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:35.130880 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a04e5ca-26da-4612-9b95-6799f0d87cab None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:35.176743 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4fc206-cdc7-4820-be0a-e39d78ae8974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:35.178781 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4fc206-cdc7-4820-be0a-e39d78ae8974 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:35.179040 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4fc206-cdc7-4820-be0a-e39d78ae8974 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:35.179270 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4fc206-cdc7-4820-be0a-e39d78ae8974 None admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:35.180078 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4fc206-cdc7-4820-be0a-e39d78ae8974 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:35.180389 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4fc206-cdc7-4820-be0a-e39d78ae8974 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:35.182130 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4fc206-cdc7-4820-be0a-e39d78ae8974 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:35.202991 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 273/534] 10.222.0.91 () {56 vars in 1148 bytes} [Tue Aug 30 04:14:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:35.203954 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:35.204067 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4fc206-cdc7-4820-be0a-e39d78ae8974 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:35.281055 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a04e5ca-26da-4612-9b95-6799f0d87cab None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:35.290350 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:35.335016 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00edeba-06f9-4c18-9006-5dfb44e695d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:35.336863 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00edeba-06f9-4c18-9006-5dfb44e695d8 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:35.337085 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00edeba-06f9-4c18-9006-5dfb44e695d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:35.337356 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00edeba-06f9-4c18-9006-5dfb44e695d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:35.352600 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00edeba-06f9-4c18-9006-5dfb44e695d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:35.354902 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00edeba-06f9-4c18-9006-5dfb44e695d8 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:35.357808 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4fc206-cdc7-4820-be0a-e39d78ae8974 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:35.373040 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-c00edeba-06f9-4c18-9006-5dfb44e695d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:35.373040 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:35.373040 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:35.373040 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:35.373040 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:35.373040 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:35.373040 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:35.373040 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:35.373040 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:35.373040 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:35.373040 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:35.373040 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:35.373040 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:14:35.373040 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:14:35.373040 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:14:35.373040 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:14:35.374212 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:35.374212 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:35.374212 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:35.374212 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:35.374212 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:35.374212 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:35.374212 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:35.374212 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:35.374212 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:35.374212 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:35.374212 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:35.374212 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:35.374212 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:35.374212 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:35.374212 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:35.374212 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:35.374212 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:14:35.375296 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:14:35.375296 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:35.375296 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:14:35.376840 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 262/535] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:14:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:35.378027 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00edeba-06f9-4c18-9006-5dfb44e695d8 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:35.409444 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc471de9-0a01-4f0e-870b-ad178ebbd494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:35.410235 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc471de9-0a01-4f0e-870b-ad178ebbd494 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:35.410653 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc471de9-0a01-4f0e-870b-ad178ebbd494 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:35.411024 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc471de9-0a01-4f0e-870b-ad178ebbd494 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:35.411902 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc471de9-0a01-4f0e-870b-ad178ebbd494 None admin] RBAC: Adding query filter params (role.id=c3eef5523b7a407082ffaa23a9753410, scope.project.id=4e05769361674c8fa995050150ad4cfa, user.id=d806295278ae4997b5c6968aa553290c) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:35.412346 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc471de9-0a01-4f0e-870b-ad178ebbd494 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:35.414166 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc471de9-0a01-4f0e-870b-ad178ebbd494 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:35.428642 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 274/536] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 30 04:14:35 2022] GET /identity/v3/role_assignments?user.id=d806295278ae4997b5c6968aa553290c&scope.project.id=4e05769361674c8fa995050150ad4cfa&role.id=c3eef5523b7a407082ffaa23a9753410 => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:35.429597 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc471de9-0a01-4f0e-870b-ad178ebbd494 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:35.513894 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:35.522992 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00edeba-06f9-4c18-9006-5dfb44e695d8 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:35.599436 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addac82e-5a79-4a56-b17d-25db2d3f6a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:35.600336 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addac82e-5a79-4a56-b17d-25db2d3f6a7e None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:35.600728 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addac82e-5a79-4a56-b17d-25db2d3f6a7e None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:35.601100 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addac82e-5a79-4a56-b17d-25db2d3f6a7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:35.602015 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addac82e-5a79-4a56-b17d-25db2d3f6a7e None admin] RBAC: Adding query filter params (role.id=c3eef5523b7a407082ffaa23a9753410, scope.project.id=4e05769361674c8fa995050150ad4cfa, user.id=812abdd745f149e6a0166cd9040f28e8) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:35.602427 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addac82e-5a79-4a56-b17d-25db2d3f6a7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:35.605103 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addac82e-5a79-4a56-b17d-25db2d3f6a7e None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:35.612604 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 263/537] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 30 04:14:35 2022] GET /identity/v3/role_assignments?user.id=812abdd745f149e6a0166cd9040f28e8&scope.project.id=4e05769361674c8fa995050150ad4cfa&role.id=c3eef5523b7a407082ffaa23a9753410 => generated 259 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:35.627952 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad0e28-1fde-47f0-a1cf-690a877a78a2 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:35.627952 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad0e28-1fde-47f0-a1cf-690a877a78a2 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:35.627952 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad0e28-1fde-47f0-a1cf-690a877a78a2 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:35.627952 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 264/538] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:14:35 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:14:35.633372 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573b56d-9668-4054-afdb-e115a4d7c2ce None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:35.633807 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573b56d-9668-4054-afdb-e115a4d7c2ce None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:35.634201 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573b56d-9668-4054-afdb-e115a4d7c2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:35.675082 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc471de9-0a01-4f0e-870b-ad178ebbd494 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:35.685391 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-0573b56d-9668-4054-afdb-e115a4d7c2ce None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:35.686749 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-0573b56d-9668-4054-afdb-e115a4d7c2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:35.728874 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:35.763891 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ac2c5-1ab8-4daa-b7fb-8659d17d5be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:35.766682 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ac2c5-1ab8-4daa-b7fb-8659d17d5be7 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:35.769002 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ac2c5-1ab8-4daa-b7fb-8659d17d5be7 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:35.772340 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ac2c5-1ab8-4daa-b7fb-8659d17d5be7 None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:35.776384 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89ac2c5-1ab8-4daa-b7fb-8659d17d5be7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:35.786539 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89ac2c5-1ab8-4daa-b7fb-8659d17d5be7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:35.789735 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89ac2c5-1ab8-4daa-b7fb-8659d17d5be7 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:35.824729 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 275/539] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:14:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:35.833903 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ac2c5-1ab8-4daa-b7fb-8659d17d5be7 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:35.857996 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 265/540] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:14:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 04:14:35.979475 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ac2c5-1ab8-4daa-b7fb-8659d17d5be7 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:36.031334 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d732e30b-e33d-4306-9a8c-7d48d61f6c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:36.032091 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732e30b-e33d-4306-9a8c-7d48d61f6c8d None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:36.032390 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732e30b-e33d-4306-9a8c-7d48d61f6c8d None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:36.032628 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732e30b-e33d-4306-9a8c-7d48d61f6c8d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:36.045666 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d732e30b-e33d-4306-9a8c-7d48d61f6c8d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:36.047388 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d732e30b-e33d-4306-9a8c-7d48d61f6c8d None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:36.061770 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-d732e30b-e33d-4306-9a8c-7d48d61f6c8d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:14:36.061770 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:36.061770 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:36.061770 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:36.061770 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:36.061770 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:36.061770 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:36.061770 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:36.061770 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:36.061770 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:36.061770 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:36.061770 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:36.061770 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:14:36.061770 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:14:36.061770 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:14:36.063373 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:14:36.063373 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:36.063373 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:36.063373 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:36.063373 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:36.063373 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:36.063373 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:36.063373 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:36.063373 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:36.063373 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:36.063373 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:36.063373 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:36.063373 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:36.063373 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:36.063373 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:36.063373 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:36.063373 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:36.067141 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:14:36.067141 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:14:36.067141 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:14:36.067141 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:14:36.067141 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:14:36.067141 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:14:36.067141 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:14:36.067141 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:14:36.067141 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 276/541] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 30 04:14:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:36.075975 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0573b56d-9668-4054-afdb-e115a4d7c2ce None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:36.248483 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:36.260081 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0573b56d-9668-4054-afdb-e115a4d7c2ce None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:36.323378 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed722fab-d53a-4a8b-a2dc-f2682724929f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:36.324269 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed722fab-d53a-4a8b-a2dc-f2682724929f None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:36.324551 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed722fab-d53a-4a8b-a2dc-f2682724929f None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:36.324821 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed722fab-d53a-4a8b-a2dc-f2682724929f None admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:36.325548 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed722fab-d53a-4a8b-a2dc-f2682724929f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:36.325849 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed722fab-d53a-4a8b-a2dc-f2682724929f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:36.327352 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed722fab-d53a-4a8b-a2dc-f2682724929f None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:36.346047 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 266/542] 10.222.0.91 () {56 vars in 1148 bytes} [Tue Aug 30 04:14:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:36.353088 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d732e30b-e33d-4306-9a8c-7d48d61f6c8d None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:36.408241 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:36.422467 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18327ec8-6b57-4ea8-ad65-7708083e334b None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:36.422810 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18327ec8-6b57-4ea8-ad65-7708083e334b None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:36.423024 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18327ec8-6b57-4ea8-ad65-7708083e334b None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:36.424798 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 267/543] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:14:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:14:36.431119 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822b3a8-03bc-46a0-9e9c-242d674752d9 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:36.431433 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822b3a8-03bc-46a0-9e9c-242d674752d9 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:36.431703 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822b3a8-03bc-46a0-9e9c-242d674752d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:36.454117 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-8822b3a8-03bc-46a0-9e9c-242d674752d9 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:36.455361 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-8822b3a8-03bc-46a0-9e9c-242d674752d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:36.505994 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d732e30b-e33d-4306-9a8c-7d48d61f6c8d None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:36.548039 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 268/544] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:14:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:14:36.549236 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8822b3a8-03bc-46a0-9e9c-242d674752d9 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:36.572570 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7532c1fe-681d-44c3-b8ce-f99255f7d92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:36.573583 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532c1fe-681d-44c3-b8ce-f99255f7d92b None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:36.574052 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532c1fe-681d-44c3-b8ce-f99255f7d92b None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:36.574502 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532c1fe-681d-44c3-b8ce-f99255f7d92b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:36.575867 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7532c1fe-681d-44c3-b8ce-f99255f7d92b None admin] RBAC: Adding query filter params (role.id=c3eef5523b7a407082ffaa23a9753410, scope.project.id=4e05769361674c8fa995050150ad4cfa, user.id=1c05f49ae42b4f9583ff10b2cfce52a1) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:36.576445 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7532c1fe-681d-44c3-b8ce-f99255f7d92b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:36.579260 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7532c1fe-681d-44c3-b8ce-f99255f7d92b None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:36.592363 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 277/545] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 30 04:14:36 2022] GET /identity/v3/role_assignments?user.id=1c05f49ae42b4f9583ff10b2cfce52a1&scope.project.id=4e05769361674c8fa995050150ad4cfa&role.id=c3eef5523b7a407082ffaa23a9753410 => generated 259 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:14:36.733063 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:36.765134 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8822b3a8-03bc-46a0-9e9c-242d674752d9 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:36.818531 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30be547-14fb-4438-b164-56561f760880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:36.819599 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30be547-14fb-4438-b164-56561f760880 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:36.820110 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30be547-14fb-4438-b164-56561f760880 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:36.820583 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30be547-14fb-4438-b164-56561f760880 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:36.841197 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30be547-14fb-4438-b164-56561f760880 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:14:36.846889 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-b30be547-14fb-4438-b164-56561f760880 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:14:36.846889 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:36.846889 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:36.846889 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:36.846889 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:36.846889 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:36.846889 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:36.846889 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:36.846889 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:36.846889 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:36.846889 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:36.846889 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:36.846889 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:14:36.846889 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:14:36.846889 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:14:36.846889 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:14:36.847860 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:14:36.847860 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:14:36.847860 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:14:36.847860 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:14:36.847860 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:36.847860 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:36.847860 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:36.847860 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:36.847860 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:36.847860 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:36.847860 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:36.847860 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:36.847860 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:36.847860 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:36.847860 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:36.847860 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:36.848712 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:36.848712 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:36.848712 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:36.848712 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:36.848712 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:14:36.848712 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:14:36.848712 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:14:36.848712 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:14:36.848712 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:14:36.848712 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:14:36.848712 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:14:36.848712 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:14:36.851154 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 269/546] 10.222.0.91 () {56 vars in 1102 bytes} [Tue Aug 30 04:14:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:36.861021 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7532c1fe-681d-44c3-b8ce-f99255f7d92b None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:36.894280 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30be547-14fb-4438-b164-56561f760880 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:37.030234 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30be547-14fb-4438-b164-56561f760880 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:37.075561 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d4a12-2576-4d28-b7cd-e61d728fc361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:37.076766 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d4a12-2576-4d28-b7cd-e61d728fc361 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:37.077254 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d4a12-2576-4d28-b7cd-e61d728fc361 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:37.077725 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d4a12-2576-4d28-b7cd-e61d728fc361 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:37.092232 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3d4a12-2576-4d28-b7cd-e61d728fc361 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:14:37.098801 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-1c3d4a12-2576-4d28-b7cd-e61d728fc361 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:14:37.098801 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:37.098801 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:37.098801 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:37.098801 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:37.098801 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:37.098801 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:37.098801 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:37.098801 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:37.098801 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:37.098801 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:37.098801 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:37.098801 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:14:37.098801 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:14:37.098801 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:14:37.098801 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:14:37.099797 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:14:37.099797 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:14:37.099797 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:14:37.099797 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:14:37.099797 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:37.099797 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:37.099797 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:37.099797 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:37.099797 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:37.099797 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:37.099797 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:37.099797 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:37.099797 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:37.099797 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:37.099797 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:37.099797 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:37.100652 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:37.100652 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:37.100652 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:37.100652 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:37.100652 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:14:37.100652 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:14:37.100652 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:14:37.100652 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:14:37.100652 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:14:37.100652 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:14:37.100652 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:14:37.100652 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:14:37.103806 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 270/547] 10.222.0.91 () {56 vars in 1102 bytes} [Tue Aug 30 04:14:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:37.108604 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:37.113290 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d4a12-2576-4d28-b7cd-e61d728fc361 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:37.161136 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7532c1fe-681d-44c3-b8ce-f99255f7d92b None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:37.186859 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:37.251190 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d4a12-2576-4d28-b7cd-e61d728fc361 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:37.274131 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001ed4d3-c2f4-4383-8d52-447e7276d57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:37.274776 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ed4d3-c2f4-4383-8d52-447e7276d57f None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:37.275066 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ed4d3-c2f4-4383-8d52-447e7276d57f None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:37.275351 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ed4d3-c2f4-4383-8d52-447e7276d57f None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:37.276441 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001ed4d3-c2f4-4383-8d52-447e7276d57f None admin] RBAC: Adding query filter params (name=service) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:37.277193 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001ed4d3-c2f4-4383-8d52-447e7276d57f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:37.278462 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001ed4d3-c2f4-4383-8d52-447e7276d57f None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:37.305832 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 278/548] 10.222.0.91 () {56 vars in 1103 bytes} [Tue Aug 30 04:14:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 441 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:37.307994 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59400d10-510e-4ff4-88a4-29078e98a1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:37.309032 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001ed4d3-c2f4-4383-8d52-447e7276d57f None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:37.309171 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59400d10-510e-4ff4-88a4-29078e98a1e2 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:37.309685 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59400d10-510e-4ff4-88a4-29078e98a1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:37.310171 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59400d10-510e-4ff4-88a4-29078e98a1e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:37.311374 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59400d10-510e-4ff4-88a4-29078e98a1e2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:37.312315 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59400d10-510e-4ff4-88a4-29078e98a1e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:37.314267 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59400d10-510e-4ff4-88a4-29078e98a1e2 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:37.328201 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 271/549] 10.222.0.91 () {56 vars in 1103 bytes} [Tue Aug 30 04:14:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:14:37.336986 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59400d10-510e-4ff4-88a4-29078e98a1e2 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:37.436589 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:37.485206 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59400d10-510e-4ff4-88a4-29078e98a1e2 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:37.528617 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d935d65-1ae4-485c-ac1d-729326537863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:37.529882 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d935d65-1ae4-485c-ac1d-729326537863 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:37.530368 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d935d65-1ae4-485c-ac1d-729326537863 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:37.530841 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d935d65-1ae4-485c-ac1d-729326537863 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:37.544929 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d935d65-1ae4-485c-ac1d-729326537863 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:37.546902 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d935d65-1ae4-485c-ac1d-729326537863 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:37.565036 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-9d935d65-1ae4-485c-ac1d-729326537863 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:37.565036 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:37.565036 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:37.565036 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:37.565036 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:37.565036 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:37.565036 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:37.565036 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:37.565036 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:37.565036 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:37.565036 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:37.565036 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:37.565036 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:14:37.565036 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:14:37.565036 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:14:37.565036 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:14:37.566158 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:37.566158 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:37.566158 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:37.566158 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:37.566158 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:37.566158 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:37.566158 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:37.566158 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:37.566158 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:37.566158 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:37.566158 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:37.566158 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:37.566158 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:37.566158 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:37.566158 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:37.566158 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:37.566158 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:14:37.567042 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:14:37.567042 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:37.567042 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:14:37.569524 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 272/550] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:14:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:37.576900 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d935d65-1ae4-485c-ac1d-729326537863 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:37.601151 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001ed4d3-c2f4-4383-8d52-447e7276d57f None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:37.721142 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d935d65-1ae4-485c-ac1d-729326537863 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:37.729432 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf59b84-88dd-4bc2-8f0a-72368607e9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:37.730337 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf59b84-88dd-4bc2-8f0a-72368607e9af None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:37.730791 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf59b84-88dd-4bc2-8f0a-72368607e9af None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:37.731241 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf59b84-88dd-4bc2-8f0a-72368607e9af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:37.742012 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:37.764766 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf59b84-88dd-4bc2-8f0a-72368607e9af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:37.767518 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf59b84-88dd-4bc2-8f0a-72368607e9af None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:37.768166 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac0944a-bcf1-468b-b704-6f3f956eb984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:37.769142 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0944a-bcf1-468b-b704-6f3f956eb984 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:37.769622 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0944a-bcf1-468b-b704-6f3f956eb984 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:37.770092 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0944a-bcf1-468b-b704-6f3f956eb984 None admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:37.770989 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac0944a-bcf1-468b-b704-6f3f956eb984 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:37.771563 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac0944a-bcf1-468b-b704-6f3f956eb984 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:37.773315 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac0944a-bcf1-468b-b704-6f3f956eb984 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:37.789376 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 273/551] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:14:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:37.796965 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac0944a-bcf1-468b-b704-6f3f956eb984 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:37.830107 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-6bf59b84-88dd-4bc2-8f0a-72368607e9af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:37.830107 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:37.830107 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:37.830107 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:37.830107 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:37.830107 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:37.830107 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:37.830107 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:37.830107 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:37.830107 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:37.830107 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:37.830107 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:37.830107 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:14:37.830107 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:14:37.830107 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:14:37.830107 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:14:37.831100 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:37.831100 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:37.831100 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:37.831100 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:37.831100 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:37.831100 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:37.831100 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:37.831100 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:37.831100 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:37.831100 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:37.831100 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:37.831100 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:37.831100 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:37.831100 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:37.831100 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:37.831100 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:37.831100 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:14:37.832041 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:14:37.832041 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:37.832041 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:14:37.840207 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 279/552] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:14:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 524 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:37.845811 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf59b84-88dd-4bc2-8f0a-72368607e9af None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:37.926115 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:37.937737 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac0944a-bcf1-468b-b704-6f3f956eb984 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:37.981211 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542faaeb-1c92-4f15-8aaf-31666ba16371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:37.982500 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542faaeb-1c92-4f15-8aaf-31666ba16371 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:37.983148 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542faaeb-1c92-4f15-8aaf-31666ba16371 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:37.983633 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542faaeb-1c92-4f15-8aaf-31666ba16371 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:37.993383 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542faaeb-1c92-4f15-8aaf-31666ba16371 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:37.996312 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542faaeb-1c92-4f15-8aaf-31666ba16371 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:38.011316 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-542faaeb-1c92-4f15-8aaf-31666ba16371 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 04:14:38.011316 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:38.011316 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:38.011316 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:38.011316 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:38.011316 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:38.011316 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:38.011316 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:38.011316 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:38.011316 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:38.011316 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:38.011316 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:38.011316 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:14:38.011316 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:14:38.011316 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:14:38.011316 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:14:38.012375 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:38.012375 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:38.012375 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:14:38.012375 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:14:38.012375 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:14:38.012375 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:14:38.012375 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:38.012375 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:38.012375 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:38.012375 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:38.012375 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:38.012375 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:38.012375 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:38.012375 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:38.012375 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:38.012375 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:38.012375 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:38.012375 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:38.013417 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:38.013417 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:38.013417 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:14:38.013417 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:14:38.013417 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:14:38.013417 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:14:38.013417 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:14:38.013417 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:14:38.013417 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 04:14:38.013417 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:14:38.020167 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 274/553] 10.222.0.91 () {56 vars in 1096 bytes} [Tue Aug 30 04:14:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:14:38.022623 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542faaeb-1c92-4f15-8aaf-31666ba16371 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:38.066206 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:38.111649 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf59b84-88dd-4bc2-8f0a-72368607e9af None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:38.196912 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f276fc1-cba1-4e0e-8d09-6a3477cae5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:38.199028 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f276fc1-cba1-4e0e-8d09-6a3477cae5cb None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:38.203665 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f276fc1-cba1-4e0e-8d09-6a3477cae5cb None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:38.204330 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f276fc1-cba1-4e0e-8d09-6a3477cae5cb None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:38.205263 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f276fc1-cba1-4e0e-8d09-6a3477cae5cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:38.205784 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f276fc1-cba1-4e0e-8d09-6a3477cae5cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:38.207466 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f276fc1-cba1-4e0e-8d09-6a3477cae5cb None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:38.232983 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542faaeb-1c92-4f15-8aaf-31666ba16371 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:38.242153 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 280/554] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:14:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:38.251174 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f276fc1-cba1-4e0e-8d09-6a3477cae5cb None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:38.314323 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4159f66-a860-44a8-866f-88bdaa1ded88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:38.315435 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4159f66-a860-44a8-866f-88bdaa1ded88 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:38.316058 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4159f66-a860-44a8-866f-88bdaa1ded88 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:38.316566 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4159f66-a860-44a8-866f-88bdaa1ded88 None admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:38.317630 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4159f66-a860-44a8-866f-88bdaa1ded88 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:38.318168 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4159f66-a860-44a8-866f-88bdaa1ded88 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:38.320287 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4159f66-a860-44a8-866f-88bdaa1ded88 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:38.344434 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 275/555] 10.222.0.91 () {56 vars in 1135 bytes} [Tue Aug 30 04:14:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:38.346135 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e538b-b9d2-4f08-9154-4c8f9fc82658 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:38.346707 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e538b-b9d2-4f08-9154-4c8f9fc82658 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:38.347245 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e538b-b9d2-4f08-9154-4c8f9fc82658 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:38.349562 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 276/556] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:14:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:14:38.350914 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e538b-b9d2-4f08-9154-4c8f9fc82658 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:38.380530 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:38.402752 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f276fc1-cba1-4e0e-8d09-6a3477cae5cb None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:38.445434 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b082d706-2c0b-42ac-bd98-dc791aaf09b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:38.446121 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082d706-2c0b-42ac-bd98-dc791aaf09b6 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:38.446646 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082d706-2c0b-42ac-bd98-dc791aaf09b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:38.447114 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082d706-2c0b-42ac-bd98-dc791aaf09b6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:38.456606 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b082d706-2c0b-42ac-bd98-dc791aaf09b6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:38.458484 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b082d706-2c0b-42ac-bd98-dc791aaf09b6 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:38.472444 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-b082d706-2c0b-42ac-bd98-dc791aaf09b6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 30 04:14:38.472444 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:38.472444 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:38.472444 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:38.472444 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:38.472444 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:38.472444 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:38.472444 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:38.472444 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:38.472444 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:38.472444 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:38.472444 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:38.472444 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:14:38.472444 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:14:38.472444 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:14:38.472444 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:14:38.473935 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:38.473935 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:38.473935 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:14:38.473935 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:14:38.473935 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:14:38.473935 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:14:38.473935 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:38.473935 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:38.473935 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:38.473935 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:38.473935 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:38.473935 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:38.473935 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:38.473935 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:38.473935 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:38.473935 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:38.473935 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:38.473935 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:38.474872 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:38.474872 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:38.474872 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:14:38.474872 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:14:38.474872 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:14:38.474872 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:14:38.474872 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:14:38.474872 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:14:38.474872 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 30 04:14:38.474872 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:14:38.476009 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 281/557] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 30 04:14:38 2022] GET /identity/v3/users/glance => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:38.477593 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a84e9d-b620-4bf6-bad6-035759a62264 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:38.477894 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a84e9d-b620-4bf6-bad6-035759a62264 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:38.478163 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a84e9d-b620-4bf6-bad6-035759a62264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:38.480836 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:38.495658 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e538b-b9d2-4f08-9154-4c8f9fc82658 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:38.511412 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-f1a84e9d-b620-4bf6-bad6-035759a62264 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:38.513590 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-f1a84e9d-b620-4bf6-bad6-035759a62264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:38.539766 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382fb70f-82ae-49a9-9d8d-faf6a89d9f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:38.540427 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382fb70f-82ae-49a9-9d8d-faf6a89d9f52 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:38.540707 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382fb70f-82ae-49a9-9d8d-faf6a89d9f52 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:38.540983 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382fb70f-82ae-49a9-9d8d-faf6a89d9f52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:38.633174 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382fb70f-82ae-49a9-9d8d-faf6a89d9f52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:38.635008 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382fb70f-82ae-49a9-9d8d-faf6a89d9f52 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:38.639537 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 282/558] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:14:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:14:38.641429 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e05537-6c2a-4e39-96b8-73ff37139713 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:38.641429 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e05537-6c2a-4e39-96b8-73ff37139713 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:38.641429 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e05537-6c2a-4e39-96b8-73ff37139713 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:38.643026 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 283/559] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:14:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:14:38.643797 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e05537-6c2a-4e39-96b8-73ff37139713 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:38.800705 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:38.842055 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:38.859967 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 277/560] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 30 04:14:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:38.862362 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e164f94-f957-4691-b912-9c73b4a24cd6 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:38.863016 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e164f94-f957-4691-b912-9c73b4a24cd6 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:38.863682 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e164f94-f957-4691-b912-9c73b4a24cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:38.868750 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e05537-6c2a-4e39-96b8-73ff37139713 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:38.897495 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-0e164f94-f957-4691-b912-9c73b4a24cd6 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:38.899550 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-0e164f94-f957-4691-b912-9c73b4a24cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:38.947437 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f341a8-6795-441d-aeac-2ce400d923a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:38.948573 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f341a8-6795-441d-aeac-2ce400d923a9 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:38.948993 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f341a8-6795-441d-aeac-2ce400d923a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:38.949450 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f341a8-6795-441d-aeac-2ce400d923a9 None admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:38.950775 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f341a8-6795-441d-aeac-2ce400d923a9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:38.951342 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f341a8-6795-441d-aeac-2ce400d923a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:38.954119 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f341a8-6795-441d-aeac-2ce400d923a9 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:38.988157 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 284/561] 10.222.0.91 () {56 vars in 1137 bytes} [Tue Aug 30 04:14:38 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:38.989814 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f341a8-6795-441d-aeac-2ce400d923a9 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:38.994409 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 278/562] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:14:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:14:38.995798 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e164f94-f957-4691-b912-9c73b4a24cd6 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:39.138084 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e164f94-f957-4691-b912-9c73b4a24cd6 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:39.175238 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:39.199652 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6337cd19-6d6d-4fd7-9d76-efe1f39aa3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:39.200768 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337cd19-6d6d-4fd7-9d76-efe1f39aa3a7 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:39.201261 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337cd19-6d6d-4fd7-9d76-efe1f39aa3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:39.201763 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337cd19-6d6d-4fd7-9d76-efe1f39aa3a7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:39.211956 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f341a8-6795-441d-aeac-2ce400d923a9 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:39.216978 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6337cd19-6d6d-4fd7-9d76-efe1f39aa3a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:14:39.222560 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-6337cd19-6d6d-4fd7-9d76-efe1f39aa3a7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:14:39.222560 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:39.222560 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:39.222560 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:39.222560 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:39.222560 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:39.222560 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:39.222560 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:39.222560 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:39.222560 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:39.222560 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:39.222560 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:39.222560 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:14:39.222560 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:14:39.222560 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:14:39.222560 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:14:39.223619 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:14:39.223619 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:14:39.223619 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:14:39.223619 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:14:39.223619 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:39.223619 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:39.223619 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:39.223619 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:39.223619 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:39.223619 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:39.223619 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:39.223619 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:39.223619 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:39.223619 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:39.223619 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:39.223619 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:39.224582 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:39.224582 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:39.224582 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:39.224582 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:39.224582 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:14:39.224582 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:14:39.224582 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:14:39.224582 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:14:39.224582 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:14:39.224582 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:14:39.224582 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:14:39.224582 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:14:39.227497 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 279/563] 10.222.0.91 () {56 vars in 1102 bytes} [Tue Aug 30 04:14:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:39.228888 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6337cd19-6d6d-4fd7-9d76-efe1f39aa3a7 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:39.288669 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:39.305878 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69747c9e-65ce-4c43-bd81-a96fa79c6a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:39.307357 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69747c9e-65ce-4c43-bd81-a96fa79c6a14 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:39.308573 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69747c9e-65ce-4c43-bd81-a96fa79c6a14 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:39.309060 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69747c9e-65ce-4c43-bd81-a96fa79c6a14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:39.337223 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69747c9e-65ce-4c43-bd81-a96fa79c6a14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:39.340884 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69747c9e-65ce-4c43-bd81-a96fa79c6a14 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:39.369436 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6337cd19-6d6d-4fd7-9d76-efe1f39aa3a7 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:39.377916 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-69747c9e-65ce-4c43-bd81-a96fa79c6a14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:39.377916 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:39.377916 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:39.377916 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:39.377916 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:39.377916 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:39.377916 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:39.377916 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:39.377916 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:39.377916 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:39.377916 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:39.377916 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:39.377916 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:14:39.377916 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:14:39.377916 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:14:39.377916 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:14:39.378950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:39.378950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:39.378950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:39.378950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:39.378950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:39.378950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:39.378950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:39.378950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:39.378950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:39.378950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:39.378950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:39.378950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:39.378950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:39.378950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:39.378950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:39.378950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:39.378950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:14:39.379864 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:14:39.379864 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:39.379864 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:14:39.380493 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 285/564] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:14:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 391 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:39.381911 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69747c9e-65ce-4c43-bd81-a96fa79c6a14 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:39.442097 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5991757-e573-4b1c-84cf-932115e0fcf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:39.443059 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5991757-e573-4b1c-84cf-932115e0fcf6 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:39.443516 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5991757-e573-4b1c-84cf-932115e0fcf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:39.443981 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5991757-e573-4b1c-84cf-932115e0fcf6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:39.472785 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5991757-e573-4b1c-84cf-932115e0fcf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:39.474298 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5991757-e573-4b1c-84cf-932115e0fcf6 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:39.508493 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-b5991757-e573-4b1c-84cf-932115e0fcf6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:39.508493 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:39.508493 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:39.508493 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:39.508493 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:39.508493 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:39.508493 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:39.508493 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:39.508493 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:39.508493 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:39.508493 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:39.508493 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:39.508493 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:14:39.508493 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:14:39.508493 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:14:39.508493 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:14:39.510121 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:39.510121 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:39.510121 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:39.510121 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:39.510121 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:39.510121 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:39.510121 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:39.510121 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:39.510121 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:39.510121 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:39.510121 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:39.510121 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:39.510121 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:39.510121 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:39.510121 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:39.510121 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:39.510121 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:14:39.511286 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:14:39.511286 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:39.511286 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:14:39.511286 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 280/565] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:14:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:39.512522 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5991757-e573-4b1c-84cf-932115e0fcf6 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:39.549288 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69747c9e-65ce-4c43-bd81-a96fa79c6a14 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:39.556910 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:39.602870 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ea88a9-5fac-45b3-a183-7e3e231ad026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:39.603536 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea88a9-5fac-45b3-a183-7e3e231ad026 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:39.603937 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea88a9-5fac-45b3-a183-7e3e231ad026 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:39.604363 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea88a9-5fac-45b3-a183-7e3e231ad026 None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:39.605349 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ea88a9-5fac-45b3-a183-7e3e231ad026 None admin] RBAC: Adding query filter params (name=service) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:39.605658 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ea88a9-5fac-45b3-a183-7e3e231ad026 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:39.607110 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ea88a9-5fac-45b3-a183-7e3e231ad026 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:39.622378 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 286/566] 10.222.0.91 () {56 vars in 1103 bytes} [Tue Aug 30 04:14:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:39.622378 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ea88a9-5fac-45b3-a183-7e3e231ad026 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:39.660626 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5991757-e573-4b1c-84cf-932115e0fcf6 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:39.683211 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:39.705805 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac6051b-58bc-4f7a-a1b9-3cbec4b303f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:39.706445 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6051b-58bc-4f7a-a1b9-3cbec4b303f1 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:39.706815 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6051b-58bc-4f7a-a1b9-3cbec4b303f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:39.707095 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6051b-58bc-4f7a-a1b9-3cbec4b303f1 None admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:39.707774 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac6051b-58bc-4f7a-a1b9-3cbec4b303f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:39.708114 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac6051b-58bc-4f7a-a1b9-3cbec4b303f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:39.709550 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac6051b-58bc-4f7a-a1b9-3cbec4b303f1 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:39.724192 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 281/567] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:14:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:39.725112 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac6051b-58bc-4f7a-a1b9-3cbec4b303f1 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:39.762355 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ea88a9-5fac-45b3-a183-7e3e231ad026 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:39.806276 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708907a6-f36c-41a7-a94d-ccf1b7ca094c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:39.807408 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708907a6-f36c-41a7-a94d-ccf1b7ca094c None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:39.808078 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708907a6-f36c-41a7-a94d-ccf1b7ca094c None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:39.808539 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708907a6-f36c-41a7-a94d-ccf1b7ca094c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:39.825883 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708907a6-f36c-41a7-a94d-ccf1b7ca094c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:14:39.832443 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-708907a6-f36c-41a7-a94d-ccf1b7ca094c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:14:39.832443 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:39.832443 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:39.832443 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:39.832443 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:39.832443 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:39.832443 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:39.832443 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:39.832443 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:39.832443 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:39.832443 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:39.832443 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:39.832443 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:14:39.832443 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:14:39.832443 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:14:39.832443 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:14:39.834294 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:14:39.834294 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:14:39.834294 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:14:39.834294 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:14:39.834294 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:39.834294 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:39.834294 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:39.834294 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:39.834294 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:39.834294 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:39.834294 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:39.834294 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:39.834294 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:39.834294 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:39.834294 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:39.834294 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:39.835834 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:39.835834 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:39.835834 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:39.835834 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:39.835834 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:14:39.835834 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:14:39.835834 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:14:39.835834 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:14:39.835834 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:14:39.835834 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:14:39.835834 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:14:39.835834 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:14:39.835834 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 287/568] 10.222.0.91 () {56 vars in 1102 bytes} [Tue Aug 30 04:14:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:39.835834 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708907a6-f36c-41a7-a94d-ccf1b7ca094c None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:39.851496 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:39.860625 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac6051b-58bc-4f7a-a1b9-3cbec4b303f1 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:39.899393 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c38372c-a6c9-4bfb-af96-aacd84a6202b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:39.900043 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38372c-a6c9-4bfb-af96-aacd84a6202b None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:39.900320 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38372c-a6c9-4bfb-af96-aacd84a6202b None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:39.900822 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38372c-a6c9-4bfb-af96-aacd84a6202b None admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:39.901490 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c38372c-a6c9-4bfb-af96-aacd84a6202b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:39.901791 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c38372c-a6c9-4bfb-af96-aacd84a6202b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:39.903301 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c38372c-a6c9-4bfb-af96-aacd84a6202b None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:39.916017 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 282/569] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:14:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:39.916984 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c38372c-a6c9-4bfb-af96-aacd84a6202b None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:39.961993 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708907a6-f36c-41a7-a94d-ccf1b7ca094c None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:39.965377 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:40.007130 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7ca17a-3fb3-4a2c-879a-b1d6ab0e51cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:40.008040 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ca17a-3fb3-4a2c-879a-b1d6ab0e51cb None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:40.008383 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ca17a-3fb3-4a2c-879a-b1d6ab0e51cb None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:40.008720 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ca17a-3fb3-4a2c-879a-b1d6ab0e51cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:40.022504 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7ca17a-3fb3-4a2c-879a-b1d6ab0e51cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:40.025236 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7ca17a-3fb3-4a2c-879a-b1d6ab0e51cb None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:40.050408 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-cf7ca17a-3fb3-4a2c-879a-b1d6ab0e51cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:40.050408 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:40.050408 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:40.050408 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:40.050408 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:40.050408 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:40.050408 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:40.050408 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:40.050408 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:40.050408 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:40.050408 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:40.050408 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:40.050408 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:14:40.050408 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:14:40.050408 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:14:40.050408 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:14:40.051516 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:40.051516 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:40.051516 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:40.051516 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:40.051516 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:40.051516 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:40.051516 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:40.051516 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:40.051516 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:40.051516 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:40.051516 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:40.051516 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:40.051516 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:40.051516 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:40.051516 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:40.051516 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:40.051516 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:14:40.052825 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:14:40.052825 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:40.052825 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:14:40.053129 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c38372c-a6c9-4bfb-af96-aacd84a6202b None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:40.053252 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 288/570] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:14:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:40.054532 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fcbafc-fabc-4edc-8fd7-6e1a3a712b78 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:40.054983 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fcbafc-fabc-4edc-8fd7-6e1a3a712b78 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:40.056574 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fcbafc-fabc-4edc-8fd7-6e1a3a712b78 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:40.057875 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 289/571] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:14:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:14:40.059762 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fcbafc-fabc-4edc-8fd7-6e1a3a712b78 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:40.113691 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1847a996-7ea3-454a-8caa-e41135b150ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:40.114466 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847a996-7ea3-454a-8caa-e41135b150ea None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:40.114834 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847a996-7ea3-454a-8caa-e41135b150ea None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:40.115198 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847a996-7ea3-454a-8caa-e41135b150ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:40.124215 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1847a996-7ea3-454a-8caa-e41135b150ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:40.125944 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1847a996-7ea3-454a-8caa-e41135b150ea None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:40.143066 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-1847a996-7ea3-454a-8caa-e41135b150ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:14:40.143066 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:40.143066 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:40.143066 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:40.143066 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:40.143066 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:40.143066 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:40.143066 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:40.143066 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:40.143066 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:40.143066 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:40.143066 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:40.143066 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:14:40.143066 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:14:40.143066 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:14:40.145011 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:14:40.145011 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:40.145011 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:40.145011 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:40.145011 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:40.145011 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:40.145011 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:40.145011 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:40.145011 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:40.145011 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:40.145011 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:40.145011 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:40.145011 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:40.145011 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:40.145011 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:40.145011 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:40.145011 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:40.147001 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:14:40.147001 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:14:40.147001 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:14:40.147001 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:14:40.147001 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:14:40.147001 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:14:40.147001 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:14:40.147001 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:14:40.147001 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 283/572] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 30 04:14:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:40.147001 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1847a996-7ea3-454a-8caa-e41135b150ea None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:40.167414 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:40.205206 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fcbafc-fabc-4edc-8fd7-6e1a3a712b78 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:40.255563 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b137073-e1d2-4fb6-851e-3177fd9fef87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:40.256422 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b137073-e1d2-4fb6-851e-3177fd9fef87 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:40.256763 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b137073-e1d2-4fb6-851e-3177fd9fef87 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:40.257103 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b137073-e1d2-4fb6-851e-3177fd9fef87 None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:40.257997 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b137073-e1d2-4fb6-851e-3177fd9fef87 None admin] RBAC: Adding query filter params (name=service) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:40.258381 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b137073-e1d2-4fb6-851e-3177fd9fef87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:40.260634 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b137073-e1d2-4fb6-851e-3177fd9fef87 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:40.278108 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 290/573] 10.222.0.91 () {56 vars in 1103 bytes} [Tue Aug 30 04:14:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:40.278108 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b137073-e1d2-4fb6-851e-3177fd9fef87 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:40.299417 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:40.309596 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1847a996-7ea3-454a-8caa-e41135b150ea None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:40.355639 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e131e89d-5792-453a-b8ff-c67f8ba5d85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:40.360855 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e131e89d-5792-453a-b8ff-c67f8ba5d85f None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:40.361241 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e131e89d-5792-453a-b8ff-c67f8ba5d85f None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:40.361520 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e131e89d-5792-453a-b8ff-c67f8ba5d85f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:40.371492 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e131e89d-5792-453a-b8ff-c67f8ba5d85f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:40.373055 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e131e89d-5792-453a-b8ff-c67f8ba5d85f None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:40.387875 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-e131e89d-5792-453a-b8ff-c67f8ba5d85f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:14:40.387875 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:40.387875 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:40.387875 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:40.387875 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:40.387875 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:40.387875 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:40.387875 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:40.387875 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:40.387875 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:40.387875 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:40.387875 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:40.387875 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:14:40.387875 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:14:40.387875 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:14:40.389460 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:14:40.389460 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:40.389460 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:40.389460 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:40.389460 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:40.389460 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:40.389460 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:40.389460 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:40.389460 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:40.389460 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:40.389460 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:40.389460 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:40.389460 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:40.389460 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:40.389460 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:40.389460 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:40.389460 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:40.391325 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:14:40.391325 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:14:40.391325 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:14:40.391325 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:14:40.391325 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:14:40.391325 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:14:40.391325 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:14:40.391325 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:14:40.391325 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 284/574] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 30 04:14:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:40.394767 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a3101-55b1-4ae9-922f-3f56010d8e7e None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:40.394767 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a3101-55b1-4ae9-922f-3f56010d8e7e None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:40.395318 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a3101-55b1-4ae9-922f-3f56010d8e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:40.418988 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-3a6a3101-55b1-4ae9-922f-3f56010d8e7e None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:40.420259 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-3a6a3101-55b1-4ae9-922f-3f56010d8e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:40.450700 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b137073-e1d2-4fb6-851e-3177fd9fef87 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:40.497868 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 285/575] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:14:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:14:40.498768 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a3101-55b1-4ae9-922f-3f56010d8e7e None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:40.502866 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:40.517523 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa99ebb1-b06f-428a-a6cc-9c5c2821c534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:40.518374 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99ebb1-b06f-428a-a6cc-9c5c2821c534 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:40.518812 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99ebb1-b06f-428a-a6cc-9c5c2821c534 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:40.519270 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99ebb1-b06f-428a-a6cc-9c5c2821c534 None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:40.520188 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa99ebb1-b06f-428a-a6cc-9c5c2821c534 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:40.520646 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa99ebb1-b06f-428a-a6cc-9c5c2821c534 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:40.522625 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa99ebb1-b06f-428a-a6cc-9c5c2821c534 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:40.543967 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 291/576] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:14:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:40.543967 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa99ebb1-b06f-428a-a6cc-9c5c2821c534 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:40.687024 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:40.702894 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a3101-55b1-4ae9-922f-3f56010d8e7e None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:40.722129 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa99ebb1-b06f-428a-a6cc-9c5c2821c534 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:40.771089 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ee4f1-1cd4-455c-87ab-927d41512aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:40.772071 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ee4f1-1cd4-455c-87ab-927d41512aa9 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:40.772548 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ee4f1-1cd4-455c-87ab-927d41512aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:40.773018 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ee4f1-1cd4-455c-87ab-927d41512aa9 None admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:40.773137 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af584a4-a13f-4aa7-b9ef-a0d30ed53740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:40.773799 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af584a4-a13f-4aa7-b9ef-a0d30ed53740 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:40.774074 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af584a4-a13f-4aa7-b9ef-a0d30ed53740 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:40.774293 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2ee4f1-1cd4-455c-87ab-927d41512aa9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:40.774391 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af584a4-a13f-4aa7-b9ef-a0d30ed53740 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:40.774894 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2ee4f1-1cd4-455c-87ab-927d41512aa9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:40.778122 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2ee4f1-1cd4-455c-87ab-927d41512aa9 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:40.785910 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af584a4-a13f-4aa7-b9ef-a0d30ed53740 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:40.787409 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af584a4-a13f-4aa7-b9ef-a0d30ed53740 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:40.810696 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 286/577] 10.222.0.91 () {56 vars in 1148 bytes} [Tue Aug 30 04:14:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:40.810913 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-9af584a4-a13f-4aa7-b9ef-a0d30ed53740 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:40.810913 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:40.810913 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:40.810913 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:40.810913 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:40.810913 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:40.810913 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:40.810913 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:40.810913 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:40.810913 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:40.810913 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:40.810913 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:40.810913 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:14:40.810913 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:14:40.810913 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:14:40.810913 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:14:40.812038 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:40.812038 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:40.812038 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:40.812038 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:40.812038 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:40.812038 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:40.812038 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:40.812038 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:40.812038 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:40.812038 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:40.812038 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:40.812038 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:40.812038 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:40.812038 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:40.812038 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:40.812038 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:40.812038 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:14:40.813130 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:14:40.813130 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:40.813130 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:14:40.813341 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ee4f1-1cd4-455c-87ab-927d41512aa9 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:40.813414 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 292/578] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:14:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:40.813414 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af584a4-a13f-4aa7-b9ef-a0d30ed53740 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:40.918522 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:40.952860 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af584a4-a13f-4aa7-b9ef-a0d30ed53740 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:40.964824 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ee4f1-1cd4-455c-87ab-927d41512aa9 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:40.995594 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:41.002922 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bab9916-d7c0-4e4b-81b7-02c840f6b868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:41.003571 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab9916-d7c0-4e4b-81b7-02c840f6b868 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:41.003844 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab9916-d7c0-4e4b-81b7-02c840f6b868 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:41.004147 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab9916-d7c0-4e4b-81b7-02c840f6b868 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:41.013642 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bab9916-d7c0-4e4b-81b7-02c840f6b868 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:41.014069 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d405f1a-010a-4dd2-adea-52726e4bd19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:41.014788 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d405f1a-010a-4dd2-adea-52726e4bd19f None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:41.015130 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bab9916-d7c0-4e4b-81b7-02c840f6b868 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:41.015298 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d405f1a-010a-4dd2-adea-52726e4bd19f None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:41.015597 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d405f1a-010a-4dd2-adea-52726e4bd19f None admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:41.016424 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d405f1a-010a-4dd2-adea-52726e4bd19f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:41.016778 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d405f1a-010a-4dd2-adea-52726e4bd19f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:41.018351 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d405f1a-010a-4dd2-adea-52726e4bd19f None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:41.044381 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 287/579] 10.222.0.91 () {56 vars in 1148 bytes} [Tue Aug 30 04:14:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:41.044381 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d405f1a-010a-4dd2-adea-52726e4bd19f None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:41.044782 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-2bab9916-d7c0-4e4b-81b7-02c840f6b868 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 04:14:41.044782 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:41.044782 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:41.044782 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:41.044782 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:41.044782 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:41.044782 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:41.044782 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:41.044782 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:41.044782 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:41.044782 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:41.044782 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:41.044782 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:14:41.044782 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:14:41.044782 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:14:41.044782 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:14:41.046693 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:41.046693 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:41.046693 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:14:41.046693 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:14:41.046693 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:14:41.046693 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:14:41.046693 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:41.046693 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:41.046693 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:41.046693 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:41.046693 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:41.046693 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:41.046693 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:41.046693 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:41.046693 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:41.046693 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:41.046693 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:41.046693 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:41.048902 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:41.048902 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:41.048902 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:14:41.048902 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:14:41.048902 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:14:41.048902 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:14:41.048902 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:14:41.048902 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:14:41.048902 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 04:14:41.048902 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:14:41.048902 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 293/580] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 30 04:14:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:41.048902 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bab9916-d7c0-4e4b-81b7-02c840f6b868 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:41.208175 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d405f1a-010a-4dd2-adea-52726e4bd19f None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:41.227687 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bab9916-d7c0-4e4b-81b7-02c840f6b868 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:41.252445 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:41.269127 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31aabd-b209-4f13-a204-5f074ad5bb0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:41.269757 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31aabd-b209-4f13-a204-5f074ad5bb0d None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:41.270035 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31aabd-b209-4f13-a204-5f074ad5bb0d None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:41.270307 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31aabd-b209-4f13-a204-5f074ad5bb0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:41.271110 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc31aabd-b209-4f13-a204-5f074ad5bb0d None admin] RBAC: Adding query filter params (role.id=c3eef5523b7a407082ffaa23a9753410, scope.project.id=4e05769361674c8fa995050150ad4cfa, user.id=94b50f9552124b07822ae63c1d553864) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:41.271417 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc31aabd-b209-4f13-a204-5f074ad5bb0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:41.272978 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc31aabd-b209-4f13-a204-5f074ad5bb0d None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:41.280121 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 288/581] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 30 04:14:41 2022] GET /identity/v3/role_assignments?user.id=94b50f9552124b07822ae63c1d553864&scope.project.id=4e05769361674c8fa995050150ad4cfa&role.id=c3eef5523b7a407082ffaa23a9753410 => generated 259 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:41.280393 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbcde55-996f-4618-8804-8a129894bc8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:41.280995 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31aabd-b209-4f13-a204-5f074ad5bb0d None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:41.281195 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbcde55-996f-4618-8804-8a129894bc8d None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:41.281539 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbcde55-996f-4618-8804-8a129894bc8d None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:41.281987 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbcde55-996f-4618-8804-8a129894bc8d None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:41.283145 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbcde55-996f-4618-8804-8a129894bc8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:41.283649 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbcde55-996f-4618-8804-8a129894bc8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:41.286115 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbcde55-996f-4618-8804-8a129894bc8d None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:41.308777 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 294/582] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:14:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:41.310001 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbcde55-996f-4618-8804-8a129894bc8d None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:41.390213 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:41.461541 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbcde55-996f-4618-8804-8a129894bc8d None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:41.495107 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31aabd-b209-4f13-a204-5f074ad5bb0d None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:41.530128 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b3ed65-0629-4168-8b82-a9c0d61d1371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:41.531083 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3ed65-0629-4168-8b82-a9c0d61d1371 None admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:41.531394 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3ed65-0629-4168-8b82-a9c0d61d1371 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:41.531714 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3ed65-0629-4168-8b82-a9c0d61d1371 None admin] PATH_INFO: `/v3/projects/4e05769361674c8fa995050150ad4cfa/users/2af2e1344bc54bf388e5ec025ab94c2d/roles/c3eef5523b7a407082ffaa23a9753410` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:41.545873 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d58dd-e41f-4362-852d-00420070d4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:41.546892 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d58dd-e41f-4362-852d-00420070d4fd None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:41.547428 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d58dd-e41f-4362-852d-00420070d4fd None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:41.548083 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d58dd-e41f-4362-852d-00420070d4fd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:41.551825 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b3ed65-0629-4168-8b82-a9c0d61d1371 None admin] RBAC: Authorizing `identity:create_grant(project_id=4e05769361674c8fa995050150ad4cfa, user_id=2af2e1344bc54bf388e5ec025ab94c2d, role_id=c3eef5523b7a407082ffaa23a9753410)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:41.553533 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b3ed65-0629-4168-8b82-a9c0d61d1371 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:41.562850 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953d58dd-e41f-4362-852d-00420070d4fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:14:41.576480 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 295/583] 10.222.0.91 () {58 vars in 1439 bytes} [Tue Aug 30 04:14:41 2022] PUT /identity/v3/projects/4e05769361674c8fa995050150ad4cfa/users/2af2e1344bc54bf388e5ec025ab94c2d/roles/c3eef5523b7a407082ffaa23a9753410 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:41.576748 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-953d58dd-e41f-4362-852d-00420070d4fd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:14:41.576748 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:41.576748 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:41.576748 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:41.576748 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:41.576748 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:41.576748 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:41.576748 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:41.576748 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:41.576748 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:41.576748 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:41.576748 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:41.576748 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:14:41.576748 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:14:41.576748 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:14:41.576748 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:14:41.579498 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:14:41.579498 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:14:41.579498 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:14:41.579498 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:14:41.579498 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:41.579498 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:41.579498 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:41.579498 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:41.579498 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:41.579498 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:41.579498 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:41.579498 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:41.579498 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:41.579498 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:41.579498 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:41.579498 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:41.584922 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:41.584922 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:41.584922 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:41.584922 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:41.584922 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:14:41.584922 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:14:41.584922 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:14:41.584922 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:14:41.584922 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:14:41.584922 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:14:41.584922 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:14:41.584922 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:14:41.585739 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b3ed65-0629-4168-8b82-a9c0d61d1371 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:41.585829 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 289/584] 10.222.0.91 () {56 vars in 1102 bytes} [Tue Aug 30 04:14:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:41.585829 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d58dd-e41f-4362-852d-00420070d4fd None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:41.689683 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:41.759973 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:41.764872 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b3ed65-0629-4168-8b82-a9c0d61d1371 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:41.813728 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d58dd-e41f-4362-852d-00420070d4fd None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:41.838231 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3907bf18-486d-4286-976c-6b935963598f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:41.839401 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907bf18-486d-4286-976c-6b935963598f None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:41.839537 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907bf18-486d-4286-976c-6b935963598f None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:41.839829 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907bf18-486d-4286-976c-6b935963598f None admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:41.840726 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3907bf18-486d-4286-976c-6b935963598f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:41.841293 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3907bf18-486d-4286-976c-6b935963598f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:41.842645 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3907bf18-486d-4286-976c-6b935963598f None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:41.870709 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 296/585] 10.222.0.91 () {56 vars in 1137 bytes} [Tue Aug 30 04:14:41 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:41.871696 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3907bf18-486d-4286-976c-6b935963598f None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:41.882839 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d982a9a-daa3-4bec-81e5-951462c32755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:41.883979 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d982a9a-daa3-4bec-81e5-951462c32755 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:41.884487 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d982a9a-daa3-4bec-81e5-951462c32755 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:41.885879 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d982a9a-daa3-4bec-81e5-951462c32755 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:41.901576 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d982a9a-daa3-4bec-81e5-951462c32755 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:41.904174 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d982a9a-daa3-4bec-81e5-951462c32755 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:41.929460 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-2d982a9a-daa3-4bec-81e5-951462c32755 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 04:14:41.929460 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:41.929460 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:41.929460 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:41.929460 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:41.929460 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:41.929460 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:41.929460 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:41.929460 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:41.929460 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:41.929460 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:41.929460 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:41.929460 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:14:41.929460 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:14:41.929460 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:14:41.929460 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:14:41.930486 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:41.930486 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:41.930486 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:14:41.930486 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:14:41.930486 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:14:41.930486 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:14:41.930486 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:41.930486 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:41.930486 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:41.930486 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:41.930486 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:41.930486 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:41.930486 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:41.930486 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:41.930486 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:41.930486 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:41.930486 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:41.930486 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:41.931738 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:41.931738 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:41.931738 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:14:41.931738 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:14:41.931738 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:14:41.931738 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:14:41.931738 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:14:41.931738 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:14:41.931738 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 04:14:41.931738 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:14:41.936142 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 290/586] 10.222.0.91 () {56 vars in 1093 bytes} [Tue Aug 30 04:14:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:41.938156 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d982a9a-daa3-4bec-81e5-951462c32755 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:42.061512 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3907bf18-486d-4286-976c-6b935963598f None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:42.145518 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7778f34f-9e9b-4140-9f61-a421cd4f66cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:42.146303 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778f34f-9e9b-4140-9f61-a421cd4f66cc None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:42.146587 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778f34f-9e9b-4140-9f61-a421cd4f66cc None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:42.146850 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778f34f-9e9b-4140-9f61-a421cd4f66cc None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:42.147567 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7778f34f-9e9b-4140-9f61-a421cd4f66cc None admin] RBAC: Adding query filter params (name=service) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:42.147876 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7778f34f-9e9b-4140-9f61-a421cd4f66cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:42.149426 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7778f34f-9e9b-4140-9f61-a421cd4f66cc None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:42.159107 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d982a9a-daa3-4bec-81e5-951462c32755 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:42.168736 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 297/587] 10.222.0.91 () {56 vars in 1103 bytes} [Tue Aug 30 04:14:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:42.170303 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7778f34f-9e9b-4140-9f61-a421cd4f66cc None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:42.184999 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:42.220886 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:42.221213 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0352c67-4778-453a-9e7f-dfbcd47ea336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:42.222060 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0352c67-4778-453a-9e7f-dfbcd47ea336 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:42.222535 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0352c67-4778-453a-9e7f-dfbcd47ea336 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:42.222953 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0352c67-4778-453a-9e7f-dfbcd47ea336 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:42.238292 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0352c67-4778-453a-9e7f-dfbcd47ea336 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:42.240224 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0352c67-4778-453a-9e7f-dfbcd47ea336 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:42.258225 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-d0352c67-4778-453a-9e7f-dfbcd47ea336 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:42.258225 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:42.258225 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:42.258225 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:42.258225 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:42.258225 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:42.258225 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:42.258225 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:42.258225 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:42.258225 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:42.258225 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:42.258225 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:42.258225 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:14:42.258225 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:14:42.258225 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:14:42.258225 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:14:42.259507 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:42.259507 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:42.259507 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:42.259507 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:42.259507 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:42.259507 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:42.259507 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:42.259507 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:42.259507 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:42.259507 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:42.259507 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:42.259507 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:42.259507 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:42.259507 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:42.259507 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:42.259507 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:42.259507 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:14:42.261197 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:14:42.261197 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:42.261197 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:14:42.267692 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 291/588] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:14:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:42.269016 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0352c67-4778-453a-9e7f-dfbcd47ea336 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:42.390881 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7778f34f-9e9b-4140-9f61-a421cd4f66cc None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:42.404436 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0352c67-4778-453a-9e7f-dfbcd47ea336 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:42.447745 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc298b76-94c5-4dde-b8e6-4e54db592d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:42.449579 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc298b76-94c5-4dde-b8e6-4e54db592d27 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:42.450030 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc298b76-94c5-4dde-b8e6-4e54db592d27 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:42.450535 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc298b76-94c5-4dde-b8e6-4e54db592d27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:42.469466 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc298b76-94c5-4dde-b8e6-4e54db592d27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:42.472232 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc298b76-94c5-4dde-b8e6-4e54db592d27 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:42.472986 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e372b0b6-8479-4063-8a87-af75dcb69f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:42.474582 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e372b0b6-8479-4063-8a87-af75dcb69f20 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:42.475480 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e372b0b6-8479-4063-8a87-af75dcb69f20 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:42.476674 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e372b0b6-8479-4063-8a87-af75dcb69f20 None admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:42.479649 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e372b0b6-8479-4063-8a87-af75dcb69f20 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:42.489484 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e372b0b6-8479-4063-8a87-af75dcb69f20 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:42.492737 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e372b0b6-8479-4063-8a87-af75dcb69f20 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:42.499881 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-bc298b76-94c5-4dde-b8e6-4e54db592d27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:42.499881 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:42.499881 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:42.499881 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:42.499881 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:42.499881 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:42.499881 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:42.499881 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:42.499881 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:42.499881 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:42.499881 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:42.499881 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:42.499881 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:14:42.499881 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:14:42.499881 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:14:42.499881 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:14:42.501852 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:42.501852 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:42.501852 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:42.501852 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:42.501852 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:42.501852 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:42.501852 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:42.501852 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:42.501852 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:42.501852 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:42.501852 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:42.501852 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:42.501852 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:42.501852 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:42.501852 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:42.501852 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:42.501852 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:14:42.503538 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:14:42.503538 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:42.503538 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:14:42.506571 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 292/589] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:14:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:42.507613 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc298b76-94c5-4dde-b8e6-4e54db592d27 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:42.527557 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:42.545678 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 298/590] 10.222.0.91 () {56 vars in 1133 bytes} [Tue Aug 30 04:14:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:42.545678 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e372b0b6-8479-4063-8a87-af75dcb69f20 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:42.677415 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc298b76-94c5-4dde-b8e6-4e54db592d27 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:42.712630 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:42.725368 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3af0dab-fb01-4ed8-8e9d-6eda60e2091d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:42.726411 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af0dab-fb01-4ed8-8e9d-6eda60e2091d None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:42.726897 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af0dab-fb01-4ed8-8e9d-6eda60e2091d None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:42.727403 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af0dab-fb01-4ed8-8e9d-6eda60e2091d None admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:42.728418 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3af0dab-fb01-4ed8-8e9d-6eda60e2091d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:42.729801 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3af0dab-fb01-4ed8-8e9d-6eda60e2091d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:42.731563 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3af0dab-fb01-4ed8-8e9d-6eda60e2091d None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:42.752491 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 293/591] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:14:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:42.753830 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3af0dab-fb01-4ed8-8e9d-6eda60e2091d None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:42.763544 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e372b0b6-8479-4063-8a87-af75dcb69f20 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:42.839752 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad535663-5461-4d8d-963c-05f32945e4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:42.841305 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad535663-5461-4d8d-963c-05f32945e4a4 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:42.841749 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad535663-5461-4d8d-963c-05f32945e4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:42.842189 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad535663-5461-4d8d-963c-05f32945e4a4 None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:42.843281 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad535663-5461-4d8d-963c-05f32945e4a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:42.843772 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad535663-5461-4d8d-963c-05f32945e4a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:42.846975 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad535663-5461-4d8d-963c-05f32945e4a4 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:42.871487 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 299/592] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:14:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:42.873691 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad535663-5461-4d8d-963c-05f32945e4a4 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:42.881812 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:42.949545 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3af0dab-fb01-4ed8-8e9d-6eda60e2091d None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:43.030322 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f39f142-c63c-44eb-ad7b-287046b48e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:43.031830 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f39f142-c63c-44eb-ad7b-287046b48e18 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:43.032582 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f39f142-c63c-44eb-ad7b-287046b48e18 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:43.033270 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f39f142-c63c-44eb-ad7b-287046b48e18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:43.058302 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f39f142-c63c-44eb-ad7b-287046b48e18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:43.061443 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f39f142-c63c-44eb-ad7b-287046b48e18 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:43.086903 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad535663-5461-4d8d-963c-05f32945e4a4 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:43.097728 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-5f39f142-c63c-44eb-ad7b-287046b48e18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:43.097728 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:43.097728 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:43.097728 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:43.097728 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:43.097728 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:43.097728 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:43.097728 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:43.097728 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:43.097728 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:43.097728 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:43.097728 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:43.097728 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:14:43.097728 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:14:43.097728 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:14:43.097728 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:14:43.099608 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:43.099608 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:43.099608 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:43.099608 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:43.099608 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:43.099608 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:43.099608 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:43.099608 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:43.099608 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:43.099608 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:43.099608 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:43.099608 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:43.099608 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:43.099608 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:43.099608 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:43.099608 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:43.099608 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:14:43.101320 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:14:43.101320 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:43.101320 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:14:43.104310 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 294/593] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:14:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:43.105889 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f39f142-c63c-44eb-ad7b-287046b48e18 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:43.160208 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9947a957-a350-4be2-aba7-f7ab9aaf5649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:43.161815 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947a957-a350-4be2-aba7-f7ab9aaf5649 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:43.162533 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947a957-a350-4be2-aba7-f7ab9aaf5649 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:43.163389 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947a957-a350-4be2-aba7-f7ab9aaf5649 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:43.177818 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9947a957-a350-4be2-aba7-f7ab9aaf5649 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:43.180858 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9947a957-a350-4be2-aba7-f7ab9aaf5649 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:43.184494 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:43.206137 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-9947a957-a350-4be2-aba7-f7ab9aaf5649 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:14:43.206137 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:43.206137 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:43.206137 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:43.206137 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:43.206137 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:43.206137 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:43.206137 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:43.206137 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:43.206137 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:43.206137 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:43.206137 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:43.206137 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:14:43.206137 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:14:43.206137 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:14:43.207887 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:14:43.207887 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:43.207887 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:43.207887 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:43.207887 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:43.207887 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:43.207887 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:43.207887 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:43.207887 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:43.207887 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:43.207887 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:43.207887 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:43.207887 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:43.207887 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:43.207887 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:43.207887 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:43.207887 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:43.209679 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:14:43.209679 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:14:43.209679 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:14:43.209679 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:14:43.209679 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:14:43.209679 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:14:43.209679 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:14:43.209679 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:14:43.214774 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 300/594] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 30 04:14:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:43.216923 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9947a957-a350-4be2-aba7-f7ab9aaf5649 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:43.300563 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f39f142-c63c-44eb-ad7b-287046b48e18 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:43.345853 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:43.367088 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9421a4e2-ea43-4811-b818-886bd7c436d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:43.368220 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9421a4e2-ea43-4811-b818-886bd7c436d5 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:43.368698 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9421a4e2-ea43-4811-b818-886bd7c436d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:43.369351 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9421a4e2-ea43-4811-b818-886bd7c436d5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:43.385564 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9421a4e2-ea43-4811-b818-886bd7c436d5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:43.388251 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9421a4e2-ea43-4811-b818-886bd7c436d5 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:43.401804 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9947a957-a350-4be2-aba7-f7ab9aaf5649 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:43.410968 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-9421a4e2-ea43-4811-b818-886bd7c436d5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 04:14:43.410968 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:43.410968 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:43.410968 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:43.410968 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:43.410968 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:43.410968 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:43.410968 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:43.410968 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:43.410968 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:43.410968 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:43.410968 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:43.410968 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:14:43.410968 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:14:43.410968 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:14:43.410968 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:14:43.413133 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:43.413133 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:43.413133 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:14:43.413133 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:14:43.413133 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:14:43.413133 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:14:43.413133 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:43.413133 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:43.413133 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:43.413133 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:43.413133 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:43.413133 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:43.413133 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:43.413133 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:43.413133 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:43.413133 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:43.413133 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:43.413133 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:43.414939 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:43.414939 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:43.414939 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:14:43.414939 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:14:43.414939 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:14:43.414939 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:14:43.414939 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:14:43.414939 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:14:43.414939 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 04:14:43.414939 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:14:43.414939 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 295/595] 10.222.0.91 () {56 vars in 1102 bytes} [Tue Aug 30 04:14:43 2022] GET /identity/v3/users/neutron => generated 85 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:43.414939 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9421a4e2-ea43-4811-b818-886bd7c436d5 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:43.477110 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6597b-afd5-4f8f-b1fd-09fff1f20579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:43.478819 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6597b-afd5-4f8f-b1fd-09fff1f20579 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:43.479698 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6597b-afd5-4f8f-b1fd-09fff1f20579 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:43.480444 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6597b-afd5-4f8f-b1fd-09fff1f20579 None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:43.482005 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d6597b-afd5-4f8f-b1fd-09fff1f20579 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:43.482844 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d6597b-afd5-4f8f-b1fd-09fff1f20579 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:43.486099 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d6597b-afd5-4f8f-b1fd-09fff1f20579 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:43.510702 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 301/596] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:14:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:43.512979 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6597b-afd5-4f8f-b1fd-09fff1f20579 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:43.624119 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9421a4e2-ea43-4811-b818-886bd7c436d5 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:43.649585 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:43.697442 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2122ac42-d386-4957-a2dc-d878c2295319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:43.698546 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122ac42-d386-4957-a2dc-d878c2295319 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:43.699015 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122ac42-d386-4957-a2dc-d878c2295319 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:43.699525 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122ac42-d386-4957-a2dc-d878c2295319 None admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:43.700883 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2122ac42-d386-4957-a2dc-d878c2295319 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:43.701411 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2122ac42-d386-4957-a2dc-d878c2295319 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:43.704120 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2122ac42-d386-4957-a2dc-d878c2295319 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:43.722448 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 296/597] 10.222.0.91 () {56 vars in 1148 bytes} [Tue Aug 30 04:14:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:43.723369 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2122ac42-d386-4957-a2dc-d878c2295319 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:43.739213 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6597b-afd5-4f8f-b1fd-09fff1f20579 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:43.780226 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:43.816285 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1318890-6621-4f80-972d-ad8aa359c040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:43.817100 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1318890-6621-4f80-972d-ad8aa359c040 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:43.817241 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1318890-6621-4f80-972d-ad8aa359c040 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:43.817650 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1318890-6621-4f80-972d-ad8aa359c040 None admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:43.818176 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1318890-6621-4f80-972d-ad8aa359c040 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:43.818482 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1318890-6621-4f80-972d-ad8aa359c040 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:43.820008 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1318890-6621-4f80-972d-ad8aa359c040 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:43.856309 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2122ac42-d386-4957-a2dc-d878c2295319 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:43.859160 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 302/598] 10.222.0.91 () {56 vars in 1139 bytes} [Tue Aug 30 04:14:43 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:43.861064 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1318890-6621-4f80-972d-ad8aa359c040 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:43.899625 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5df1bfb-b6dc-44c1-a238-46dc79156be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:43.900633 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df1bfb-b6dc-44c1-a238-46dc79156be2 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:43.900772 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df1bfb-b6dc-44c1-a238-46dc79156be2 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:43.901631 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df1bfb-b6dc-44c1-a238-46dc79156be2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:43.913903 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5df1bfb-b6dc-44c1-a238-46dc79156be2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:43.916406 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5df1bfb-b6dc-44c1-a238-46dc79156be2 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:43.932470 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-c5df1bfb-b6dc-44c1-a238-46dc79156be2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:14:43.932470 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:43.932470 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:43.932470 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:43.932470 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:43.932470 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:43.932470 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:43.932470 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:43.932470 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:43.932470 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:43.932470 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:43.932470 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:43.932470 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:14:43.932470 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:14:43.932470 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:14:43.934168 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:14:43.934168 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:43.934168 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:43.934168 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:43.934168 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:43.934168 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:43.934168 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:43.934168 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:43.934168 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:43.934168 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:43.934168 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:43.934168 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:43.934168 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:43.934168 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:43.934168 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:43.934168 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:43.934168 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:43.935943 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:14:43.935943 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:14:43.935943 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:14:43.935943 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:14:43.935943 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:14:43.935943 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:14:43.935943 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:14:43.935943 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:14:43.938700 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 297/599] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 30 04:14:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:43.939753 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5df1bfb-b6dc-44c1-a238-46dc79156be2 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:44.053411 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1318890-6621-4f80-972d-ad8aa359c040 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:44.074104 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:44.087763 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5df1bfb-b6dc-44c1-a238-46dc79156be2 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:44.091613 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:44.101745 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f62ec-e578-44bf-91f3-af56d27ecefb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:44.102849 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f62ec-e578-44bf-91f3-af56d27ecefb None admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:44.103130 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f62ec-e578-44bf-91f3-af56d27ecefb None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:44.103412 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f62ec-e578-44bf-91f3-af56d27ecefb None admin] PATH_INFO: `/v3/projects/4e05769361674c8fa995050150ad4cfa/users/812abdd745f149e6a0166cd9040f28e8/roles/c3eef5523b7a407082ffaa23a9753410` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:44.124731 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6f62ec-e578-44bf-91f3-af56d27ecefb None admin] RBAC: Authorizing `identity:create_grant(project_id=4e05769361674c8fa995050150ad4cfa, user_id=812abdd745f149e6a0166cd9040f28e8, role_id=c3eef5523b7a407082ffaa23a9753410)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:44.126242 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6f62ec-e578-44bf-91f3-af56d27ecefb None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:44.133749 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f98a49-65ce-4471-a255-edbd40d0ddd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:44.134475 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f98a49-65ce-4471-a255-edbd40d0ddd0 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:44.135144 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f98a49-65ce-4471-a255-edbd40d0ddd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:44.135817 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f98a49-65ce-4471-a255-edbd40d0ddd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:44.145502 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 303/600] 10.222.0.91 () {58 vars in 1439 bytes} [Tue Aug 30 04:14:43 2022] PUT /identity/v3/projects/4e05769361674c8fa995050150ad4cfa/users/812abdd745f149e6a0166cd9040f28e8/roles/c3eef5523b7a407082ffaa23a9753410 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:44.146391 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f62ec-e578-44bf-91f3-af56d27ecefb None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:44.158260 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f98a49-65ce-4471-a255-edbd40d0ddd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:44.160439 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f98a49-65ce-4471-a255-edbd40d0ddd0 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:44.180700 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-80f98a49-65ce-4471-a255-edbd40d0ddd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:44.180700 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:44.180700 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:44.180700 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:44.180700 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:44.180700 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:44.180700 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:44.180700 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:44.180700 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:44.180700 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:44.180700 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:44.180700 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:44.180700 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:14:44.180700 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:14:44.180700 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:14:44.180700 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:14:44.181798 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:44.181798 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:44.181798 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:44.181798 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:44.181798 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:44.181798 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:44.181798 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:44.181798 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:44.181798 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:44.181798 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:44.181798 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:44.181798 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:44.181798 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:44.181798 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:44.181798 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:44.181798 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:44.181798 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:14:44.183377 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:14:44.183377 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:44.183377 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:14:44.183377 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 298/601] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:14:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:44.183377 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71026a-424b-4fa6-a33f-09f0478f8ac3 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:44.183953 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71026a-424b-4fa6-a33f-09f0478f8ac3 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:44.183953 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71026a-424b-4fa6-a33f-09f0478f8ac3 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:44.185687 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 299/602] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:14:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:14:44.186776 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa092375-a9e0-48c0-adcf-254cf216cb71 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:44.187065 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa092375-a9e0-48c0-adcf-254cf216cb71 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:44.187326 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa092375-a9e0-48c0-adcf-254cf216cb71 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:44.192162 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 300/603] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:14:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:14:44.193653 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa092375-a9e0-48c0-adcf-254cf216cb71 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:44.301982 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f62ec-e578-44bf-91f3-af56d27ecefb None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:44.351228 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa092375-a9e0-48c0-adcf-254cf216cb71 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:44.354982 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf4a2ca-3f62-4739-bca7-00fc32f003c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:44.355635 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf4a2ca-3f62-4739-bca7-00fc32f003c8 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:44.356037 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf4a2ca-3f62-4739-bca7-00fc32f003c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:44.356250 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf4a2ca-3f62-4739-bca7-00fc32f003c8 None admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:44.356997 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf4a2ca-3f62-4739-bca7-00fc32f003c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:44.357282 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf4a2ca-3f62-4739-bca7-00fc32f003c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:44.358804 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf4a2ca-3f62-4739-bca7-00fc32f003c8 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:44.373206 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 304/604] 10.222.0.91 () {56 vars in 1148 bytes} [Tue Aug 30 04:14:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:44.375962 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18177d64-564c-4907-9df6-e6284bc70af9 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:44.375962 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18177d64-564c-4907-9df6-e6284bc70af9 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:44.375962 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18177d64-564c-4907-9df6-e6284bc70af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:44.395051 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-18177d64-564c-4907-9df6-e6284bc70af9 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:44.395314 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea49bc-8a3b-422a-be2e-a551d052a0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:44.395805 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea49bc-8a3b-422a-be2e-a551d052a0fc None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:44.396119 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea49bc-8a3b-422a-be2e-a551d052a0fc None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:44.396310 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-18177d64-564c-4907-9df6-e6284bc70af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:44.396471 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea49bc-8a3b-422a-be2e-a551d052a0fc None admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:44.397085 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ea49bc-8a3b-422a-be2e-a551d052a0fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:44.397389 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ea49bc-8a3b-422a-be2e-a551d052a0fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:44.399147 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ea49bc-8a3b-422a-be2e-a551d052a0fc None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:44.414388 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 301/605] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:14:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:44.415788 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde456c-d074-4dd0-a3c6-d54faf7bf208 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:44.416404 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde456c-d074-4dd0-a3c6-d54faf7bf208 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:44.416734 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde456c-d074-4dd0-a3c6-d54faf7bf208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:44.434238 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:44.439764 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-2fde456c-d074-4dd0-a3c6-d54faf7bf208 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:44.441051 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-2fde456c-d074-4dd0-a3c6-d54faf7bf208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:44.454171 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:44.495796 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 305/606] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:14:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:14:44.505125 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18177d64-564c-4907-9df6-e6284bc70af9 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:44.536176 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 302/607] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:14:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:14:44.537395 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fde456c-d074-4dd0-a3c6-d54faf7bf208 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:44.686811 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18177d64-564c-4907-9df6-e6284bc70af9 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:44.716949 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fde456c-d074-4dd0-a3c6-d54faf7bf208 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:44.755520 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766423d0-bf64-4887-8a4e-950f064cbe4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:44.756899 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766423d0-bf64-4887-8a4e-950f064cbe4c None admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:44.757500 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766423d0-bf64-4887-8a4e-950f064cbe4c None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:44.758083 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766423d0-bf64-4887-8a4e-950f064cbe4c None admin] PATH_INFO: `/v3/projects/4e05769361674c8fa995050150ad4cfa/users/d806295278ae4997b5c6968aa553290c/roles/c3eef5523b7a407082ffaa23a9753410` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:44.783374 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766423d0-bf64-4887-8a4e-950f064cbe4c None admin] RBAC: Authorizing `identity:create_grant(project_id=4e05769361674c8fa995050150ad4cfa, user_id=d806295278ae4997b5c6968aa553290c, role_id=c3eef5523b7a407082ffaa23a9753410)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:44.792180 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766423d0-bf64-4887-8a4e-950f064cbe4c None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:44.813277 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf54ec2a-0f42-4190-b985-019c3fc20d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:44.814487 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54ec2a-0f42-4190-b985-019c3fc20d0b None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:44.814969 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54ec2a-0f42-4190-b985-019c3fc20d0b None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:44.816627 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 306/608] 10.222.0.91 () {58 vars in 1439 bytes} [Tue Aug 30 04:14:44 2022] PUT /identity/v3/projects/4e05769361674c8fa995050150ad4cfa/users/d806295278ae4997b5c6968aa553290c/roles/c3eef5523b7a407082ffaa23a9753410 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:44.817395 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54ec2a-0f42-4190-b985-019c3fc20d0b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:44.832937 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf54ec2a-0f42-4190-b985-019c3fc20d0b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:44.836285 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf54ec2a-0f42-4190-b985-019c3fc20d0b None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:44.847538 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766423d0-bf64-4887-8a4e-950f064cbe4c None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:44.872006 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:44.875332 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-cf54ec2a-0f42-4190-b985-019c3fc20d0b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:14:44.875332 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:44.875332 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:44.875332 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:44.875332 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:44.875332 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:44.875332 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:44.875332 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:44.875332 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:44.875332 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:44.875332 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:44.875332 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:44.875332 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:14:44.875332 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:14:44.875332 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:14:44.877076 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:14:44.877076 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:44.877076 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:44.877076 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:44.877076 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:44.877076 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:44.877076 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:44.877076 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:44.877076 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:44.877076 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:44.877076 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:44.877076 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:44.877076 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:44.877076 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:44.877076 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:44.877076 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:44.877076 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:44.878784 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:14:44.878784 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:14:44.878784 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:14:44.878784 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:14:44.878784 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:14:44.878784 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:14:44.878784 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:14:44.878784 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:14:44.878784 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 303/609] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 30 04:14:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:44.888309 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf54ec2a-0f42-4190-b985-019c3fc20d0b None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:44.904778 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:45.092303 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766423d0-bf64-4887-8a4e-950f064cbe4c None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:45.124062 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf54ec2a-0f42-4190-b985-019c3fc20d0b None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:45.154343 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce6bcb-4aa6-49af-bc7b-5bb2d7bd21e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:45.155107 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce6bcb-4aa6-49af-bc7b-5bb2d7bd21e7 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:45.155270 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce6bcb-4aa6-49af-bc7b-5bb2d7bd21e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:45.155563 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce6bcb-4aa6-49af-bc7b-5bb2d7bd21e7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:45.169760 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ce6bcb-4aa6-49af-bc7b-5bb2d7bd21e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:14:45.175057 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-c9ce6bcb-4aa6-49af-bc7b-5bb2d7bd21e7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:14:45.175057 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:45.175057 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:45.175057 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:45.175057 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:45.175057 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:45.175057 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:45.175057 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:45.175057 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:45.175057 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:45.175057 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:45.175057 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:45.175057 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:14:45.175057 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:14:45.175057 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:14:45.175057 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:14:45.176956 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:14:45.176956 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:14:45.176956 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:14:45.176956 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:14:45.176956 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:45.176956 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:45.176956 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:45.176956 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:45.176956 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:45.176956 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:45.176956 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:45.176956 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:45.176956 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:45.176956 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:45.176956 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:45.176956 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:45.178600 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:45.178600 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:45.178600 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:45.178600 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:45.178600 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:14:45.178600 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:14:45.178600 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:14:45.178600 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:14:45.178600 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:14:45.178600 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:14:45.178600 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:14:45.178600 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:14:45.178600 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 307/610] 10.222.0.91 () {56 vars in 1102 bytes} [Tue Aug 30 04:14:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:45.178600 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce6bcb-4aa6-49af-bc7b-5bb2d7bd21e7 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:45.195159 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3967034c-c7b3-4c1f-a02e-4d353eef6a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:45.195805 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967034c-c7b3-4c1f-a02e-4d353eef6a0d None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:45.196201 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967034c-c7b3-4c1f-a02e-4d353eef6a0d None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:45.196475 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967034c-c7b3-4c1f-a02e-4d353eef6a0d None admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:45.197398 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3967034c-c7b3-4c1f-a02e-4d353eef6a0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:45.197525 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3967034c-c7b3-4c1f-a02e-4d353eef6a0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:45.199496 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3967034c-c7b3-4c1f-a02e-4d353eef6a0d None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:45.213871 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 304/611] 10.222.0.91 () {56 vars in 1148 bytes} [Tue Aug 30 04:14:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:14:45.214903 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3967034c-c7b3-4c1f-a02e-4d353eef6a0d None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:45.274477 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:45.352326 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce6bcb-4aa6-49af-bc7b-5bb2d7bd21e7 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:45.355380 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:45.380713 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3967034c-c7b3-4c1f-a02e-4d353eef6a0d None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:45.433520 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c9c2a-9afa-4cb8-925a-5a90af5f2650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:45.434119 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af16508-6952-457e-948c-334e528be182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:45.434914 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af16508-6952-457e-948c-334e528be182 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:45.435258 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af16508-6952-457e-948c-334e528be182 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:45.435630 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af16508-6952-457e-948c-334e528be182 None admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:45.436139 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c9c2a-9afa-4cb8-925a-5a90af5f2650 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:45.436554 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af16508-6952-457e-948c-334e528be182 None admin] RBAC: Adding query filter params (name=service) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:45.436924 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af16508-6952-457e-948c-334e528be182 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:45.437370 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c9c2a-9afa-4cb8-925a-5a90af5f2650 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:45.438103 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c9c2a-9afa-4cb8-925a-5a90af5f2650 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:45.438851 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af16508-6952-457e-948c-334e528be182 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:45.450550 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 305/612] 10.222.0.91 () {56 vars in 1103 bytes} [Tue Aug 30 04:14:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:45.451838 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af16508-6952-457e-948c-334e528be182 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:45.464783 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893c9c2a-9afa-4cb8-925a-5a90af5f2650 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:14:45.471880 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-893c9c2a-9afa-4cb8-925a-5a90af5f2650 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:14:45.471880 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:45.471880 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:45.471880 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:45.471880 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:45.471880 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:45.471880 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:45.471880 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:45.471880 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:45.471880 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:45.471880 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:45.471880 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:45.471880 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:14:45.471880 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:14:45.471880 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:14:45.471880 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:14:45.473784 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:14:45.473784 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:14:45.473784 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:14:45.473784 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:14:45.473784 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:45.473784 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:45.473784 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:45.473784 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:45.473784 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:45.473784 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:45.473784 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:45.473784 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:45.473784 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:45.473784 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:45.473784 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:45.473784 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:45.475419 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:45.475419 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:45.475419 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:45.475419 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:45.475419 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:14:45.475419 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:14:45.475419 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:14:45.475419 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:14:45.475419 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:14:45.475419 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:14:45.475419 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:14:45.475419 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:14:45.475419 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 308/613] 10.222.0.91 () {56 vars in 1102 bytes} [Tue Aug 30 04:14:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:45.475419 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c9c2a-9afa-4cb8-925a-5a90af5f2650 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:45.655053 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af16508-6952-457e-948c-334e528be182 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:45.657973 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c9c2a-9afa-4cb8-925a-5a90af5f2650 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:45.693702 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:45.713174 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:45.715766 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d4f16-5266-4a3a-b26f-67f284bff827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:45.717434 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d4f16-5266-4a3a-b26f-67f284bff827 None admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:45.717929 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d4f16-5266-4a3a-b26f-67f284bff827 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:45.718418 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d4f16-5266-4a3a-b26f-67f284bff827 None admin] PATH_INFO: `/v3/projects/4e05769361674c8fa995050150ad4cfa/users/1c05f49ae42b4f9583ff10b2cfce52a1/roles/c3eef5523b7a407082ffaa23a9753410` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:45.726361 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffb6003-406a-4ec3-bb63-9daaa50cc51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:45.728363 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffb6003-406a-4ec3-bb63-9daaa50cc51c None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:45.728885 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffb6003-406a-4ec3-bb63-9daaa50cc51c None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:45.729302 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffb6003-406a-4ec3-bb63-9daaa50cc51c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:45.743038 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffb6003-406a-4ec3-bb63-9daaa50cc51c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:45.745686 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffb6003-406a-4ec3-bb63-9daaa50cc51c None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:45.756419 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746d4f16-5266-4a3a-b26f-67f284bff827 None admin] RBAC: Authorizing `identity:create_grant(project_id=4e05769361674c8fa995050150ad4cfa, user_id=1c05f49ae42b4f9583ff10b2cfce52a1, role_id=c3eef5523b7a407082ffaa23a9753410)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:45.760926 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746d4f16-5266-4a3a-b26f-67f284bff827 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:45.764730 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-bffb6003-406a-4ec3-bb63-9daaa50cc51c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:45.764730 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:45.764730 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:45.764730 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:45.764730 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:45.764730 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:45.764730 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:45.764730 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:45.764730 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:45.764730 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:45.764730 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:45.764730 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:45.764730 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:14:45.764730 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:14:45.764730 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:14:45.764730 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:14:45.765837 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:45.765837 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:45.765837 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:45.765837 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:45.765837 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:45.765837 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:45.765837 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:45.765837 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:45.765837 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:45.765837 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:45.765837 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:45.765837 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:45.765837 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:45.765837 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:45.765837 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:45.765837 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:45.765837 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:14:45.766899 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:14:45.766899 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:45.766899 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:14:45.768942 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 309/614] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:14:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:45.770432 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffb6003-406a-4ec3-bb63-9daaa50cc51c None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:45.800088 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 306/615] 10.222.0.91 () {58 vars in 1439 bytes} [Tue Aug 30 04:14:45 2022] PUT /identity/v3/projects/4e05769361674c8fa995050150ad4cfa/users/1c05f49ae42b4f9583ff10b2cfce52a1/roles/c3eef5523b7a407082ffaa23a9753410 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:45.801871 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d4f16-5266-4a3a-b26f-67f284bff827 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:45.956639 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffb6003-406a-4ec3-bb63-9daaa50cc51c None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:46.012461 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce4e7c1-c0a5-488e-adbe-015fe58e655f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:46.013542 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4e7c1-c0a5-488e-adbe-015fe58e655f None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:46.014027 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4e7c1-c0a5-488e-adbe-015fe58e655f None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:46.014501 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4e7c1-c0a5-488e-adbe-015fe58e655f None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:46.016001 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce4e7c1-c0a5-488e-adbe-015fe58e655f None admin] RBAC: Adding query filter params (name=service) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:46.017423 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce4e7c1-c0a5-488e-adbe-015fe58e655f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:46.029398 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce4e7c1-c0a5-488e-adbe-015fe58e655f None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:46.059298 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 310/616] 10.222.0.91 () {56 vars in 1103 bytes} [Tue Aug 30 04:14:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:46.069568 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce4e7c1-c0a5-488e-adbe-015fe58e655f None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:46.121904 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d4f16-5266-4a3a-b26f-67f284bff827 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:46.183248 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:46.198810 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306c633-3795-457f-b260-c33be67c4c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:46.199949 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306c633-3795-457f-b260-c33be67c4c06 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:46.200445 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306c633-3795-457f-b260-c33be67c4c06 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:46.200916 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306c633-3795-457f-b260-c33be67c4c06 None admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:46.202121 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9306c633-3795-457f-b260-c33be67c4c06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:46.202652 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9306c633-3795-457f-b260-c33be67c4c06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:46.206945 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9306c633-3795-457f-b260-c33be67c4c06 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:46.240193 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 307/617] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:14:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 439 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:46.255497 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306c633-3795-457f-b260-c33be67c4c06 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:46.349316 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:46.365752 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce4e7c1-c0a5-488e-adbe-015fe58e655f None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:46.448134 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a129bf71-1c3d-4c7d-94d8-375da4657cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:46.449286 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a129bf71-1c3d-4c7d-94d8-375da4657cd6 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:46.449764 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a129bf71-1c3d-4c7d-94d8-375da4657cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:46.450255 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a129bf71-1c3d-4c7d-94d8-375da4657cd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:46.477231 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a129bf71-1c3d-4c7d-94d8-375da4657cd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:46.479270 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a129bf71-1c3d-4c7d-94d8-375da4657cd6 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:46.513989 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-a129bf71-1c3d-4c7d-94d8-375da4657cd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:46.513989 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:46.513989 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:46.513989 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:46.513989 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:46.513989 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:46.513989 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:46.513989 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:46.513989 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:46.513989 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:46.513989 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:46.513989 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:46.513989 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:14:46.513989 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:14:46.513989 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:14:46.513989 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:14:46.515014 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:46.515014 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:46.515014 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:46.515014 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:46.515014 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:46.515014 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:46.515014 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:46.515014 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:46.515014 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:46.515014 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:46.515014 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:46.515014 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:46.515014 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:46.515014 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:46.515014 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:46.515014 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:46.515014 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:14:46.516004 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:14:46.516004 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:46.516004 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:14:46.523085 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 311/618] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:14:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 454 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:46.527512 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306c633-3795-457f-b260-c33be67c4c06 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:46.532698 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a129bf71-1c3d-4c7d-94d8-375da4657cd6 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:46.658770 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d466bb7-2fcb-4173-91bc-bfe1aecd5044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:46.659862 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d466bb7-2fcb-4173-91bc-bfe1aecd5044 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:46.670692 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d466bb7-2fcb-4173-91bc-bfe1aecd5044 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:46.671188 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d466bb7-2fcb-4173-91bc-bfe1aecd5044 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:46.699019 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d466bb7-2fcb-4173-91bc-bfe1aecd5044 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:46.701716 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d466bb7-2fcb-4173-91bc-bfe1aecd5044 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:46.721552 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-9d466bb7-2fcb-4173-91bc-bfe1aecd5044 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 30 04:14:46.721552 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:46.721552 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:46.721552 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:46.721552 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:46.721552 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:46.721552 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:46.721552 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:46.721552 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:46.721552 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:46.721552 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:46.721552 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:46.721552 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:14:46.721552 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:14:46.721552 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:14:46.721552 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:14:46.723400 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:46.723400 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:46.723400 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:14:46.723400 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:14:46.723400 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:14:46.723400 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:14:46.723400 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:46.723400 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:46.723400 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:46.723400 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:46.723400 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:46.723400 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:46.723400 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:46.723400 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:46.723400 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:46.723400 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:46.723400 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:46.723400 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:46.725289 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:46.725289 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:46.725289 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:14:46.725289 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:14:46.725289 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:14:46.725289 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:14:46.725289 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:14:46.725289 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:14:46.725289 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 30 04:14:46.725289 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:14:46.725289 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 308/619] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 30 04:14:46 2022] GET /identity/v3/users/glance => generated 84 bytes in 466 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:46.729373 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d466bb7-2fcb-4173-91bc-bfe1aecd5044 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:46.775983 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:46.792599 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a129bf71-1c3d-4c7d-94d8-375da4657cd6 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:46.836712 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5784502a-3913-4504-83e7-f6bcc6362612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:46.837337 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5784502a-3913-4504-83e7-f6bcc6362612 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:46.837622 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5784502a-3913-4504-83e7-f6bcc6362612 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:46.838358 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5784502a-3913-4504-83e7-f6bcc6362612 None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:46.838708 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5784502a-3913-4504-83e7-f6bcc6362612 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:46.839048 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5784502a-3913-4504-83e7-f6bcc6362612 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:46.841371 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5784502a-3913-4504-83e7-f6bcc6362612 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:46.856492 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 312/620] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:14:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:14:46.862175 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5784502a-3913-4504-83e7-f6bcc6362612 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:46.958953 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:46.964439 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d466bb7-2fcb-4173-91bc-bfe1aecd5044 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:47.011335 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae91744a-e989-4ab6-a820-181e84289adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:47.012952 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91744a-e989-4ab6-a820-181e84289adf None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:47.013783 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91744a-e989-4ab6-a820-181e84289adf None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:47.014244 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91744a-e989-4ab6-a820-181e84289adf None admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:47.015630 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae91744a-e989-4ab6-a820-181e84289adf None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:47.016177 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae91744a-e989-4ab6-a820-181e84289adf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:47.019196 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae91744a-e989-4ab6-a820-181e84289adf None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:47.061136 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 309/621] 10.222.0.91 () {56 vars in 1137 bytes} [Tue Aug 30 04:14:46 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:47.063022 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dab886-4634-4d7a-92c2-c2645a351ff9 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:47.063375 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dab886-4634-4d7a-92c2-c2645a351ff9 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:47.063686 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dab886-4634-4d7a-92c2-c2645a351ff9 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:47.068249 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 310/622] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:14:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:14:47.069860 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dab886-4634-4d7a-92c2-c2645a351ff9 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:47.090954 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5784502a-3913-4504-83e7-f6bcc6362612 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:47.138757 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6455280b-636c-4a2d-b254-c37f00d3d875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:47.139422 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455280b-636c-4a2d-b254-c37f00d3d875 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:47.139708 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455280b-636c-4a2d-b254-c37f00d3d875 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:47.140061 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455280b-636c-4a2d-b254-c37f00d3d875 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:47.156113 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6455280b-636c-4a2d-b254-c37f00d3d875 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:47.158885 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6455280b-636c-4a2d-b254-c37f00d3d875 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:47.189982 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-6455280b-636c-4a2d-b254-c37f00d3d875 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 04:14:47.189982 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:47.189982 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:47.189982 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:47.189982 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:47.189982 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:47.189982 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:47.189982 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:47.189982 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:47.189982 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:47.189982 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:47.189982 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:47.189982 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:14:47.189982 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:14:47.189982 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:14:47.189982 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:14:47.193438 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:47.193438 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:47.193438 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:14:47.193438 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:14:47.193438 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:14:47.193438 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:14:47.193438 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:47.193438 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:47.193438 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:47.193438 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:47.193438 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:47.193438 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:47.193438 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:47.193438 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:47.193438 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:47.193438 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:47.193438 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:47.193438 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:47.196936 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:47.196936 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:47.196936 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:14:47.196936 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:14:47.196936 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:14:47.196936 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:14:47.196936 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:14:47.196936 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:14:47.196936 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 04:14:47.196936 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:14:47.196936 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 313/623] 10.222.0.91 () {56 vars in 1096 bytes} [Tue Aug 30 04:14:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:47.196936 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94391de3-5e72-4b30-bda1-78899136be6c None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:47.210259 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94391de3-5e72-4b30-bda1-78899136be6c None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:47.210259 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94391de3-5e72-4b30-bda1-78899136be6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:47.228321 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-94391de3-5e72-4b30-bda1-78899136be6c None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:47.230294 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-94391de3-5e72-4b30-bda1-78899136be6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:47.240348 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dab886-4634-4d7a-92c2-c2645a351ff9 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:47.241327 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:47.283433 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1597501-b0d4-45c3-a95a-5dfb648d35c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:47.284009 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1597501-b0d4-45c3-a95a-5dfb648d35c9 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:47.284353 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1597501-b0d4-45c3-a95a-5dfb648d35c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:47.284605 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1597501-b0d4-45c3-a95a-5dfb648d35c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:47.324170 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:47.331988 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 314/624] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:14:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:14:47.331988 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94391de3-5e72-4b30-bda1-78899136be6c None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:47.427626 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1597501-b0d4-45c3-a95a-5dfb648d35c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:47.429171 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1597501-b0d4-45c3-a95a-5dfb648d35c9 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:47.575161 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 311/625] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 30 04:14:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:47.583382 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1597501-b0d4-45c3-a95a-5dfb648d35c9 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:47.631649 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94391de3-5e72-4b30-bda1-78899136be6c None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:47.660327 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:47.713017 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1597501-b0d4-45c3-a95a-5dfb648d35c9 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:47.717347 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a4331-ab4c-4937-9b5f-f0b200913ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:47.718288 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a4331-ab4c-4937-9b5f-f0b200913ff7 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:47.718703 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a4331-ab4c-4937-9b5f-f0b200913ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:47.719113 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a4331-ab4c-4937-9b5f-f0b200913ff7 None admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:47.720298 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5a4331-ab4c-4937-9b5f-f0b200913ff7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:47.720754 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5a4331-ab4c-4937-9b5f-f0b200913ff7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:47.723360 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5a4331-ab4c-4937-9b5f-f0b200913ff7 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:47.751254 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:47.754933 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa842ec9-993a-4702-aa1a-ceac0a9a43d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:47.755629 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa842ec9-993a-4702-aa1a-ceac0a9a43d3 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:47.755942 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa842ec9-993a-4702-aa1a-ceac0a9a43d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:47.756462 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa842ec9-993a-4702-aa1a-ceac0a9a43d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:47.760095 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 315/626] 10.222.0.91 () {56 vars in 1135 bytes} [Tue Aug 30 04:14:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 432 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:47.762135 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40930592-5ac1-4f25-a087-2749e65b0e0c None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:47.762473 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40930592-5ac1-4f25-a087-2749e65b0e0c None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:47.762704 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40930592-5ac1-4f25-a087-2749e65b0e0c None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:47.764290 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 316/627] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:14:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:14:47.764788 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40930592-5ac1-4f25-a087-2749e65b0e0c None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:47.779969 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa842ec9-993a-4702-aa1a-ceac0a9a43d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:47.779969 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa842ec9-993a-4702-aa1a-ceac0a9a43d3 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:47.795302 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-aa842ec9-993a-4702-aa1a-ceac0a9a43d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:47.795302 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:47.795302 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:47.795302 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:47.795302 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:47.795302 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:47.795302 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:47.795302 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:47.795302 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:47.795302 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:47.795302 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:47.795302 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:47.795302 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:14:47.795302 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:14:47.795302 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:14:47.795302 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:14:47.797071 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:47.797071 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:47.797071 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:47.797071 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:47.797071 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:47.797071 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:47.797071 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:47.797071 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:47.797071 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:47.797071 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:47.797071 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:47.797071 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:47.797071 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:47.797071 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:47.797071 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:47.797071 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:47.797071 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:14:47.798547 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:14:47.798547 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:47.798547 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:14:47.798547 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 312/628] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:14:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:14:47.798547 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa842ec9-993a-4702-aa1a-ceac0a9a43d3 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:47.922474 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40930592-5ac1-4f25-a087-2749e65b0e0c None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:47.968638 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa842ec9-993a-4702-aa1a-ceac0a9a43d3 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:47.971329 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a449d4-488a-4308-89b9-ff2db3fac7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:47.972414 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a449d4-488a-4308-89b9-ff2db3fac7b3 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:47.972843 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a449d4-488a-4308-89b9-ff2db3fac7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:47.973382 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a449d4-488a-4308-89b9-ff2db3fac7b3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:47.987670 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a449d4-488a-4308-89b9-ff2db3fac7b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:14:47.988259 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:47.994892 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-b6a449d4-488a-4308-89b9-ff2db3fac7b3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:14:47.994892 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:47.994892 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:47.994892 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:47.994892 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:47.994892 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:47.994892 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:47.994892 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:47.994892 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:47.994892 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:47.994892 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:47.994892 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:47.994892 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:14:47.994892 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:14:47.994892 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:14:47.994892 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:14:47.997230 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:14:47.997230 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:14:47.997230 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:14:47.997230 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:14:47.997230 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:47.997230 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:47.997230 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:47.997230 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:47.997230 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:47.997230 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:47.997230 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:47.997230 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:47.997230 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:47.997230 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:47.997230 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:47.997230 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:47.998830 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:47.998830 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:47.998830 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:47.998830 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:47.998830 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:14:47.998830 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:14:47.998830 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:14:47.998830 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:14:47.998830 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:14:47.998830 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:14:47.998830 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:14:47.998830 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:14:47.998830 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 317/629] 10.222.0.91 () {56 vars in 1102 bytes} [Tue Aug 30 04:14:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:47.998830 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4e25d-f5b3-4f3a-b519-6c82367d3e74 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:48.001390 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4e25d-f5b3-4f3a-b519-6c82367d3e74 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:48.001390 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4e25d-f5b3-4f3a-b519-6c82367d3e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:48.019616 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-02e4e25d-f5b3-4f3a-b519-6c82367d3e74 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:48.020892 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-02e4e25d-f5b3-4f3a-b519-6c82367d3e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:48.032709 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad4b582-8ccb-49ac-a125-5fff5b2dae42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:48.033368 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4b582-8ccb-49ac-a125-5fff5b2dae42 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:48.033649 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4b582-8ccb-49ac-a125-5fff5b2dae42 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:48.033920 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4b582-8ccb-49ac-a125-5fff5b2dae42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:48.048377 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad4b582-8ccb-49ac-a125-5fff5b2dae42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:48.051129 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad4b582-8ccb-49ac-a125-5fff5b2dae42 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:48.078726 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-9ad4b582-8ccb-49ac-a125-5fff5b2dae42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:48.078726 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:48.078726 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:48.078726 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:48.078726 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:48.078726 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:48.078726 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:48.078726 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:48.078726 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:48.078726 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:48.078726 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:48.078726 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:48.078726 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:14:48.078726 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:14:48.078726 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:14:48.078726 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:14:48.079790 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:48.079790 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:48.079790 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:48.079790 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:48.079790 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:48.079790 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:48.079790 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:48.079790 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:48.079790 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:48.079790 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:48.079790 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:48.079790 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:48.079790 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:48.079790 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:48.079790 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:48.079790 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:48.079790 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:14:48.080743 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:14:48.080743 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:48.080743 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:14:48.080743 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 313/630] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:14:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:48.082271 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad4b582-8ccb-49ac-a125-5fff5b2dae42 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:48.101845 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:48.123961 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 318/631] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:14:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:14:48.123961 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e4e25d-f5b3-4f3a-b519-6c82367d3e74 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:48.271512 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e4e25d-f5b3-4f3a-b519-6c82367d3e74 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:48.296460 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad4b582-8ccb-49ac-a125-5fff5b2dae42 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:48.320209 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56a6ce-c26c-446f-8c24-c28491ab9db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:48.320957 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56a6ce-c26c-446f-8c24-c28491ab9db2 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:48.321303 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56a6ce-c26c-446f-8c24-c28491ab9db2 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:48.321817 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56a6ce-c26c-446f-8c24-c28491ab9db2 None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:48.322876 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a56a6ce-c26c-446f-8c24-c28491ab9db2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:48.323250 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a56a6ce-c26c-446f-8c24-c28491ab9db2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:48.324815 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a56a6ce-c26c-446f-8c24-c28491ab9db2 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:48.336838 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 319/632] 10.222.0.91 () {56 vars in 1103 bytes} [Tue Aug 30 04:14:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:48.337998 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56a6ce-c26c-446f-8c24-c28491ab9db2 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:48.366429 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754d9af-372c-48b7-85a2-85ec2e565c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:48.367588 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754d9af-372c-48b7-85a2-85ec2e565c51 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:48.368249 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754d9af-372c-48b7-85a2-85ec2e565c51 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:48.368853 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754d9af-372c-48b7-85a2-85ec2e565c51 None admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:48.370769 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8754d9af-372c-48b7-85a2-85ec2e565c51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:48.371420 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8754d9af-372c-48b7-85a2-85ec2e565c51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:48.374269 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8754d9af-372c-48b7-85a2-85ec2e565c51 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:48.397293 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 314/633] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:14:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:48.398830 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754d9af-372c-48b7-85a2-85ec2e565c51 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:48.409311 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:48.443186 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:48.472495 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56a6ce-c26c-446f-8c24-c28491ab9db2 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:48.520315 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cb7ea8-0037-4c0d-a71c-b7c78ac284eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:48.520949 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb7ea8-0037-4c0d-a71c-b7c78ac284eb None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:48.521252 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb7ea8-0037-4c0d-a71c-b7c78ac284eb None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:48.521619 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb7ea8-0037-4c0d-a71c-b7c78ac284eb None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:48.522168 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cb7ea8-0037-4c0d-a71c-b7c78ac284eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:48.522470 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cb7ea8-0037-4c0d-a71c-b7c78ac284eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:48.524162 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cb7ea8-0037-4c0d-a71c-b7c78ac284eb None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:48.549075 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 320/634] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:14:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:48.549075 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cb7ea8-0037-4c0d-a71c-b7c78ac284eb None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:48.586463 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754d9af-372c-48b7-85a2-85ec2e565c51 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:48.645017 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097c6340-7bd7-4c3a-81ab-d8b23aa6f91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:48.646048 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c6340-7bd7-4c3a-81ab-d8b23aa6f91a None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:48.646485 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c6340-7bd7-4c3a-81ab-d8b23aa6f91a None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:48.646925 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c6340-7bd7-4c3a-81ab-d8b23aa6f91a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:48.661640 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097c6340-7bd7-4c3a-81ab-d8b23aa6f91a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:48.663744 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097c6340-7bd7-4c3a-81ab-d8b23aa6f91a None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:48.683638 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-097c6340-7bd7-4c3a-81ab-d8b23aa6f91a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:48.683638 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:48.683638 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:48.683638 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:48.683638 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:48.683638 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:48.683638 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:48.683638 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:48.683638 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:48.683638 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:48.683638 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:48.683638 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:48.683638 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:14:48.683638 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:14:48.683638 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:14:48.683638 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:14:48.684785 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:48.684785 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:48.684785 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:48.684785 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:48.684785 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:48.684785 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:48.684785 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:48.684785 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:48.684785 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:48.684785 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:48.684785 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:48.684785 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:48.684785 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:48.684785 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:48.684785 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:48.684785 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:48.684785 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:14:48.685754 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:14:48.685754 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:48.685754 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:14:48.685754 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 315/635] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:14:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:48.686226 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097c6340-7bd7-4c3a-81ab-d8b23aa6f91a None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:48.718183 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cb7ea8-0037-4c0d-a71c-b7c78ac284eb None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:48.737909 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:48.767057 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57cf308-6b04-474c-abca-d802f942f481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:48.768224 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57cf308-6b04-474c-abca-d802f942f481 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:48.768690 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57cf308-6b04-474c-abca-d802f942f481 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:48.769183 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57cf308-6b04-474c-abca-d802f942f481 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:48.781414 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57cf308-6b04-474c-abca-d802f942f481 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:48.783550 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57cf308-6b04-474c-abca-d802f942f481 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:48.790582 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:48.803898 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-c57cf308-6b04-474c-abca-d802f942f481 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:14:48.803898 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:48.803898 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:48.803898 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:48.803898 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:48.803898 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:48.803898 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:48.803898 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:48.803898 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:48.803898 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:48.803898 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:48.803898 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:48.803898 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:14:48.803898 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:14:48.803898 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:14:48.805747 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:14:48.805747 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:48.805747 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:48.805747 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:48.805747 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:48.805747 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:48.805747 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:48.805747 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:48.805747 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:48.805747 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:48.805747 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:48.805747 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:48.805747 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:48.805747 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:48.805747 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:48.805747 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:48.805747 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:48.808151 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:14:48.808151 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:14:48.808151 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:14:48.808151 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:14:48.808151 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:14:48.808151 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:14:48.808151 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:14:48.808151 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:14:48.808151 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 321/636] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 30 04:14:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:48.808151 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57cf308-6b04-474c-abca-d802f942f481 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:48.860036 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097c6340-7bd7-4c3a-81ab-d8b23aa6f91a None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:48.902968 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb7b90-65d2-491d-9763-4eda0e9acccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:48.903625 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb7b90-65d2-491d-9763-4eda0e9acccb None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:48.903891 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb7b90-65d2-491d-9763-4eda0e9acccb None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:48.904198 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb7b90-65d2-491d-9763-4eda0e9acccb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:48.916799 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fb7b90-65d2-491d-9763-4eda0e9acccb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:14:48.922751 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-f6fb7b90-65d2-491d-9763-4eda0e9acccb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:14:48.922751 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:48.922751 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:48.922751 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:48.922751 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:48.922751 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:48.922751 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:48.922751 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:48.922751 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:48.922751 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:48.922751 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:48.922751 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:48.922751 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:14:48.922751 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:14:48.922751 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:14:48.922751 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:14:48.923972 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:14:48.923972 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:14:48.923972 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:14:48.923972 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:14:48.923972 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:48.923972 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:48.923972 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:48.923972 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:48.923972 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:48.923972 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:48.923972 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:48.923972 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:48.923972 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:48.923972 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:48.923972 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:48.923972 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:48.924839 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:48.924839 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:48.924839 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:48.924839 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:48.924839 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:14:48.924839 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:14:48.924839 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:14:48.924839 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:14:48.924839 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:14:48.924839 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:14:48.924839 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:14:48.924839 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:14:48.928776 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 316/637] 10.222.0.91 () {56 vars in 1102 bytes} [Tue Aug 30 04:14:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:48.929763 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb7b90-65d2-491d-9763-4eda0e9acccb None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:48.974405 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57cf308-6b04-474c-abca-d802f942f481 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:49.040116 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1878fe7c-1d9a-462f-931e-9c6ee530a2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:49.041221 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878fe7c-1d9a-462f-931e-9c6ee530a2aa None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:49.041697 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878fe7c-1d9a-462f-931e-9c6ee530a2aa None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:49.042195 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878fe7c-1d9a-462f-931e-9c6ee530a2aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:49.053107 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb7b90-65d2-491d-9763-4eda0e9acccb None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:49.056057 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1878fe7c-1d9a-462f-931e-9c6ee530a2aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:49.059799 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1878fe7c-1d9a-462f-931e-9c6ee530a2aa None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:49.081294 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-1878fe7c-1d9a-462f-931e-9c6ee530a2aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:14:49.081294 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:49.081294 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:49.081294 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:49.081294 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:49.081294 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:49.081294 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:49.081294 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:49.081294 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:49.081294 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:49.081294 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:49.081294 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:49.081294 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:14:49.081294 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:14:49.081294 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:14:49.082594 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:14:49.082594 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:49.082594 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:49.082594 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:49.082594 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:49.082594 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:49.082594 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:49.082594 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:49.082594 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:49.082594 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:49.082594 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:49.082594 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:49.082594 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:49.082594 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:49.082594 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:49.082594 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:49.082594 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:49.083511 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:14:49.083511 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:14:49.083511 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:14:49.083511 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:14:49.083511 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:14:49.083511 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:14:49.083511 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:14:49.083511 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:14:49.083511 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 322/638] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 30 04:14:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:49.084964 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1878fe7c-1d9a-462f-931e-9c6ee530a2aa None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:49.088990 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:49.095491 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d90efc0-4a1e-4419-90d1-f23856a2c578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:49.096155 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90efc0-4a1e-4419-90d1-f23856a2c578 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:49.096432 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90efc0-4a1e-4419-90d1-f23856a2c578 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:49.096700 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90efc0-4a1e-4419-90d1-f23856a2c578 None admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:49.097361 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d90efc0-4a1e-4419-90d1-f23856a2c578 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:49.097730 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d90efc0-4a1e-4419-90d1-f23856a2c578 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:49.099184 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d90efc0-4a1e-4419-90d1-f23856a2c578 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:49.112961 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 317/639] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:14:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:49.113866 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d90efc0-4a1e-4419-90d1-f23856a2c578 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:49.138245 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:49.232590 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d90efc0-4a1e-4419-90d1-f23856a2c578 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:49.244810 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1878fe7c-1d9a-462f-931e-9c6ee530a2aa None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:49.274659 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a0417a-43d6-453f-9e4b-dc92024f78c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:49.275694 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0417a-43d6-453f-9e4b-dc92024f78c6 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:49.276210 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0417a-43d6-453f-9e4b-dc92024f78c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:49.276654 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0417a-43d6-453f-9e4b-dc92024f78c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:49.277899 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a0417a-43d6-453f-9e4b-dc92024f78c6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:49.278426 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a0417a-43d6-453f-9e4b-dc92024f78c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:49.280719 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a0417a-43d6-453f-9e4b-dc92024f78c6 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:49.296068 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 318/640] 10.222.0.91 () {56 vars in 1103 bytes} [Tue Aug 30 04:14:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:49.298160 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e6d3c-fac7-4762-9488-51c07b0a84f0 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:49.298755 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e6d3c-fac7-4762-9488-51c07b0a84f0 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:49.299272 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e6d3c-fac7-4762-9488-51c07b0a84f0 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:49.301937 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 319/641] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:14:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:14:49.303038 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29e6d3c-fac7-4762-9488-51c07b0a84f0 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:49.306827 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca26fd91-05ee-443f-bc84-0a66b9a244ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:49.307896 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca26fd91-05ee-443f-bc84-0a66b9a244ef None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:49.308403 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca26fd91-05ee-443f-bc84-0a66b9a244ef None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:49.308884 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca26fd91-05ee-443f-bc84-0a66b9a244ef None admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:49.310162 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca26fd91-05ee-443f-bc84-0a66b9a244ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:49.310664 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca26fd91-05ee-443f-bc84-0a66b9a244ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:49.313313 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca26fd91-05ee-443f-bc84-0a66b9a244ef None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:49.335054 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 323/642] 10.222.0.91 () {56 vars in 1148 bytes} [Tue Aug 30 04:14:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:49.336617 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca26fd91-05ee-443f-bc84-0a66b9a244ef None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:49.389070 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:49.456032 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29e6d3c-fac7-4762-9488-51c07b0a84f0 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:49.458648 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:49.470886 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca26fd91-05ee-443f-bc84-0a66b9a244ef None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:49.495478 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dcc7fe-eb6f-4d1c-8418-512d728d531f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:49.496127 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dcc7fe-eb6f-4d1c-8418-512d728d531f None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:49.496396 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dcc7fe-eb6f-4d1c-8418-512d728d531f None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:49.496660 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dcc7fe-eb6f-4d1c-8418-512d728d531f None admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:49.497347 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dcc7fe-eb6f-4d1c-8418-512d728d531f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:49.497643 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dcc7fe-eb6f-4d1c-8418-512d728d531f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:49.499108 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dcc7fe-eb6f-4d1c-8418-512d728d531f None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:49.511118 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d19b154-bcd9-4762-a6c8-21792bf581d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:49.511770 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19b154-bcd9-4762-a6c8-21792bf581d3 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:49.512092 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19b154-bcd9-4762-a6c8-21792bf581d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:49.512362 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19b154-bcd9-4762-a6c8-21792bf581d3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:49.514215 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 320/643] 10.222.0.91 () {56 vars in 1148 bytes} [Tue Aug 30 04:14:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:49.515281 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dcc7fe-eb6f-4d1c-8418-512d728d531f None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:49.520578 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d19b154-bcd9-4762-a6c8-21792bf581d3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:49.522063 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d19b154-bcd9-4762-a6c8-21792bf581d3 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:49.535659 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-2d19b154-bcd9-4762-a6c8-21792bf581d3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 04:14:49.535659 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:49.535659 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:49.535659 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:49.535659 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:49.535659 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:49.535659 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:49.535659 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:49.535659 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:49.535659 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:49.535659 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:49.535659 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:49.535659 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:14:49.535659 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:14:49.535659 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:14:49.535659 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:14:49.545804 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:49.545804 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:49.545804 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:14:49.545804 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:14:49.545804 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:14:49.545804 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:14:49.545804 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:49.545804 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:49.545804 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:49.545804 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:49.545804 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:49.545804 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:49.545804 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:49.545804 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:49.545804 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:49.545804 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:49.545804 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:49.545804 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:49.547548 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:49.547548 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:49.547548 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:14:49.547548 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:14:49.547548 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:14:49.547548 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:14:49.547548 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:14:49.547548 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:14:49.547548 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 04:14:49.547548 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:14:49.547548 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 324/644] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 30 04:14:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:49.547548 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e50a55-d35f-4599-8bd7-d7ee1f350023 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:49.547548 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e50a55-d35f-4599-8bd7-d7ee1f350023 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:49.549862 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e50a55-d35f-4599-8bd7-d7ee1f350023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:49.571491 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-07e50a55-d35f-4599-8bd7-d7ee1f350023 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:49.573698 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-07e50a55-d35f-4599-8bd7-d7ee1f350023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:49.658880 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dcc7fe-eb6f-4d1c-8418-512d728d531f None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:49.664458 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 325/645] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:14:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:14:49.665805 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e50a55-d35f-4599-8bd7-d7ee1f350023 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:49.680637 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:49.712640 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82796a7a-57c6-46a3-9b51-98599be5d586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:49.713377 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82796a7a-57c6-46a3-9b51-98599be5d586 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:49.713731 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82796a7a-57c6-46a3-9b51-98599be5d586 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:49.714029 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82796a7a-57c6-46a3-9b51-98599be5d586 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:49.733402 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82796a7a-57c6-46a3-9b51-98599be5d586 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:49.735051 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82796a7a-57c6-46a3-9b51-98599be5d586 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:49.752964 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-82796a7a-57c6-46a3-9b51-98599be5d586 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:49.752964 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:49.752964 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:49.752964 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:49.752964 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:49.752964 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:49.752964 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:49.752964 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:49.752964 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:49.752964 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:49.752964 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:49.752964 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:49.752964 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:14:49.752964 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:14:49.752964 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:14:49.752964 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:14:49.754173 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:49.754173 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:49.754173 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:49.754173 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:49.754173 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:49.754173 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:49.754173 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:49.754173 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:49.754173 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:49.754173 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:49.754173 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:49.754173 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:49.754173 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:49.754173 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:49.754173 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:49.754173 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:49.754173 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:14:49.755112 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:14:49.755112 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:49.755112 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:14:49.755112 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 321/646] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:14:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:49.755112 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82796a7a-57c6-46a3-9b51-98599be5d586 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:49.787722 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:49.819940 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e50a55-d35f-4599-8bd7-d7ee1f350023 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:49.867165 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081cd69b-61a2-49c7-8023-5f5e92f2f396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:49.867790 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081cd69b-61a2-49c7-8023-5f5e92f2f396 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:49.868103 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081cd69b-61a2-49c7-8023-5f5e92f2f396 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:49.868382 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081cd69b-61a2-49c7-8023-5f5e92f2f396 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:49.869179 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081cd69b-61a2-49c7-8023-5f5e92f2f396 None admin] RBAC: Adding query filter params (role.id=c3eef5523b7a407082ffaa23a9753410, scope.project.id=4e05769361674c8fa995050150ad4cfa, user.id=2af2e1344bc54bf388e5ec025ab94c2d) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:49.869490 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081cd69b-61a2-49c7-8023-5f5e92f2f396 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:49.871071 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081cd69b-61a2-49c7-8023-5f5e92f2f396 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:49.878201 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 326/647] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 30 04:14:49 2022] GET /identity/v3/role_assignments?user.id=2af2e1344bc54bf388e5ec025ab94c2d&scope.project.id=4e05769361674c8fa995050150ad4cfa&role.id=c3eef5523b7a407082ffaa23a9753410 => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:49.879101 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081cd69b-61a2-49c7-8023-5f5e92f2f396 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:49.926893 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82796a7a-57c6-46a3-9b51-98599be5d586 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:49.995880 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ab3c9-9792-4934-bd99-1fa0fae0b88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:49.997472 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ab3c9-9792-4934-bd99-1fa0fae0b88a None admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:49.998195 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ab3c9-9792-4934-bd99-1fa0fae0b88a None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:49.998876 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ab3c9-9792-4934-bd99-1fa0fae0b88a None admin] PATH_INFO: `/v3/projects/4e05769361674c8fa995050150ad4cfa/users/94b50f9552124b07822ae63c1d553864/roles/c3eef5523b7a407082ffaa23a9753410` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:50.025646 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2ab3c9-9792-4934-bd99-1fa0fae0b88a None admin] RBAC: Authorizing `identity:create_grant(project_id=4e05769361674c8fa995050150ad4cfa, user_id=94b50f9552124b07822ae63c1d553864, role_id=c3eef5523b7a407082ffaa23a9753410)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:50.028862 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2ab3c9-9792-4934-bd99-1fa0fae0b88a None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:50.054187 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 322/648] 10.222.0.91 () {58 vars in 1439 bytes} [Tue Aug 30 04:14:49 2022] PUT /identity/v3/projects/4e05769361674c8fa995050150ad4cfa/users/94b50f9552124b07822ae63c1d553864/roles/c3eef5523b7a407082ffaa23a9753410 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:50.056351 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ab3c9-9792-4934-bd99-1fa0fae0b88a None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:50.091057 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:50.134644 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081cd69b-61a2-49c7-8023-5f5e92f2f396 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:50.219679 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28e194d-872e-426a-bcd9-710b463f66c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:50.221636 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e194d-872e-426a-bcd9-710b463f66c1 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:50.222083 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e194d-872e-426a-bcd9-710b463f66c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:50.222524 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e194d-872e-426a-bcd9-710b463f66c1 None admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:50.223992 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28e194d-872e-426a-bcd9-710b463f66c1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:50.224381 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28e194d-872e-426a-bcd9-710b463f66c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:50.227700 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28e194d-872e-426a-bcd9-710b463f66c1 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:50.271947 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 327/649] 10.222.0.91 () {56 vars in 1137 bytes} [Tue Aug 30 04:14:49 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:50.271947 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28e194d-872e-426a-bcd9-710b463f66c1 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:50.277178 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:50.282326 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ab3c9-9792-4934-bd99-1fa0fae0b88a None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:50.355839 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf8ad93-8697-450c-ba8b-2c4105dce972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:50.357385 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8ad93-8697-450c-ba8b-2c4105dce972 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:50.357848 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8ad93-8697-450c-ba8b-2c4105dce972 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:50.358320 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8ad93-8697-450c-ba8b-2c4105dce972 None admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:50.359195 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf8ad93-8697-450c-ba8b-2c4105dce972 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:50.359692 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf8ad93-8697-450c-ba8b-2c4105dce972 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:50.362207 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf8ad93-8697-450c-ba8b-2c4105dce972 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:50.381293 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 323/650] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:14:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:50.383087 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf8ad93-8697-450c-ba8b-2c4105dce972 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:50.467139 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28e194d-872e-426a-bcd9-710b463f66c1 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:50.528288 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9600d3a4-52c6-4858-81c9-356559244224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:50.530420 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600d3a4-52c6-4858-81c9-356559244224 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:50.530898 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600d3a4-52c6-4858-81c9-356559244224 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:50.531378 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600d3a4-52c6-4858-81c9-356559244224 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:50.545494 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:50.555271 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9600d3a4-52c6-4858-81c9-356559244224 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:14:50.561402 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-9600d3a4-52c6-4858-81c9-356559244224 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:14:50.561402 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:50.561402 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:50.561402 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:50.561402 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:50.561402 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:50.561402 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:50.561402 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:50.561402 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:50.561402 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:50.561402 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:50.561402 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:50.561402 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:14:50.561402 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:14:50.561402 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:14:50.561402 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:14:50.562431 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:14:50.562431 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:14:50.562431 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:14:50.562431 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:14:50.562431 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:50.562431 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:50.562431 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:50.562431 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:50.562431 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:50.562431 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:50.562431 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:50.562431 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:50.562431 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:50.562431 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:50.562431 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:50.562431 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:50.563269 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:50.563269 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:50.563269 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:50.563269 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:50.563269 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:14:50.563269 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:14:50.563269 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:14:50.563269 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:14:50.563269 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:14:50.563269 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:14:50.563269 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:14:50.563269 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:14:50.570934 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 328/651] 10.222.0.91 () {56 vars in 1102 bytes} [Tue Aug 30 04:14:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:50.572374 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9600d3a4-52c6-4858-81c9-356559244224 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:50.600744 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf8ad93-8697-450c-ba8b-2c4105dce972 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:50.655765 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeefd72-0b6d-4b98-b460-5e27a1068100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:50.656560 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeefd72-0b6d-4b98-b460-5e27a1068100 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:50.656837 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeefd72-0b6d-4b98-b460-5e27a1068100 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:50.657102 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeefd72-0b6d-4b98-b460-5e27a1068100 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:50.694508 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:50.747568 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeefd72-0b6d-4b98-b460-5e27a1068100 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:50.749384 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeefd72-0b6d-4b98-b460-5e27a1068100 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:50.785653 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9600d3a4-52c6-4858-81c9-356559244224 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:50.865134 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e326113-49e6-4537-9bfd-3b8fbcbc2c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:50.866172 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e326113-49e6-4537-9bfd-3b8fbcbc2c9e None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:50.866626 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e326113-49e6-4537-9bfd-3b8fbcbc2c9e None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:50.867081 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e326113-49e6-4537-9bfd-3b8fbcbc2c9e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:50.874930 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:50.880427 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e326113-49e6-4537-9bfd-3b8fbcbc2c9e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:50.883372 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e326113-49e6-4537-9bfd-3b8fbcbc2c9e None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:50.913560 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-0e326113-49e6-4537-9bfd-3b8fbcbc2c9e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 04:14:50.913560 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:50.913560 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:50.913560 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:50.913560 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:50.913560 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:50.913560 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:50.913560 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:50.913560 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:50.913560 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:50.913560 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:50.913560 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:50.913560 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:14:50.913560 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:14:50.913560 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:14:50.913560 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:14:50.915619 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:50.915619 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:50.915619 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:14:50.915619 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:14:50.915619 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:14:50.915619 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:14:50.915619 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:50.915619 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:50.915619 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:50.915619 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:50.915619 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:50.915619 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:50.915619 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:50.915619 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:50.915619 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:50.915619 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:50.915619 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:50.915619 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:50.918602 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:50.918602 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:50.918602 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:14:50.918602 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:14:50.918602 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:14:50.918602 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:14:50.918602 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:14:50.918602 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:14:50.918602 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 04:14:50.918602 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:14:50.918602 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 329/652] 10.222.0.91 () {56 vars in 1093 bytes} [Tue Aug 30 04:14:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:50.918602 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e326113-49e6-4537-9bfd-3b8fbcbc2c9e None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:50.940435 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 324/653] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 30 04:14:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:50.942857 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeefd72-0b6d-4b98-b460-5e27a1068100 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:51.160701 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e326113-49e6-4537-9bfd-3b8fbcbc2c9e None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:51.169657 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeefd72-0b6d-4b98-b460-5e27a1068100 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:51.207077 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:51.221812 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e8345-bcd3-4cd9-8b01-4712bcd596f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:51.223164 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e8345-bcd3-4cd9-8b01-4712bcd596f7 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:51.223589 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e8345-bcd3-4cd9-8b01-4712bcd596f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:51.224116 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e8345-bcd3-4cd9-8b01-4712bcd596f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:51.225003 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403e8345-bcd3-4cd9-8b01-4712bcd596f7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:51.225548 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403e8345-bcd3-4cd9-8b01-4712bcd596f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:51.227164 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403e8345-bcd3-4cd9-8b01-4712bcd596f7 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:51.238262 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 330/654] 10.222.0.91 () {56 vars in 1103 bytes} [Tue Aug 30 04:14:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:51.239568 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e8345-bcd3-4cd9-8b01-4712bcd596f7 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:51.246703 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a63f38b-fb4a-4f02-b59f-6ed59525c6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:51.247700 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63f38b-fb4a-4f02-b59f-6ed59525c6ad None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:51.248219 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63f38b-fb4a-4f02-b59f-6ed59525c6ad None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:51.248692 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63f38b-fb4a-4f02-b59f-6ed59525c6ad None admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:51.250057 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a63f38b-fb4a-4f02-b59f-6ed59525c6ad None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:51.250601 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a63f38b-fb4a-4f02-b59f-6ed59525c6ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:51.253527 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a63f38b-fb4a-4f02-b59f-6ed59525c6ad None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:51.297144 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 325/655] 10.222.0.91 () {56 vars in 1133 bytes} [Tue Aug 30 04:14:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:51.297144 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a63f38b-fb4a-4f02-b59f-6ed59525c6ad None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:51.365209 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:51.372601 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e8345-bcd3-4cd9-8b01-4712bcd596f7 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:51.417319 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794868b9-6d0e-4ae0-9055-d2a318affb81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:51.418779 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794868b9-6d0e-4ae0-9055-d2a318affb81 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:51.419333 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794868b9-6d0e-4ae0-9055-d2a318affb81 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:51.419882 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794868b9-6d0e-4ae0-9055-d2a318affb81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:51.433599 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794868b9-6d0e-4ae0-9055-d2a318affb81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:51.435601 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794868b9-6d0e-4ae0-9055-d2a318affb81 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:51.452295 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-794868b9-6d0e-4ae0-9055-d2a318affb81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:51.452295 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:51.452295 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:51.452295 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:51.452295 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:51.452295 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:51.452295 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:51.452295 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:51.452295 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:51.452295 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:51.452295 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:51.452295 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:51.452295 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:14:51.452295 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:14:51.452295 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:14:51.452295 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:14:51.453328 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:51.453328 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:51.453328 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:51.453328 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:51.453328 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:51.453328 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:51.453328 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:51.453328 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:51.453328 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:51.453328 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:51.453328 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:51.453328 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:51.453328 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:51.453328 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:51.453328 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:51.453328 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:51.453328 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:14:51.454225 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:14:51.454225 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:51.454225 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:14:51.456621 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 331/656] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:14:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:51.457909 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794868b9-6d0e-4ae0-9055-d2a318affb81 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:51.501319 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a63f38b-fb4a-4f02-b59f-6ed59525c6ad None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:51.509393 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:51.576909 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dcf7ef-1c28-41a2-a490-2fc468601216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:51.578197 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dcf7ef-1c28-41a2-a490-2fc468601216 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:51.578684 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dcf7ef-1c28-41a2-a490-2fc468601216 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:51.579396 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dcf7ef-1c28-41a2-a490-2fc468601216 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:51.582741 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794868b9-6d0e-4ae0-9055-d2a318affb81 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:51.600962 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dcf7ef-1c28-41a2-a490-2fc468601216 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:51.604758 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dcf7ef-1c28-41a2-a490-2fc468601216 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:51.624149 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2646af1e-fd5b-44dd-9774-495556dfe24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:51.625147 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646af1e-fd5b-44dd-9774-495556dfe24a None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:51.625622 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646af1e-fd5b-44dd-9774-495556dfe24a None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:51.626216 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646af1e-fd5b-44dd-9774-495556dfe24a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:51.644221 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-f2dcf7ef-1c28-41a2-a490-2fc468601216 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:51.644221 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:51.644221 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:51.644221 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:51.644221 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:51.644221 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:51.644221 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:51.644221 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:51.644221 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:51.644221 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:51.644221 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:51.644221 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:51.644221 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:14:51.644221 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:14:51.644221 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:14:51.644221 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:14:51.645276 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:51.645276 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:51.645276 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:51.645276 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:51.645276 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:51.645276 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:51.645276 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:51.645276 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:51.645276 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:51.645276 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:51.645276 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:51.645276 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:51.645276 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:51.645276 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:51.645276 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:51.645276 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:51.645276 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:14:51.646193 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:14:51.646193 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:51.646193 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:14:51.646895 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 326/657] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:14:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:51.648739 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dcf7ef-1c28-41a2-a490-2fc468601216 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:51.766773 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2646af1e-fd5b-44dd-9774-495556dfe24a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:51.769898 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2646af1e-fd5b-44dd-9774-495556dfe24a None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:51.830803 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:51.855621 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:51.866463 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dcf7ef-1c28-41a2-a490-2fc468601216 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:51.937956 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ef63e-33bd-4a0c-a382-2c00f15ad9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:51.939146 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ef63e-33bd-4a0c-a382-2c00f15ad9eb None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:51.939705 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ef63e-33bd-4a0c-a382-2c00f15ad9eb None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:51.940320 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ef63e-33bd-4a0c-a382-2c00f15ad9eb None admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:51.941748 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415ef63e-33bd-4a0c-a382-2c00f15ad9eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:51.942365 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415ef63e-33bd-4a0c-a382-2c00f15ad9eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:51.945196 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415ef63e-33bd-4a0c-a382-2c00f15ad9eb None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:51.973199 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 327/658] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:14:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:51.974929 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ef63e-33bd-4a0c-a382-2c00f15ad9eb None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:51.990031 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 332/659] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 30 04:14:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:51.991798 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2646af1e-fd5b-44dd-9774-495556dfe24a None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:52.195606 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ef63e-33bd-4a0c-a382-2c00f15ad9eb None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:52.210621 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2646af1e-fd5b-44dd-9774-495556dfe24a None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:52.268663 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d96475-4f66-44bd-977e-3610af077abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:52.269922 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d96475-4f66-44bd-977e-3610af077abd None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:52.270524 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d96475-4f66-44bd-977e-3610af077abd None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:52.271122 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d96475-4f66-44bd-977e-3610af077abd None admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:52.272537 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d96475-4f66-44bd-977e-3610af077abd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:52.273302 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d96475-4f66-44bd-977e-3610af077abd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:52.276809 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d96475-4f66-44bd-977e-3610af077abd None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:52.286236 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d88c2-295f-4891-99a9-5ec11e7e8c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:52.287339 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d88c2-295f-4891-99a9-5ec11e7e8c85 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:52.287825 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d88c2-295f-4891-99a9-5ec11e7e8c85 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:52.288361 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d88c2-295f-4891-99a9-5ec11e7e8c85 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:52.303326 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73d88c2-295f-4891-99a9-5ec11e7e8c85 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:52.306187 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73d88c2-295f-4891-99a9-5ec11e7e8c85 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:52.308152 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 328/660] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:14:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:52.309609 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:52.309885 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d96475-4f66-44bd-977e-3610af077abd None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:52.330860 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:52.331620 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-b73d88c2-295f-4891-99a9-5ec11e7e8c85 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:14:52.331620 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:52.331620 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:52.331620 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:52.331620 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:52.331620 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:52.331620 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:52.331620 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:52.331620 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:52.331620 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:52.331620 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:52.331620 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:52.331620 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:14:52.331620 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:14:52.331620 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:14:52.333738 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:14:52.333738 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:52.333738 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:52.333738 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:52.333738 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:52.333738 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:52.333738 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:52.333738 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:52.333738 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:52.333738 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:52.333738 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:52.333738 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:52.333738 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:52.333738 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:52.333738 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:52.333738 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:52.333738 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:52.335803 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:14:52.335803 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:14:52.335803 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:14:52.335803 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:14:52.335803 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:14:52.335803 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:14:52.335803 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:14:52.335803 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:14:52.335803 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 333/661] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 30 04:14:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:52.342596 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d88c2-295f-4891-99a9-5ec11e7e8c85 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:52.520466 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d88c2-295f-4891-99a9-5ec11e7e8c85 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:52.537733 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d96475-4f66-44bd-977e-3610af077abd None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:52.586060 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e56274-18a6-4120-898d-609f2c956c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:52.586881 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e56274-18a6-4120-898d-609f2c956c68 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:52.587687 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e56274-18a6-4120-898d-609f2c956c68 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:52.587980 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e56274-18a6-4120-898d-609f2c956c68 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:52.600008 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e56274-18a6-4120-898d-609f2c956c68 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:52.602369 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b792ecd-bd21-4316-899d-9f78e7df6122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:52.602595 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e56274-18a6-4120-898d-609f2c956c68 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:52.603975 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b792ecd-bd21-4316-899d-9f78e7df6122 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:52.604833 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b792ecd-bd21-4316-899d-9f78e7df6122 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:52.605489 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b792ecd-bd21-4316-899d-9f78e7df6122 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:52.624555 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b792ecd-bd21-4316-899d-9f78e7df6122 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:52.626248 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b792ecd-bd21-4316-899d-9f78e7df6122 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:52.628139 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-38e56274-18a6-4120-898d-609f2c956c68 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 04:14:52.628139 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:52.628139 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:52.628139 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:52.628139 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:52.628139 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:52.628139 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:52.628139 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:52.628139 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:52.628139 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:52.628139 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:52.628139 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:52.628139 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:14:52.628139 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:14:52.628139 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:14:52.628139 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:14:52.629292 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:52.629292 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:52.629292 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:14:52.629292 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:14:52.629292 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:14:52.629292 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:14:52.629292 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:52.629292 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:52.629292 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:52.629292 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:52.629292 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:52.629292 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:52.629292 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:52.629292 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:52.629292 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:52.629292 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:52.629292 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:52.629292 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:52.630324 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:52.630324 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:52.630324 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:14:52.630324 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:14:52.630324 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:14:52.630324 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:14:52.630324 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:14:52.630324 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:14:52.630324 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 04:14:52.630324 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:14:52.630324 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 334/662] 10.222.0.91 () {56 vars in 1102 bytes} [Tue Aug 30 04:14:52 2022] GET /identity/v3/users/neutron => generated 85 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:52.632969 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e56274-18a6-4120-898d-609f2c956c68 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:52.657932 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-8b792ecd-bd21-4316-899d-9f78e7df6122 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:52.657932 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:52.657932 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:52.657932 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:52.657932 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:52.657932 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:52.657932 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:52.657932 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:52.657932 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:52.657932 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:52.657932 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:52.657932 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:52.657932 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:14:52.657932 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:14:52.657932 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:14:52.657932 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:14:52.659811 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:52.659811 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:52.659811 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:52.659811 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:52.659811 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:52.659811 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:52.659811 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:52.659811 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:52.659811 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:52.659811 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:52.659811 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:52.659811 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:52.659811 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:52.659811 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:52.659811 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:52.659811 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:52.659811 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:14:52.662191 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:14:52.662191 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:52.662191 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:14:52.662191 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 329/663] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:14:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:52.662630 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503315d2-b984-4adf-a913-7aac702aa689 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:52.663276 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503315d2-b984-4adf-a913-7aac702aa689 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:52.663699 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503315d2-b984-4adf-a913-7aac702aa689 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:52.665580 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 330/664] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:14:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:14:52.666681 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503315d2-b984-4adf-a913-7aac702aa689 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:52.755561 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:52.764387 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:52.830880 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503315d2-b984-4adf-a913-7aac702aa689 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:52.844806 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e56274-18a6-4120-898d-609f2c956c68 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:52.887585 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3da2ba-8c81-4ffd-b811-44664f4260d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:52.888682 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3da2ba-8c81-4ffd-b811-44664f4260d5 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:52.889101 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3da2ba-8c81-4ffd-b811-44664f4260d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:52.889939 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3da2ba-8c81-4ffd-b811-44664f4260d5 None admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:52.891049 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3da2ba-8c81-4ffd-b811-44664f4260d5 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:52.891532 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3da2ba-8c81-4ffd-b811-44664f4260d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:52.893802 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3da2ba-8c81-4ffd-b811-44664f4260d5 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:52.912015 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a08bb19-0651-4b8c-ba22-3d7c56a568d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:52.913028 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08bb19-0651-4b8c-ba22-3d7c56a568d6 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:52.913487 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08bb19-0651-4b8c-ba22-3d7c56a568d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:52.913920 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08bb19-0651-4b8c-ba22-3d7c56a568d6 None admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:52.915113 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a08bb19-0651-4b8c-ba22-3d7c56a568d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:52.915587 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a08bb19-0651-4b8c-ba22-3d7c56a568d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:52.918604 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a08bb19-0651-4b8c-ba22-3d7c56a568d6 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:52.935302 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 331/665] 10.222.0.91 () {56 vars in 1139 bytes} [Tue Aug 30 04:14:52 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:52.935302 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3da2ba-8c81-4ffd-b811-44664f4260d5 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:52.945956 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 335/666] 10.222.0.91 () {56 vars in 1148 bytes} [Tue Aug 30 04:14:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:52.952005 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2788cd4-0306-4a38-93c9-8feb823a33a0 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:52.952005 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2788cd4-0306-4a38-93c9-8feb823a33a0 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:52.952005 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2788cd4-0306-4a38-93c9-8feb823a33a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:52.980846 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-e2788cd4-0306-4a38-93c9-8feb823a33a0 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:52.982446 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-e2788cd4-0306-4a38-93c9-8feb823a33a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:53.092256 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 336/667] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:14:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:14:53.092256 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2788cd4-0306-4a38-93c9-8feb823a33a0 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:53.101124 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3da2ba-8c81-4ffd-b811-44664f4260d5 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:53.125377 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:53.151618 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619346da-3ea7-4506-90f4-524eb31f4993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:53.152373 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619346da-3ea7-4506-90f4-524eb31f4993 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:53.152804 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619346da-3ea7-4506-90f4-524eb31f4993 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:53.153233 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619346da-3ea7-4506-90f4-524eb31f4993 None admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:53.153961 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619346da-3ea7-4506-90f4-524eb31f4993 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:53.154323 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619346da-3ea7-4506-90f4-524eb31f4993 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:53.155989 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619346da-3ea7-4506-90f4-524eb31f4993 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:53.163068 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:53.177767 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 332/668] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:14:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:53.177767 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619346da-3ea7-4506-90f4-524eb31f4993 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:53.235094 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2788cd4-0306-4a38-93c9-8feb823a33a0 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:53.300309 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6436dd27-978b-4fae-8832-340ddd880e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:53.301494 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436dd27-978b-4fae-8832-340ddd880e94 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:53.301995 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436dd27-978b-4fae-8832-340ddd880e94 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:53.302483 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436dd27-978b-4fae-8832-340ddd880e94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:53.348440 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619346da-3ea7-4506-90f4-524eb31f4993 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:53.395552 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b43c9a-ed84-475f-ad74-7ec2b786eaa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:53.396561 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b43c9a-ed84-475f-ad74-7ec2b786eaa6 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:53.396860 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b43c9a-ed84-475f-ad74-7ec2b786eaa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:53.397118 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b43c9a-ed84-475f-ad74-7ec2b786eaa6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:53.397846 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b43c9a-ed84-475f-ad74-7ec2b786eaa6 None admin] RBAC: Adding query filter params (role.id=c3eef5523b7a407082ffaa23a9753410, scope.project.id=4e05769361674c8fa995050150ad4cfa, user.id=812abdd745f149e6a0166cd9040f28e8) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:53.398151 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b43c9a-ed84-475f-ad74-7ec2b786eaa6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:53.399649 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b43c9a-ed84-475f-ad74-7ec2b786eaa6 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:53.412059 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 333/669] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 30 04:14:53 2022] GET /identity/v3/role_assignments?user.id=812abdd745f149e6a0166cd9040f28e8&scope.project.id=4e05769361674c8fa995050150ad4cfa&role.id=c3eef5523b7a407082ffaa23a9753410 => generated 608 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:53.412059 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173fc4d-389b-43bc-a259-4ac65fab0848 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:53.412059 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173fc4d-389b-43bc-a259-4ac65fab0848 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:53.412059 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173fc4d-389b-43bc-a259-4ac65fab0848 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:53.412059 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 334/670] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:14:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:14:53.412793 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2173fc4d-389b-43bc-a259-4ac65fab0848 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:53.450351 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6436dd27-978b-4fae-8832-340ddd880e94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:53.452376 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6436dd27-978b-4fae-8832-340ddd880e94 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:53.470950 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:53.531851 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:53.553838 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2173fc4d-389b-43bc-a259-4ac65fab0848 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:53.606464 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d29eb8-f73b-477a-99ba-91a12c7c5ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:53.607040 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d29eb8-f73b-477a-99ba-91a12c7c5ba8 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:53.607447 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d29eb8-f73b-477a-99ba-91a12c7c5ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:53.607609 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d29eb8-f73b-477a-99ba-91a12c7c5ba8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:53.612055 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 337/671] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 30 04:14:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:53.612055 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e668af-1b86-477c-b830-536f00d8e0e8 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:53.612055 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e668af-1b86-477c-b830-536f00d8e0e8 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:53.612055 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e668af-1b86-477c-b830-536f00d8e0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:53.624426 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d29eb8-f73b-477a-99ba-91a12c7c5ba8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:53.625939 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d29eb8-f73b-477a-99ba-91a12c7c5ba8 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:53.640106 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-f0e668af-1b86-477c-b830-536f00d8e0e8 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:53.642692 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-f0e668af-1b86-477c-b830-536f00d8e0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:53.642899 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-52d29eb8-f73b-477a-99ba-91a12c7c5ba8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:14:53.642899 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:53.642899 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:53.642899 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:53.642899 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:53.642899 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:53.642899 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:53.642899 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:53.642899 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:53.642899 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:53.642899 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:53.642899 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:53.642899 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:14:53.642899 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:14:53.642899 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:14:53.645975 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:14:53.645975 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:53.645975 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:53.645975 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:53.645975 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:53.645975 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:53.645975 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:53.645975 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:53.645975 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:53.645975 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:53.645975 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:53.645975 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:53.645975 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:53.645975 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:53.645975 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:53.645975 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:53.645975 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:53.647038 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:14:53.647038 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:14:53.647038 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:14:53.647038 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:14:53.647038 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:14:53.647038 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:14:53.647038 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:14:53.647038 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:14:53.647038 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 335/672] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 30 04:14:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:53.647038 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d29eb8-f73b-477a-99ba-91a12c7c5ba8 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:53.756250 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 338/673] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:14:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:14:53.756250 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e668af-1b86-477c-b830-536f00d8e0e8 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:53.811040 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:53.820881 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d29eb8-f73b-477a-99ba-91a12c7c5ba8 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:53.882959 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:53.886343 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4318a6cb-ff26-464c-acd3-692ab4b41ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:53.887845 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318a6cb-ff26-464c-acd3-692ab4b41ee3 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:53.888683 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318a6cb-ff26-464c-acd3-692ab4b41ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:53.889392 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318a6cb-ff26-464c-acd3-692ab4b41ee3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:53.910181 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4318a6cb-ff26-464c-acd3-692ab4b41ee3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:53.913207 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e668af-1b86-477c-b830-536f00d8e0e8 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:53.913770 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4318a6cb-ff26-464c-acd3-692ab4b41ee3 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:53.943010 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-4318a6cb-ff26-464c-acd3-692ab4b41ee3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:53.943010 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:53.943010 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:53.943010 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:53.943010 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:53.943010 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:53.943010 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:53.943010 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:53.943010 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:53.943010 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:53.943010 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:53.943010 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:53.943010 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:14:53.943010 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:14:53.943010 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:14:53.943010 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:14:53.945096 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:53.945096 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:53.945096 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:53.945096 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:53.945096 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:53.945096 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:53.945096 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:53.945096 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:53.945096 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:53.945096 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:53.945096 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:53.945096 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:53.945096 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:53.945096 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:53.945096 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:53.945096 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:53.945096 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:14:53.946820 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:14:53.946820 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:53.946820 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:14:53.956063 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 336/674] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:14:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:53.956063 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4318a6cb-ff26-464c-acd3-692ab4b41ee3 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:53.963364 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655de729-ffe7-46b6-aef3-449f68262faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:53.965264 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655de729-ffe7-46b6-aef3-449f68262faf None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:53.966056 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655de729-ffe7-46b6-aef3-449f68262faf None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:53.966827 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655de729-ffe7-46b6-aef3-449f68262faf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:53.988408 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655de729-ffe7-46b6-aef3-449f68262faf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:53.991859 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655de729-ffe7-46b6-aef3-449f68262faf None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:54.024070 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-655de729-ffe7-46b6-aef3-449f68262faf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:54.024070 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:54.024070 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:54.024070 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:54.024070 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:54.024070 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:54.024070 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:54.024070 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:54.024070 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:54.024070 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:54.024070 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:54.024070 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:54.024070 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:14:54.024070 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:14:54.024070 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:14:54.024070 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:14:54.025961 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:54.025961 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:54.025961 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:54.025961 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:54.025961 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:54.025961 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:54.025961 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:54.025961 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:54.025961 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:54.025961 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:54.025961 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:54.025961 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:54.025961 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:54.025961 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:54.025961 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:54.025961 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:54.025961 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:14:54.027623 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:14:54.027623 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:54.027623 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:14:54.031268 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 339/675] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:14:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:54.032994 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655de729-ffe7-46b6-aef3-449f68262faf None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:54.098166 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4318a6cb-ff26-464c-acd3-692ab4b41ee3 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:54.146373 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760d6aa-178b-4591-9b57-bf32d9c86a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:54.146968 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760d6aa-178b-4591-9b57-bf32d9c86a3f None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:54.147268 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760d6aa-178b-4591-9b57-bf32d9c86a3f None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:54.147527 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760d6aa-178b-4591-9b57-bf32d9c86a3f None admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:54.148593 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f760d6aa-178b-4591-9b57-bf32d9c86a3f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:54.148947 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f760d6aa-178b-4591-9b57-bf32d9c86a3f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:54.151267 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f760d6aa-178b-4591-9b57-bf32d9c86a3f None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:54.169417 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 337/676] 10.222.0.91 () {56 vars in 1148 bytes} [Tue Aug 30 04:14:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:54.170325 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760d6aa-178b-4591-9b57-bf32d9c86a3f None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:54.191564 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:54.229648 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655de729-ffe7-46b6-aef3-449f68262faf None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:54.285360 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:54.299020 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d774a786-02e0-4df7-bfdd-4c989d1f3f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:54.300109 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d774a786-02e0-4df7-bfdd-4c989d1f3f83 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:54.300601 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d774a786-02e0-4df7-bfdd-4c989d1f3f83 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:54.301494 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d774a786-02e0-4df7-bfdd-4c989d1f3f83 None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:54.301975 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d774a786-02e0-4df7-bfdd-4c989d1f3f83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:54.302516 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d774a786-02e0-4df7-bfdd-4c989d1f3f83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:54.305179 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d774a786-02e0-4df7-bfdd-4c989d1f3f83 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:54.306324 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760d6aa-178b-4591-9b57-bf32d9c86a3f None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:54.330707 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 340/677] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:14:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:54.332604 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d774a786-02e0-4df7-bfdd-4c989d1f3f83 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:54.357654 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e639f91-b381-4708-af59-687d72b16267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:54.358378 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e639f91-b381-4708-af59-687d72b16267 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:54.358714 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e639f91-b381-4708-af59-687d72b16267 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:54.359040 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e639f91-b381-4708-af59-687d72b16267 None admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:54.359698 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e639f91-b381-4708-af59-687d72b16267 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:54.360028 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e639f91-b381-4708-af59-687d72b16267 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:54.361487 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e639f91-b381-4708-af59-687d72b16267 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:54.383960 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 338/678] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:14:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:54.383960 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e639f91-b381-4708-af59-687d72b16267 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:54.479225 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:54.524291 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d774a786-02e0-4df7-bfdd-4c989d1f3f83 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:54.534883 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e639f91-b381-4708-af59-687d72b16267 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:54.569183 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f413e2-0fd2-4f00-8ca4-72de701c463d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:54.569866 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f413e2-0fd2-4f00-8ca4-72de701c463d None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:54.570085 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f413e2-0fd2-4f00-8ca4-72de701c463d None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:54.570337 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f413e2-0fd2-4f00-8ca4-72de701c463d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:54.571078 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f413e2-0fd2-4f00-8ca4-72de701c463d None admin] RBAC: Adding query filter params (role.id=c3eef5523b7a407082ffaa23a9753410, scope.project.id=4e05769361674c8fa995050150ad4cfa, user.id=d806295278ae4997b5c6968aa553290c) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:54.571390 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f413e2-0fd2-4f00-8ca4-72de701c463d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:54.573020 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f413e2-0fd2-4f00-8ca4-72de701c463d None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:54.591980 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 341/679] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 30 04:14:54 2022] GET /identity/v3/role_assignments?user.id=d806295278ae4997b5c6968aa553290c&scope.project.id=4e05769361674c8fa995050150ad4cfa&role.id=c3eef5523b7a407082ffaa23a9753410 => generated 608 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:54.591980 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f413e2-0fd2-4f00-8ca4-72de701c463d None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:54.615805 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfa189f-9e62-457d-aeaf-7e691eff8cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:54.616988 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa189f-9e62-457d-aeaf-7e691eff8cb8 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:54.617510 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa189f-9e62-457d-aeaf-7e691eff8cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:54.618040 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa189f-9e62-457d-aeaf-7e691eff8cb8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:54.655785 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfa189f-9e62-457d-aeaf-7e691eff8cb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:14:54.668913 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-9cfa189f-9e62-457d-aeaf-7e691eff8cb8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:14:54.668913 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:54.668913 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:54.668913 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:54.668913 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:54.668913 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:54.668913 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:54.668913 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:54.668913 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:54.668913 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:54.668913 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:54.668913 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:54.668913 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:14:54.668913 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:14:54.668913 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:14:54.668913 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:14:54.670928 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:14:54.670928 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:14:54.670928 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:14:54.670928 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:14:54.670928 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:54.670928 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:54.670928 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:54.670928 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:54.670928 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:54.670928 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:54.670928 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:54.670928 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:54.670928 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:54.670928 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:54.670928 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:54.670928 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:54.673430 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:54.673430 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:54.673430 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:54.673430 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:54.673430 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:14:54.673430 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:14:54.673430 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:14:54.673430 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:14:54.673430 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:14:54.673430 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:14:54.673430 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:14:54.673430 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:14:54.673430 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 339/680] 10.222.0.91 () {56 vars in 1102 bytes} [Tue Aug 30 04:14:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:54.675826 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfa189f-9e62-457d-aeaf-7e691eff8cb8 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:54.709861 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:54.797072 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f413e2-0fd2-4f00-8ca4-72de701c463d None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:54.864738 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8138b288-be22-45c7-9cea-9aba830ad4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:54.865585 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8138b288-be22-45c7-9cea-9aba830ad4b3 None admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:54.866035 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8138b288-be22-45c7-9cea-9aba830ad4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:54.866549 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8138b288-be22-45c7-9cea-9aba830ad4b3 None admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:54.867692 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8138b288-be22-45c7-9cea-9aba830ad4b3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:54.870601 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8138b288-be22-45c7-9cea-9aba830ad4b3 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:54.907239 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 342/681] 10.222.0.91 () {60 vars in 1132 bytes} [Tue Aug 30 04:14:54 2022] POST /identity/v3/users => generated 254 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:14:54.908282 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8138b288-be22-45c7-9cea-9aba830ad4b3 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:54.917439 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfa189f-9e62-457d-aeaf-7e691eff8cb8 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:55.007061 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:55.027288 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b945b8-1895-467f-8fe5-09e0292357e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:55.029098 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b945b8-1895-467f-8fe5-09e0292357e2 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:55.030351 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b945b8-1895-467f-8fe5-09e0292357e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:55.031827 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b945b8-1895-467f-8fe5-09e0292357e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:55.049964 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b945b8-1895-467f-8fe5-09e0292357e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:55.053288 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b945b8-1895-467f-8fe5-09e0292357e2 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:55.079777 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-41b945b8-1895-467f-8fe5-09e0292357e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:14:55.079777 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:55.079777 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:55.079777 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:55.079777 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:55.079777 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:55.079777 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:55.079777 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:55.079777 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:55.079777 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:55.079777 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:55.079777 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:55.079777 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:14:55.079777 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:14:55.079777 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:14:55.081775 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:14:55.081775 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:55.081775 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:55.081775 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:55.081775 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:55.081775 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:55.081775 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:55.081775 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:55.081775 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:55.081775 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:55.081775 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:55.081775 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:55.081775 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:55.081775 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:55.081775 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:55.081775 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:55.081775 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:55.083536 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:14:55.083536 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:14:55.083536 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:14:55.083536 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:14:55.083536 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:14:55.083536 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:14:55.083536 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:14:55.083536 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:14:55.087383 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8138b288-be22-45c7-9cea-9aba830ad4b3 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:55.089590 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 340/682] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 30 04:14:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 416 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:55.100245 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b945b8-1895-467f-8fe5-09e0292357e2 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:55.101284 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:55.155517 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba0766-7b84-4814-9271-78b3f46cd345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:55.156417 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba0766-7b84-4814-9271-78b3f46cd345 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:55.156911 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba0766-7b84-4814-9271-78b3f46cd345 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:55.157382 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba0766-7b84-4814-9271-78b3f46cd345 None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:55.158655 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ba0766-7b84-4814-9271-78b3f46cd345 None admin] RBAC: Adding query filter params (name=service) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:55.159192 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ba0766-7b84-4814-9271-78b3f46cd345 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:55.162031 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ba0766-7b84-4814-9271-78b3f46cd345 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:55.191963 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 343/683] 10.222.0.91 () {56 vars in 1103 bytes} [Tue Aug 30 04:14:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:55.208116 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba0766-7b84-4814-9271-78b3f46cd345 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:55.302703 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b945b8-1895-467f-8fe5-09e0292357e2 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:55.349654 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49be167-ea54-415a-bc64-e94fdb3262a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:55.350807 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49be167-ea54-415a-bc64-e94fdb3262a3 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:55.351300 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49be167-ea54-415a-bc64-e94fdb3262a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:55.351770 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49be167-ea54-415a-bc64-e94fdb3262a3 None admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:55.352957 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49be167-ea54-415a-bc64-e94fdb3262a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:55.353541 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49be167-ea54-415a-bc64-e94fdb3262a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:55.355370 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49be167-ea54-415a-bc64-e94fdb3262a3 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:55.372443 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 341/684] 10.222.0.91 () {56 vars in 1148 bytes} [Tue Aug 30 04:14:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:55.389923 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49be167-ea54-415a-bc64-e94fdb3262a3 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:55.452954 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba0766-7b84-4814-9271-78b3f46cd345 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:55.479226 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:55.531632 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406fc05a-9a30-4c24-b7b5-96ff8b803892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:55.532808 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406fc05a-9a30-4c24-b7b5-96ff8b803892 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:55.533384 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406fc05a-9a30-4c24-b7b5-96ff8b803892 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:55.533746 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406fc05a-9a30-4c24-b7b5-96ff8b803892 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:55.556554 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406fc05a-9a30-4c24-b7b5-96ff8b803892 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:55.558030 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49be167-ea54-415a-bc64-e94fdb3262a3 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:55.559657 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406fc05a-9a30-4c24-b7b5-96ff8b803892 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:55.591067 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-406fc05a-9a30-4c24-b7b5-96ff8b803892 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:55.591067 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:55.591067 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:55.591067 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:55.591067 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:55.591067 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:55.591067 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:55.591067 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:55.591067 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:55.591067 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:55.591067 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:55.591067 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:55.591067 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:14:55.591067 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:14:55.591067 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:14:55.591067 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:14:55.592341 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:55.592341 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:55.592341 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:55.592341 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:55.592341 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:55.592341 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:55.592341 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:55.592341 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:55.592341 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:55.592341 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:55.592341 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:55.592341 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:55.592341 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:55.592341 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:55.592341 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:55.592341 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:55.592341 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:14:55.593265 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:14:55.593265 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:55.593265 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:14:55.593636 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 344/685] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:14:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:14:55.600835 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406fc05a-9a30-4c24-b7b5-96ff8b803892 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:55.607291 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb34838-cdb3-4e4e-a3ca-ebdccc207365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:55.609590 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb34838-cdb3-4e4e-a3ca-ebdccc207365 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:55.610122 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb34838-cdb3-4e4e-a3ca-ebdccc207365 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:55.610573 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb34838-cdb3-4e4e-a3ca-ebdccc207365 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:55.611554 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb34838-cdb3-4e4e-a3ca-ebdccc207365 None admin] RBAC: Adding query filter params (role.id=c3eef5523b7a407082ffaa23a9753410, scope.project.id=4e05769361674c8fa995050150ad4cfa, user.id=1c05f49ae42b4f9583ff10b2cfce52a1) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:55.612106 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb34838-cdb3-4e4e-a3ca-ebdccc207365 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:55.613841 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb34838-cdb3-4e4e-a3ca-ebdccc207365 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:55.623203 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 342/686] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 30 04:14:55 2022] GET /identity/v3/role_assignments?user.id=1c05f49ae42b4f9583ff10b2cfce52a1&scope.project.id=4e05769361674c8fa995050150ad4cfa&role.id=c3eef5523b7a407082ffaa23a9753410 => generated 608 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:14:55.684226 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:55.831357 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406fc05a-9a30-4c24-b7b5-96ff8b803892 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:55.883078 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6718169-ddf3-4580-bd82-a8fcb610fff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:55.884124 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6718169-ddf3-4580-bd82-a8fcb610fff5 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:55.884587 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6718169-ddf3-4580-bd82-a8fcb610fff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:55.885115 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6718169-ddf3-4580-bd82-a8fcb610fff5 None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:55.886092 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6718169-ddf3-4580-bd82-a8fcb610fff5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:55.886622 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6718169-ddf3-4580-bd82-a8fcb610fff5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:55.888319 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6718169-ddf3-4580-bd82-a8fcb610fff5 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:55.908379 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 345/687] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:14:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:55.914994 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb34838-cdb3-4e4e-a3ca-ebdccc207365 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:56.147659 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb34838-cdb3-4e4e-a3ca-ebdccc207365 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:56.182947 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:56.208827 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc910922-91e2-4663-b12f-5f6a36a0771d None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:56.209412 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc910922-91e2-4663-b12f-5f6a36a0771d None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:56.209864 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc910922-91e2-4663-b12f-5f6a36a0771d None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:56.211775 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 346/688] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:14:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:14:56.218417 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dcb47b-ea47-45fa-86f2-27fbc19f6fab None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:56.219018 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dcb47b-ea47-45fa-86f2-27fbc19f6fab None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:56.219467 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dcb47b-ea47-45fa-86f2-27fbc19f6fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:56.224333 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a015d5a-77da-4978-88fe-3d2cae2e3318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:56.224704 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a015d5a-77da-4978-88fe-3d2cae2e3318 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:56.225136 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a015d5a-77da-4978-88fe-3d2cae2e3318 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:56.226355 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a015d5a-77da-4978-88fe-3d2cae2e3318 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:56.242410 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a015d5a-77da-4978-88fe-3d2cae2e3318 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:56.245258 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a015d5a-77da-4978-88fe-3d2cae2e3318 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:56.253870 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-c9dcb47b-ea47-45fa-86f2-27fbc19f6fab None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:56.256024 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-c9dcb47b-ea47-45fa-86f2-27fbc19f6fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:56.268432 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-8a015d5a-77da-4978-88fe-3d2cae2e3318 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 04:14:56.268432 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:56.268432 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:56.268432 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:56.268432 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:56.268432 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:56.268432 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:56.268432 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:56.268432 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:56.268432 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:56.268432 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:56.268432 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:56.268432 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:14:56.268432 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:14:56.268432 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:14:56.268432 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:14:56.269444 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:56.269444 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:56.269444 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:14:56.269444 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:14:56.269444 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:14:56.269444 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:14:56.269444 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:56.269444 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:56.269444 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:56.269444 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:56.269444 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:56.269444 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:56.269444 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:56.269444 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:56.269444 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:56.269444 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:56.269444 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:56.269444 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:56.270390 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:56.270390 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:56.270390 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:14:56.270390 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:14:56.270390 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:14:56.270390 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:14:56.270390 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:14:56.270390 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:14:56.270390 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 04:14:56.270390 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:14:56.271411 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 343/689] 10.222.0.91 () {56 vars in 1096 bytes} [Tue Aug 30 04:14:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:14:56.277929 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a015d5a-77da-4978-88fe-3d2cae2e3318 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:56.409277 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 347/690] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:14:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 04:14:56.460708 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a015d5a-77da-4978-88fe-3d2cae2e3318 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:56.509604 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd77af8-cc8a-457d-92a3-512d34e68650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:56.510320 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd77af8-cc8a-457d-92a3-512d34e68650 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:56.510600 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd77af8-cc8a-457d-92a3-512d34e68650 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:56.510875 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd77af8-cc8a-457d-92a3-512d34e68650 None admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:56.511637 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd77af8-cc8a-457d-92a3-512d34e68650 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:56.512117 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd77af8-cc8a-457d-92a3-512d34e68650 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:56.513848 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd77af8-cc8a-457d-92a3-512d34e68650 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:56.544563 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 344/691] 10.222.0.91 () {56 vars in 1135 bytes} [Tue Aug 30 04:14:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:56.550734 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dcb47b-ea47-45fa-86f2-27fbc19f6fab None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:56.568703 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:56.715507 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dcb47b-ea47-45fa-86f2-27fbc19f6fab None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:56.794052 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19fb29a-850d-4612-8cc0-b2151ae9a21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:56.795092 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19fb29a-850d-4612-8cc0-b2151ae9a21b None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:56.795570 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19fb29a-850d-4612-8cc0-b2151ae9a21b None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:56.796073 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19fb29a-850d-4612-8cc0-b2151ae9a21b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:56.934350 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19fb29a-850d-4612-8cc0-b2151ae9a21b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:56.937203 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19fb29a-850d-4612-8cc0-b2151ae9a21b None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:56.968614 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:57.017921 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd77af8-cc8a-457d-92a3-512d34e68650 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:57.099973 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:57.144949 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 348/692] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 30 04:14:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 594 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:57.160038 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19fb29a-850d-4612-8cc0-b2151ae9a21b None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:57.308780 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd77af8-cc8a-457d-92a3-512d34e68650 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:57.390031 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64764ffe-4450-4300-90b0-81de6605143d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:57.390689 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64764ffe-4450-4300-90b0-81de6605143d None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:57.390961 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64764ffe-4450-4300-90b0-81de6605143d None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:57.391225 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64764ffe-4450-4300-90b0-81de6605143d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:57.391820 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64764ffe-4450-4300-90b0-81de6605143d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:57.393395 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64764ffe-4450-4300-90b0-81de6605143d None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:57.413165 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-64764ffe-4450-4300-90b0-81de6605143d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 04:14:57.413165 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:57.413165 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:14:57.413165 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:14:57.413165 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:14:57.413165 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:14:57.413165 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:14:57.413165 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:14:57.413165 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 04:14:57.413165 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:14:57.413165 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:14:57.413165 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:14:57.413165 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:57.413165 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:57.413165 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:57.413165 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:57.413165 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:57.414293 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:57.414293 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:57.414293 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:57.414293 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:57.414293 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:57.414293 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:57.414293 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:14:57.414293 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:14:57.414293 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:14:57.414293 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:14:57.414293 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:57.414293 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:57.414293 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:57.414293 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:57.414293 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:57.414293 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:57.415234 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:57.415234 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:57.415234 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:57.415234 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:57.415234 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:57.415234 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:57.415234 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:57.415234 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:57.415234 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:57.415234 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:57.415234 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:14:57.415234 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:14:57.415234 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 04:14:57.415234 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:14:57.415234 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 345/693] 10.222.0.91 () {56 vars in 1129 bytes} [Tue Aug 30 04:14:57 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 397 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:57.426475 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19fb29a-850d-4612-8cc0-b2151ae9a21b None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:57.429157 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64764ffe-4450-4300-90b0-81de6605143d None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:57.459079 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:57.506474 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d8d7f-b8da-413a-960b-5edacad6e519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:57.507132 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d8d7f-b8da-413a-960b-5edacad6e519 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:57.507402 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d8d7f-b8da-413a-960b-5edacad6e519 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:57.507665 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d8d7f-b8da-413a-960b-5edacad6e519 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:57.526738 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0d8d7f-b8da-413a-960b-5edacad6e519 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:57.528255 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0d8d7f-b8da-413a-960b-5edacad6e519 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:57.558892 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-0f0d8d7f-b8da-413a-960b-5edacad6e519 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:57.558892 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:57.558892 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:57.558892 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:57.558892 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:57.558892 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:57.558892 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:57.558892 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:57.558892 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:57.558892 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:57.558892 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:57.558892 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:57.558892 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:14:57.558892 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:14:57.558892 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:14:57.558892 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:14:57.561531 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:57.561531 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:57.561531 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:57.561531 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:57.561531 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:57.561531 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:57.561531 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:57.561531 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:57.561531 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:57.561531 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:57.561531 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:57.561531 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:57.561531 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:57.561531 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:57.561531 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:57.561531 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:57.561531 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:14:57.563365 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:14:57.563365 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:57.563365 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:14:57.563365 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 349/694] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:14:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 402 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:57.570210 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d8d7f-b8da-413a-960b-5edacad6e519 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:57.697677 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:57.705823 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64764ffe-4450-4300-90b0-81de6605143d None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:57.777858 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e6f5d6-f688-4098-8393-f83884a2fa03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:57.779361 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6f5d6-f688-4098-8393-f83884a2fa03 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:57.780164 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6f5d6-f688-4098-8393-f83884a2fa03 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:57.780898 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6f5d6-f688-4098-8393-f83884a2fa03 None admin] PATH_INFO: `/v3/services` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:57.782230 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e6f5d6-f688-4098-8393-f83884a2fa03 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:57.783077 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e6f5d6-f688-4098-8393-f83884a2fa03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:57.785847 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e6f5d6-f688-4098-8393-f83884a2fa03 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:57.795427 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 346/695] 10.222.0.91 () {56 vars in 1124 bytes} [Tue Aug 30 04:14:57 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:57.797628 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ffe1f-64bd-4cdc-afba-8f0d5bf5bc69 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:57.798327 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ffe1f-64bd-4cdc-afba-8f0d5bf5bc69 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:57.799096 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ffe1f-64bd-4cdc-afba-8f0d5bf5bc69 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:57.802303 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 347/696] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:14:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:14:57.811674 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0898f1-cb56-4dc2-85d4-30b1325cad73 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:57.811674 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0898f1-cb56-4dc2-85d4-30b1325cad73 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:57.811674 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0898f1-cb56-4dc2-85d4-30b1325cad73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:57.843278 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-ef0898f1-cb56-4dc2-85d4-30b1325cad73 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:57.845182 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-ef0898f1-cb56-4dc2-85d4-30b1325cad73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:57.892260 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d8d7f-b8da-413a-960b-5edacad6e519 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:57.956068 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 348/697] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:14:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:14:57.957774 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0898f1-cb56-4dc2-85d4-30b1325cad73 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:57.975108 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c578637-576b-45c2-a74d-992b98294499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:57.976348 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c578637-576b-45c2-a74d-992b98294499 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:57.976821 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c578637-576b-45c2-a74d-992b98294499 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:57.977301 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c578637-576b-45c2-a74d-992b98294499 None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:57.982305 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c578637-576b-45c2-a74d-992b98294499 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:57.982305 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c578637-576b-45c2-a74d-992b98294499 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:57.982965 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c578637-576b-45c2-a74d-992b98294499 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:58.014624 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 350/698] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:14:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 445 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:58.024832 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c578637-576b-45c2-a74d-992b98294499 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:58.093348 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:58.162511 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:58.179433 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0898f1-cb56-4dc2-85d4-30b1325cad73 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:58.240924 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c50065-9620-4f0a-b6fb-54dfe9d46e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:58.241886 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c50065-9620-4f0a-b6fb-54dfe9d46e44 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:58.242339 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c50065-9620-4f0a-b6fb-54dfe9d46e44 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:58.242780 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c50065-9620-4f0a-b6fb-54dfe9d46e44 None admin] PATH_INFO: `/v3/services` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:58.243857 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c50065-9620-4f0a-b6fb-54dfe9d46e44 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:58.244440 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c50065-9620-4f0a-b6fb-54dfe9d46e44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:58.246915 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c50065-9620-4f0a-b6fb-54dfe9d46e44 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:58.263952 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c578637-576b-45c2-a74d-992b98294499 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:58.264238 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 349/699] 10.222.0.91 () {56 vars in 1124 bytes} [Tue Aug 30 04:14:57 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:58.264238 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411445ab-620c-4f77-b306-48107c33d518 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:58.264238 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411445ab-620c-4f77-b306-48107c33d518 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:58.264238 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411445ab-620c-4f77-b306-48107c33d518 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:58.268275 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 350/700] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:14:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:14:58.272203 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f3f28-3edb-43e5-8123-3f789cd78df0 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:58.272655 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f3f28-3edb-43e5-8123-3f789cd78df0 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:58.273108 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f3f28-3edb-43e5-8123-3f789cd78df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:58.306062 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-ba6f3f28-3edb-43e5-8123-3f789cd78df0 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:58.308094 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-ba6f3f28-3edb-43e5-8123-3f789cd78df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:58.316892 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84821665-f6ca-417c-914c-b850fb9d4de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:58.317753 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84821665-f6ca-417c-914c-b850fb9d4de2 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:58.318123 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84821665-f6ca-417c-914c-b850fb9d4de2 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:58.318483 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84821665-f6ca-417c-914c-b850fb9d4de2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:58.327663 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84821665-f6ca-417c-914c-b850fb9d4de2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:58.329494 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84821665-f6ca-417c-914c-b850fb9d4de2 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:58.344343 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-84821665-f6ca-417c-914c-b850fb9d4de2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:14:58.344343 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:58.344343 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:58.344343 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:58.344343 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:58.344343 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:58.344343 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:58.344343 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:58.344343 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:58.344343 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:58.344343 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:58.344343 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:58.344343 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:14:58.344343 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:14:58.344343 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:14:58.345943 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:14:58.345943 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:58.345943 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:58.345943 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:58.345943 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:58.345943 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:58.345943 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:58.345943 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:58.345943 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:58.345943 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:58.345943 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:58.345943 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:58.345943 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:58.345943 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:58.345943 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:58.345943 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:58.345943 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:58.347533 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:14:58.347533 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:14:58.347533 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:14:58.347533 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:14:58.347533 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:14:58.347533 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:14:58.347533 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:14:58.347533 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:14:58.351565 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 351/701] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 30 04:14:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:58.352723 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84821665-f6ca-417c-914c-b850fb9d4de2 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:58.460284 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 351/702] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:14:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 04:14:58.461487 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f3f28-3edb-43e5-8123-3f789cd78df0 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:58.506645 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:58.546495 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84821665-f6ca-417c-914c-b850fb9d4de2 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:58.620973 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42929f3-4f9e-420d-9661-66082551ea96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:58.622059 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42929f3-4f9e-420d-9661-66082551ea96 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:58.622508 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42929f3-4f9e-420d-9661-66082551ea96 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:58.622964 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42929f3-4f9e-420d-9661-66082551ea96 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:58.639246 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:58.652598 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42929f3-4f9e-420d-9661-66082551ea96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:14:58.659070 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-a42929f3-4f9e-420d-9661-66082551ea96 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:14:58.659070 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:58.659070 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:58.659070 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:58.659070 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:58.659070 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:58.659070 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:58.659070 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:58.659070 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:58.659070 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:58.659070 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:58.659070 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:58.659070 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:14:58.659070 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:14:58.659070 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:14:58.659070 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:14:58.660140 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:14:58.660140 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:14:58.660140 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:14:58.660140 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:14:58.660140 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:58.660140 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:58.660140 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:58.660140 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:58.660140 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:58.660140 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:58.660140 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:58.660140 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:58.660140 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:58.660140 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:58.660140 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:58.660140 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:58.661066 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:58.661066 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:58.661066 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:58.661066 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:58.661066 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:14:58.661066 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:14:58.661066 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:14:58.661066 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:14:58.661066 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:14:58.661066 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:14:58.661066 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:14:58.661066 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:14:58.661854 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 352/703] 10.222.0.91 () {56 vars in 1096 bytes} [Tue Aug 30 04:14:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:58.671840 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42929f3-4f9e-420d-9661-66082551ea96 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:58.693008 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f3f28-3edb-43e5-8123-3f789cd78df0 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:58.803499 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f948cf-2231-4cc3-a16f-df8edfc76759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:58.804232 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f948cf-2231-4cc3-a16f-df8edfc76759 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:58.804516 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f948cf-2231-4cc3-a16f-df8edfc76759 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:58.804970 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f948cf-2231-4cc3-a16f-df8edfc76759 None admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:58.805744 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f948cf-2231-4cc3-a16f-df8edfc76759 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:58.806059 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f948cf-2231-4cc3-a16f-df8edfc76759 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:58.810290 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f948cf-2231-4cc3-a16f-df8edfc76759 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:58.843859 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 352/704] 10.222.0.91 () {56 vars in 1148 bytes} [Tue Aug 30 04:14:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:58.845338 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f948cf-2231-4cc3-a16f-df8edfc76759 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:58.944051 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42929f3-4f9e-420d-9661-66082551ea96 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:58.991606 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b203820-5634-43c9-b456-c576459d98d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:58.992272 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b203820-5634-43c9-b456-c576459d98d8 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:58.992797 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b203820-5634-43c9-b456-c576459d98d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:58.993300 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b203820-5634-43c9-b456-c576459d98d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:58.994333 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b203820-5634-43c9-b456-c576459d98d8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:58.995622 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b203820-5634-43c9-b456-c576459d98d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:58.997347 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b203820-5634-43c9-b456-c576459d98d8 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:59.015286 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 353/705] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 30 04:14:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:59.017689 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b203820-5634-43c9-b456-c576459d98d8 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:59.040613 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:59.105509 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f948cf-2231-4cc3-a16f-df8edfc76759 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:59.177779 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85361dc6-4d19-4e74-9ae4-ed1635d340b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:59.179901 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85361dc6-4d19-4e74-9ae4-ed1635d340b1 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:59.180707 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85361dc6-4d19-4e74-9ae4-ed1635d340b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:59.181474 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85361dc6-4d19-4e74-9ae4-ed1635d340b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:59.183371 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85361dc6-4d19-4e74-9ae4-ed1635d340b1 None admin] RBAC: Adding query filter params (role.id=c3eef5523b7a407082ffaa23a9753410, scope.project.id=4e05769361674c8fa995050150ad4cfa, user.id=94b50f9552124b07822ae63c1d553864) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:59.184340 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85361dc6-4d19-4e74-9ae4-ed1635d340b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:59.187486 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85361dc6-4d19-4e74-9ae4-ed1635d340b1 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:59.199566 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 353/706] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 30 04:14:58 2022] GET /identity/v3/role_assignments?user.id=94b50f9552124b07822ae63c1d553864&scope.project.id=4e05769361674c8fa995050150ad4cfa&role.id=c3eef5523b7a407082ffaa23a9753410 => generated 608 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:59.201674 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85361dc6-4d19-4e74-9ae4-ed1635d340b1 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:59.235967 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:59.252258 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b203820-5634-43c9-b456-c576459d98d8 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:59.413248 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9fa6a3-72c5-4bec-988d-43efc2cee266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:59.414326 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9fa6a3-72c5-4bec-988d-43efc2cee266 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:59.414804 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9fa6a3-72c5-4bec-988d-43efc2cee266 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:59.415276 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9fa6a3-72c5-4bec-988d-43efc2cee266 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:59.449381 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9fa6a3-72c5-4bec-988d-43efc2cee266 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:59.452818 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9fa6a3-72c5-4bec-988d-43efc2cee266 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:59.484196 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-5b9fa6a3-72c5-4bec-988d-43efc2cee266 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:59.484196 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:59.484196 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:59.484196 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:59.484196 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:59.484196 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:59.484196 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:59.484196 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:59.484196 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:59.484196 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:59.484196 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:59.484196 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:59.484196 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:14:59.484196 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:14:59.484196 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:14:59.484196 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:14:59.486239 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:59.486239 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:59.486239 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:59.486239 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:59.486239 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:59.486239 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:59.486239 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:59.486239 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:59.486239 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:59.486239 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:59.486239 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:59.486239 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:59.486239 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:59.486239 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:59.486239 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:59.486239 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:59.486239 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:14:59.488340 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:14:59.488340 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:14:59.488340 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:14:59.488689 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85361dc6-4d19-4e74-9ae4-ed1635d340b1 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:59.496559 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 354/707] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:14:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 479 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:14:59.499287 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf5c61-7593-4891-afd2-c22c56470357 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:59.500086 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf5c61-7593-4891-afd2-c22c56470357 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:59.500782 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf5c61-7593-4891-afd2-c22c56470357 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:59.507510 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 355/708] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:14:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:14:59.512071 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee0e2e-c499-4dfe-8816-1bc41b3352b0 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:59.512868 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee0e2e-c499-4dfe-8816-1bc41b3352b0 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:59.513556 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee0e2e-c499-4dfe-8816-1bc41b3352b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:59.536605 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5790ef-d530-467e-92f0-6378b64bb53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:59.537262 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5790ef-d530-467e-92f0-6378b64bb53f None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:59.537576 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5790ef-d530-467e-92f0-6378b64bb53f None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:59.538633 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5790ef-d530-467e-92f0-6378b64bb53f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:59.548190 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-47ee0e2e-c499-4dfe-8816-1bc41b3352b0 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:59.550697 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-47ee0e2e-c499-4dfe-8816-1bc41b3352b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:59.552454 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5790ef-d530-467e-92f0-6378b64bb53f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:14:59.558824 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-dc5790ef-d530-467e-92f0-6378b64bb53f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:14:59.558824 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:14:59.558824 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:14:59.558824 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:14:59.558824 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:14:59.558824 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:14:59.558824 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:14:59.558824 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:14:59.558824 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:14:59.558824 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:14:59.558824 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:14:59.558824 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:14:59.558824 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:14:59.558824 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:14:59.558824 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:14:59.558824 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:14:59.561224 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:14:59.561224 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:14:59.561224 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:14:59.561224 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:14:59.561224 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:14:59.561224 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:14:59.561224 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:14:59.561224 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:14:59.561224 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:14:59.561224 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:14:59.561224 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:14:59.561224 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:14:59.561224 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:14:59.561224 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:14:59.561224 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:14:59.561224 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:14:59.564110 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:14:59.564110 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:14:59.564110 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:14:59.564110 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:14:59.564110 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:14:59.564110 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:14:59.564110 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:14:59.564110 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:14:59.564110 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:14:59.564110 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:14:59.564110 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:14:59.564110 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:14:59.564110 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 354/709] 10.222.0.91 () {56 vars in 1102 bytes} [Tue Aug 30 04:14:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:14:59.564110 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5790ef-d530-467e-92f0-6378b64bb53f None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:59.658559 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:59.683998 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:59.700971 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 356/710] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:14:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:14:59.702736 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee0e2e-c499-4dfe-8816-1bc41b3352b0 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:59.703989 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5790ef-d530-467e-92f0-6378b64bb53f None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:59.844202 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe90ade-faa6-4205-b260-34f64ee54ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:59.845263 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe90ade-faa6-4205-b260-34f64ee54ea9 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:59.845754 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe90ade-faa6-4205-b260-34f64ee54ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:59.846236 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe90ade-faa6-4205-b260-34f64ee54ea9 None admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:59.847440 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe90ade-faa6-4205-b260-34f64ee54ea9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:59.848017 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe90ade-faa6-4205-b260-34f64ee54ea9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:59.850694 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe90ade-faa6-4205-b260-34f64ee54ea9 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:59.906898 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 355/711] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:14:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:59.909521 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe90ade-faa6-4205-b260-34f64ee54ea9 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:00.046189 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee0e2e-c499-4dfe-8816-1bc41b3352b0 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:00.110716 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24ec802-0da5-4f24-8bed-872a0a9707e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:00.111742 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ec802-0da5-4f24-8bed-872a0a9707e1 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:00.112396 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ec802-0da5-4f24-8bed-872a0a9707e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:00.112729 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ec802-0da5-4f24-8bed-872a0a9707e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:00.113941 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24ec802-0da5-4f24-8bed-872a0a9707e1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:00.114465 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24ec802-0da5-4f24-8bed-872a0a9707e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:00.117286 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24ec802-0da5-4f24-8bed-872a0a9707e1 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:00.131875 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe90ade-faa6-4205-b260-34f64ee54ea9 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:00.139230 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 357/712] 10.222.0.91 () {56 vars in 1103 bytes} [Tue Aug 30 04:14:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 432 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:00.139230 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24ec802-0da5-4f24-8bed-872a0a9707e1 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:00.180345 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:00.190730 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee591eff-67d9-4cbb-aa03-d1601a272d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:00.191981 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee591eff-67d9-4cbb-aa03-d1601a272d29 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:00.192470 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee591eff-67d9-4cbb-aa03-d1601a272d29 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:00.193045 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee591eff-67d9-4cbb-aa03-d1601a272d29 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:00.202992 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee591eff-67d9-4cbb-aa03-d1601a272d29 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:00.205026 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee591eff-67d9-4cbb-aa03-d1601a272d29 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:00.219678 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-ee591eff-67d9-4cbb-aa03-d1601a272d29 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 04:15:00.219678 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:00.219678 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:00.219678 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:00.219678 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:00.219678 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:00.219678 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:00.219678 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:00.219678 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:00.219678 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:00.219678 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:00.219678 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:00.219678 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:15:00.219678 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:15:00.219678 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:15:00.219678 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:15:00.221100 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:00.221100 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:00.221100 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:15:00.221100 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:15:00.221100 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:15:00.221100 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:15:00.221100 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:00.221100 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:00.221100 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:00.221100 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:00.221100 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:00.221100 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:00.221100 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:00.221100 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:00.221100 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:00.221100 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:00.221100 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:00.221100 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:00.223475 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:00.223475 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:00.223475 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:15:00.223475 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:15:00.223475 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:15:00.223475 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:15:00.223475 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:15:00.223475 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:15:00.223475 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 04:15:00.223475 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:00.236088 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 356/713] 10.222.0.91 () {56 vars in 1093 bytes} [Tue Aug 30 04:14:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:15:00.237572 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee591eff-67d9-4cbb-aa03-d1601a272d29 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:00.253398 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:00.347698 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24ec802-0da5-4f24-8bed-872a0a9707e1 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:00.372502 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee591eff-67d9-4cbb-aa03-d1601a272d29 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:00.423023 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dcd480-a6d4-4695-9c62-6761c03a7d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:00.423706 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9df291-07a0-4778-a24c-86ced2ef8ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:00.424167 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dcd480-a6d4-4695-9c62-6761c03a7d87 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:00.424634 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dcd480-a6d4-4695-9c62-6761c03a7d87 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:00.425080 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dcd480-a6d4-4695-9c62-6761c03a7d87 None admin] PATH_INFO: `/v3/services/network` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:00.425347 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9df291-07a0-4778-a24c-86ced2ef8ee2 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:00.425872 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9df291-07a0-4778-a24c-86ced2ef8ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:00.426092 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dcd480-a6d4-4695-9c62-6761c03a7d87 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:00.426571 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9df291-07a0-4778-a24c-86ced2ef8ee2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:00.428998 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dcd480-a6d4-4695-9c62-6761c03a7d87 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:00.441174 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9df291-07a0-4778-a24c-86ced2ef8ee2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:00.443079 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9df291-07a0-4778-a24c-86ced2ef8ee2 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:00.451049 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-23dcd480-a6d4-4695-9c62-6761c03a7d87 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 04:15:00.451049 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:00.451049 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:15:00.451049 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:15:00.451049 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:15:00.451049 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:15:00.451049 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:15:00.451049 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:15:00.451049 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 04:15:00.451049 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:15:00.451049 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:15:00.451049 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:15:00.451049 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:00.451049 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:00.451049 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:00.451049 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:00.451049 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:00.452244 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:00.452244 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:00.452244 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:00.452244 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:00.452244 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:00.452244 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:00.452244 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:15:00.452244 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:15:00.452244 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:15:00.452244 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:15:00.452244 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:00.452244 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:00.452244 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:00.452244 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:00.452244 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:00.452244 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:00.453154 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:00.453154 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:00.453154 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:00.453154 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:00.453154 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:00.453154 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:00.453154 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:00.453154 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:00.453154 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:00.453154 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:00.453154 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:15:00.453154 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:15:00.453154 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 04:15:00.453154 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:15:00.460062 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 358/714] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 30 04:15:00 2022] GET /identity/v3/services/network => generated 88 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:15:00.461827 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dcd480-a6d4-4695-9c62-6761c03a7d87 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:00.468197 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-9c9df291-07a0-4778-a24c-86ced2ef8ee2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:15:00.468197 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:00.468197 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:00.468197 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:00.468197 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:00.468197 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:00.468197 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:00.468197 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:00.468197 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:00.468197 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:00.468197 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:00.468197 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:00.468197 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:15:00.468197 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:15:00.468197 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:15:00.468197 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:15:00.469297 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:00.469297 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:00.469297 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:00.469297 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:00.469297 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:00.469297 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:00.469297 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:00.469297 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:00.469297 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:00.469297 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:00.469297 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:00.469297 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:00.469297 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:00.469297 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:00.469297 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:00.469297 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:00.469297 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:15:00.470248 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:15:00.470248 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:15:00.470248 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:00.473163 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 357/715] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:15:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:15:00.479466 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9df291-07a0-4778-a24c-86ced2ef8ee2 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:00.537337 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:00.614252 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9df291-07a0-4778-a24c-86ced2ef8ee2 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:00.662240 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5252e22-6a85-4454-ad7d-4a87d7d055ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:00.663396 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5252e22-6a85-4454-ad7d-4a87d7d055ad None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:00.663949 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5252e22-6a85-4454-ad7d-4a87d7d055ad None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:00.664455 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5252e22-6a85-4454-ad7d-4a87d7d055ad None admin] PATH_INFO: `/v3/services` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:00.665447 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5252e22-6a85-4454-ad7d-4a87d7d055ad None admin] RBAC: Adding query filter params (name=network) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:00.666200 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5252e22-6a85-4454-ad7d-4a87d7d055ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:00.669089 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5252e22-6a85-4454-ad7d-4a87d7d055ad None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:00.675436 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 358/716] 10.222.0.91 () {56 vars in 1112 bytes} [Tue Aug 30 04:15:00 2022] GET /identity/v3/services?name=network => generated 124 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:00.676719 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5252e22-6a85-4454-ad7d-4a87d7d055ad None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:00.685396 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dcd480-a6d4-4695-9c62-6761c03a7d87 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:00.719831 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:00.755240 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e42689f-d2e9-4b00-9c6b-121b82b902ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:00.756297 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42689f-d2e9-4b00-9c6b-121b82b902ab None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:00.756767 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42689f-d2e9-4b00-9c6b-121b82b902ab None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:00.757231 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42689f-d2e9-4b00-9c6b-121b82b902ab None admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:00.758574 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e42689f-d2e9-4b00-9c6b-121b82b902ab None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:00.759382 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e42689f-d2e9-4b00-9c6b-121b82b902ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:00.762010 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e42689f-d2e9-4b00-9c6b-121b82b902ab None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:00.802296 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 359/717] 10.222.0.91 () {56 vars in 1133 bytes} [Tue Aug 30 04:15:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:00.802296 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e42689f-d2e9-4b00-9c6b-121b82b902ab None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:00.820060 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5252e22-6a85-4454-ad7d-4a87d7d055ad None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:00.830123 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:00.871101 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d21378-740d-480a-8cf8-2517924fb8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:00.872248 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d21378-740d-480a-8cf8-2517924fb8e9 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:00.872760 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d21378-740d-480a-8cf8-2517924fb8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:00.873274 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d21378-740d-480a-8cf8-2517924fb8e9 None admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:00.874248 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d21378-740d-480a-8cf8-2517924fb8e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:00.874792 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d21378-740d-480a-8cf8-2517924fb8e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:00.876933 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d21378-740d-480a-8cf8-2517924fb8e9 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:00.898271 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 359/718] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:15:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:00.899747 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d21378-740d-480a-8cf8-2517924fb8e9 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:01.002205 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e42689f-d2e9-4b00-9c6b-121b82b902ab None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:01.035885 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d21378-740d-480a-8cf8-2517924fb8e9 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:01.069887 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16c8576-e7d6-4943-93a8-712cad4d451d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:01.070979 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c8576-e7d6-4943-93a8-712cad4d451d None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:01.071441 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c8576-e7d6-4943-93a8-712cad4d451d None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:01.071931 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c8576-e7d6-4943-93a8-712cad4d451d None admin] PATH_INFO: `/v3/services` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:01.073179 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16c8576-e7d6-4943-93a8-712cad4d451d None admin] RBAC: Adding query filter params (type=network) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:01.073737 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16c8576-e7d6-4943-93a8-712cad4d451d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:01.076463 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16c8576-e7d6-4943-93a8-712cad4d451d None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:01.085385 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d258a6c-c934-4420-826d-a330c4d281ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:01.086432 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d258a6c-c934-4420-826d-a330c4d281ce None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:01.087003 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d258a6c-c934-4420-826d-a330c4d281ce None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:01.087502 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d258a6c-c934-4420-826d-a330c4d281ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:01.096109 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 360/719] 10.222.0.91 () {56 vars in 1112 bytes} [Tue Aug 30 04:15:00 2022] GET /identity/v3/services?type=network => generated 124 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:01.097860 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16c8576-e7d6-4943-93a8-712cad4d451d None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:01.149316 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:01.184350 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:01.211134 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d258a6c-c934-4420-826d-a330c4d281ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:01.214536 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d258a6c-c934-4420-826d-a330c4d281ce None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:01.309312 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16c8576-e7d6-4943-93a8-712cad4d451d None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:01.359725 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 360/720] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 30 04:15:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:01.362175 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75aea6d-78fe-4329-8a98-66462f473398 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:01.362804 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75aea6d-78fe-4329-8a98-66462f473398 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:01.363291 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75aea6d-78fe-4329-8a98-66462f473398 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:01.365408 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 361/721] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:15:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:15:01.366541 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75aea6d-78fe-4329-8a98-66462f473398 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:01.378136 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56556731-f9a5-4b8e-a236-582ce4c0b3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:01.379210 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56556731-f9a5-4b8e-a236-582ce4c0b3d0 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:01.379656 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56556731-f9a5-4b8e-a236-582ce4c0b3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:01.380165 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56556731-f9a5-4b8e-a236-582ce4c0b3d0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:01.397893 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56556731-f9a5-4b8e-a236-582ce4c0b3d0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:01.399535 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56556731-f9a5-4b8e-a236-582ce4c0b3d0 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:01.418464 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-56556731-f9a5-4b8e-a236-582ce4c0b3d0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 04:15:01.418464 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:01.418464 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:01.418464 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:01.418464 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:01.418464 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:01.418464 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:01.418464 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:01.418464 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:01.418464 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:01.418464 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:01.418464 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:01.418464 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:15:01.418464 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:15:01.418464 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:15:01.418464 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:15:01.419519 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:01.419519 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:01.419519 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:15:01.419519 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:15:01.419519 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:15:01.419519 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:15:01.419519 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:01.419519 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:01.419519 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:01.419519 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:01.419519 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:01.419519 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:01.419519 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:01.419519 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:01.419519 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:01.419519 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:01.419519 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:01.419519 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:01.420602 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:01.420602 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:01.420602 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:15:01.420602 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:15:01.420602 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:15:01.420602 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:15:01.420602 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:15:01.420602 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:15:01.420602 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 04:15:01.420602 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:15:01.420602 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 361/722] 10.222.0.91 () {56 vars in 1117 bytes} [Tue Aug 30 04:15:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:15:01.421940 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5934f31-919e-4d1b-a257-93e95274cb2a None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:01.423322 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5934f31-919e-4d1b-a257-93e95274cb2a None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:01.423322 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5934f31-919e-4d1b-a257-93e95274cb2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:01.459242 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-a5934f31-919e-4d1b-a257-93e95274cb2a None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:01.459242 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-a5934f31-919e-4d1b-a257-93e95274cb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:01.496744 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:01.563388 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75aea6d-78fe-4329-8a98-66462f473398 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:01.587952 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 362/723] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:15:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:15:01.587952 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5934f31-919e-4d1b-a257-93e95274cb2a None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:01.607375 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646dbca4-3e92-42d1-8814-7ea285395e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:01.608065 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646dbca4-3e92-42d1-8814-7ea285395e6a None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:01.608346 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646dbca4-3e92-42d1-8814-7ea285395e6a None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:01.608613 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646dbca4-3e92-42d1-8814-7ea285395e6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:01.624736 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646dbca4-3e92-42d1-8814-7ea285395e6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:01.626240 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646dbca4-3e92-42d1-8814-7ea285395e6a None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:01.635518 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:01.649382 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-646dbca4-3e92-42d1-8814-7ea285395e6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:15:01.649382 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:01.649382 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:01.649382 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:01.649382 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:01.649382 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:01.649382 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:01.649382 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:01.649382 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:01.649382 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:01.649382 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:01.649382 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:01.649382 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:15:01.649382 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:15:01.649382 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:15:01.649382 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:15:01.651232 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:01.651232 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:01.651232 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:01.651232 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:01.651232 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:01.651232 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:01.651232 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:01.651232 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:01.651232 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:01.651232 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:01.651232 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:01.651232 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:01.651232 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:01.651232 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:01.651232 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:01.651232 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:01.651232 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:15:01.652408 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:15:01.652408 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:15:01.652408 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:01.654632 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 362/724] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:15:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:15:01.656401 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77514bbe-55ec-44ac-81f8-533dc3685de0 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:01.656958 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77514bbe-55ec-44ac-81f8-533dc3685de0 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:01.657464 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77514bbe-55ec-44ac-81f8-533dc3685de0 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:01.663683 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 363/725] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:15:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:15:01.665031 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77514bbe-55ec-44ac-81f8-533dc3685de0 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:01.751294 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5934f31-919e-4d1b-a257-93e95274cb2a None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:01.803160 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d5b316-e0cc-4d60-b3eb-bd33e47c06ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:01.803790 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5b316-e0cc-4d60-b3eb-bd33e47c06ae None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:01.804111 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5b316-e0cc-4d60-b3eb-bd33e47c06ae None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:01.804449 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5b316-e0cc-4d60-b3eb-bd33e47c06ae None admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:01.805302 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d5b316-e0cc-4d60-b3eb-bd33e47c06ae None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:01.805612 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d5b316-e0cc-4d60-b3eb-bd33e47c06ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:01.806480 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77514bbe-55ec-44ac-81f8-533dc3685de0 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:01.807733 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d5b316-e0cc-4d60-b3eb-bd33e47c06ae None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:01.836085 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 363/726] 10.222.0.91 () {56 vars in 1149 bytes} [Tue Aug 30 04:15:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:01.838163 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6f51b-121a-44b2-8e5e-43c724b34a28 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:01.838713 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6f51b-121a-44b2-8e5e-43c724b34a28 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:01.839200 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6f51b-121a-44b2-8e5e-43c724b34a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:01.842347 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:01.865708 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0f3cbc-90bf-43ce-8b0a-edb1511ab851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:01.866751 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f3cbc-90bf-43ce-8b0a-edb1511ab851 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:01.867260 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f3cbc-90bf-43ce-8b0a-edb1511ab851 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:01.867743 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f3cbc-90bf-43ce-8b0a-edb1511ab851 None admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:01.868660 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0f3cbc-90bf-43ce-8b0a-edb1511ab851 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:01.869266 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0f3cbc-90bf-43ce-8b0a-edb1511ab851 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:01.869838 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-ecc6f51b-121a-44b2-8e5e-43c724b34a28 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:01.871268 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0f3cbc-90bf-43ce-8b0a-edb1511ab851 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:01.871406 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-ecc6f51b-121a-44b2-8e5e-43c724b34a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:01.887292 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 364/727] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:15:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:01.888683 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0f3cbc-90bf-43ce-8b0a-edb1511ab851 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:01.982079 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 364/728] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:15:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:15:01.983345 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc6f51b-121a-44b2-8e5e-43c724b34a28 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:02.027205 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:02.056021 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0f3cbc-90bf-43ce-8b0a-edb1511ab851 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:02.119384 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a714819d-b31d-4764-a3ae-4d836ed0e0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:02.120185 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714819d-b31d-4764-a3ae-4d836ed0e0f0 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:02.120484 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714819d-b31d-4764-a3ae-4d836ed0e0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:02.120744 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714819d-b31d-4764-a3ae-4d836ed0e0f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:02.165841 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc6f51b-121a-44b2-8e5e-43c724b34a28 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:02.208336 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197558ba-29d7-4050-a9b3-9b04d8a248d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:02.209002 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197558ba-29d7-4050-a9b3-9b04d8a248d7 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:02.209283 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197558ba-29d7-4050-a9b3-9b04d8a248d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:02.209554 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197558ba-29d7-4050-a9b3-9b04d8a248d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:02.210660 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:02.219979 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197558ba-29d7-4050-a9b3-9b04d8a248d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:02.221765 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197558ba-29d7-4050-a9b3-9b04d8a248d7 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:02.235219 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-197558ba-29d7-4050-a9b3-9b04d8a248d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:15:02.235219 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:02.235219 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:02.235219 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:02.235219 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:02.235219 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:02.235219 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:02.235219 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:02.235219 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:02.235219 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:02.235219 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:02.235219 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:02.235219 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:15:02.235219 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:15:02.235219 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:15:02.236255 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:15:02.236255 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:02.236255 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:02.236255 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:02.236255 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:02.236255 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:02.236255 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:02.236255 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:02.236255 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:02.236255 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:02.236255 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:02.236255 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:02.236255 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:02.236255 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:02.236255 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:02.236255 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:02.236255 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:02.237895 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:15:02.237895 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:15:02.237895 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:15:02.237895 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:15:02.237895 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:15:02.237895 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:15:02.237895 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:15:02.237895 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:15:02.237895 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 365/729] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 30 04:15:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:15:02.237895 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197558ba-29d7-4050-a9b3-9b04d8a248d7 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:02.247612 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a714819d-b31d-4764-a3ae-4d836ed0e0f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:02.250668 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a714819d-b31d-4764-a3ae-4d836ed0e0f0 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:02.347963 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:02.380937 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197558ba-29d7-4050-a9b3-9b04d8a248d7 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:02.381568 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 365/730] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 30 04:15:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:02.382918 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a714819d-b31d-4764-a3ae-4d836ed0e0f0 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:02.422541 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57824e18-eab0-4197-859a-4e9a054c5ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:02.423655 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57824e18-eab0-4197-859a-4e9a054c5ffd None admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:02.424173 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57824e18-eab0-4197-859a-4e9a054c5ffd None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:02.424649 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57824e18-eab0-4197-859a-4e9a054c5ffd None admin] PATH_INFO: `/v3/services` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:02.425922 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57824e18-eab0-4197-859a-4e9a054c5ffd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:02.428687 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57824e18-eab0-4197-859a-4e9a054c5ffd None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:02.456303 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 366/731] 10.222.0.91 () {60 vars in 1141 bytes} [Tue Aug 30 04:15:02 2022] POST /identity/v3/services => generated 251 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:15:02.457378 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57824e18-eab0-4197-859a-4e9a054c5ffd None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:02.499704 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:02.538365 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a714819d-b31d-4764-a3ae-4d836ed0e0f0 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:02.649503 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad93aca8-c8d0-450c-8152-b090b6c29a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:02.650799 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93aca8-c8d0-450c-8152-b090b6c29a23 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:02.651390 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93aca8-c8d0-450c-8152-b090b6c29a23 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:02.651873 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93aca8-c8d0-450c-8152-b090b6c29a23 None admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:02.653307 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad93aca8-c8d0-450c-8152-b090b6c29a23 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:02.653816 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad93aca8-c8d0-450c-8152-b090b6c29a23 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:02.657112 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad93aca8-c8d0-450c-8152-b090b6c29a23 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:02.664704 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57824e18-eab0-4197-859a-4e9a054c5ffd None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:02.679178 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 366/732] 10.222.0.91 () {56 vars in 1148 bytes} [Tue Aug 30 04:15:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:02.681350 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad93aca8-c8d0-450c-8152-b090b6c29a23 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:02.715478 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:02.724387 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe4558f-f1df-4771-96c2-00c568cbbf34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:02.725167 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4558f-f1df-4771-96c2-00c568cbbf34 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:02.726080 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4558f-f1df-4771-96c2-00c568cbbf34 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:02.726485 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4558f-f1df-4771-96c2-00c568cbbf34 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:02.742339 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe4558f-f1df-4771-96c2-00c568cbbf34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:15:02.748502 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-efe4558f-f1df-4771-96c2-00c568cbbf34 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:15:02.748502 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:02.748502 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:02.748502 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:02.748502 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:02.748502 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:02.748502 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:02.748502 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:02.748502 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:02.748502 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:02.748502 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:02.748502 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:02.748502 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:15:02.748502 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:15:02.748502 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:15:02.748502 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:15:02.749533 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:15:02.749533 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:15:02.749533 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:15:02.749533 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:15:02.749533 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:02.749533 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:02.749533 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:02.749533 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:02.749533 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:02.749533 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:02.749533 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:02.749533 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:02.749533 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:02.749533 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:02.749533 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:02.749533 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:02.750432 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:02.750432 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:02.750432 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:02.750432 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:02.750432 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:15:02.750432 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:15:02.750432 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:15:02.750432 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:15:02.750432 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:15:02.750432 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:15:02.750432 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:15:02.750432 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:15:02.750432 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 367/733] 10.222.0.91 () {56 vars in 1096 bytes} [Tue Aug 30 04:15:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:15:02.751164 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe4558f-f1df-4771-96c2-00c568cbbf34 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:02.828970 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad93aca8-c8d0-450c-8152-b090b6c29a23 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:02.872182 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a711ee-34fa-4b25-b52d-6c6c0b9e8055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:02.873281 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a711ee-34fa-4b25-b52d-6c6c0b9e8055 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:02.873748 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a711ee-34fa-4b25-b52d-6c6c0b9e8055 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:02.874208 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a711ee-34fa-4b25-b52d-6c6c0b9e8055 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:02.877036 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:02.887731 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe4558f-f1df-4771-96c2-00c568cbbf34 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:02.891753 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a711ee-34fa-4b25-b52d-6c6c0b9e8055 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:02.893652 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a711ee-34fa-4b25-b52d-6c6c0b9e8055 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:02.911581 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-53a711ee-34fa-4b25-b52d-6c6c0b9e8055 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:15:02.911581 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:02.911581 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:02.911581 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:02.911581 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:02.911581 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:02.911581 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:02.911581 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:02.911581 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:02.911581 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:02.911581 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:02.911581 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:02.911581 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:15:02.911581 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:15:02.911581 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:15:02.911581 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:15:02.912800 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:02.912800 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:02.912800 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:02.912800 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:02.912800 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:02.912800 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:02.912800 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:02.912800 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:02.912800 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:02.912800 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:02.912800 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:02.912800 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:02.912800 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:02.912800 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:02.912800 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:02.912800 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:02.912800 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:15:02.913852 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:15:02.913852 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:15:02.913852 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:02.915957 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 367/734] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:15:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:15:02.918079 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a711ee-34fa-4b25-b52d-6c6c0b9e8055 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:02.944829 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9dab26-a63a-4836-9d35-b0489397894e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:02.945487 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9dab26-a63a-4836-9d35-b0489397894e None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:02.945786 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9dab26-a63a-4836-9d35-b0489397894e None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:02.946075 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9dab26-a63a-4836-9d35-b0489397894e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:02.946838 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9dab26-a63a-4836-9d35-b0489397894e None admin] RBAC: Adding query filter params (role.id=d8f440a82947486ebb20a633ebee736b, scope.project.id=4e05769361674c8fa995050150ad4cfa, user.id=d806295278ae4997b5c6968aa553290c) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:02.947589 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9dab26-a63a-4836-9d35-b0489397894e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:02.949856 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9dab26-a63a-4836-9d35-b0489397894e None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:02.962591 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 368/735] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 30 04:15:02 2022] GET /identity/v3/role_assignments?user.id=d806295278ae4997b5c6968aa553290c&scope.project.id=4e05769361674c8fa995050150ad4cfa&role.id=d8f440a82947486ebb20a633ebee736b => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:02.964568 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9dab26-a63a-4836-9d35-b0489397894e None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:03.092465 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:03.123051 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a711ee-34fa-4b25-b52d-6c6c0b9e8055 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:03.213331 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b9be02-b99f-49ff-bac5-93c681a9a0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:03.216921 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b9be02-b99f-49ff-bac5-93c681a9a0b1 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:03.219243 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b9be02-b99f-49ff-bac5-93c681a9a0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:03.220512 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b9be02-b99f-49ff-bac5-93c681a9a0b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:03.225496 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b9be02-b99f-49ff-bac5-93c681a9a0b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:03.226487 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b9be02-b99f-49ff-bac5-93c681a9a0b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:03.227088 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9dab26-a63a-4836-9d35-b0489397894e None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:03.230137 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b9be02-b99f-49ff-bac5-93c681a9a0b1 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:03.259593 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 368/736] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 30 04:15:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:03.265915 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b9be02-b99f-49ff-bac5-93c681a9a0b1 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:03.299426 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82eb45-a968-4791-8507-a531a7a16ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:03.300123 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82eb45-a968-4791-8507-a531a7a16ca4 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:03.300400 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82eb45-a968-4791-8507-a531a7a16ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:03.300674 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82eb45-a968-4791-8507-a531a7a16ca4 None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:03.301353 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa82eb45-a968-4791-8507-a531a7a16ca4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:03.301653 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa82eb45-a968-4791-8507-a531a7a16ca4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:03.303724 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa82eb45-a968-4791-8507-a531a7a16ca4 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:03.342412 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 369/737] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:15:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:03.343792 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b170b-d0ff-41de-849d-f770b8de4135 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:03.344097 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b170b-d0ff-41de-849d-f770b8de4135 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:03.344378 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b170b-d0ff-41de-849d-f770b8de4135 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:03.352034 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 370/738] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:15:03 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:15:03.353871 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62b170b-d0ff-41de-849d-f770b8de4135 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:03.389807 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:03.488976 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b9be02-b99f-49ff-bac5-93c681a9a0b1 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:03.528462 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961111e7-1da7-465b-9e95-26525e01ab43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:03.529124 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961111e7-1da7-465b-9e95-26525e01ab43 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:03.529406 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961111e7-1da7-465b-9e95-26525e01ab43 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:03.529677 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961111e7-1da7-465b-9e95-26525e01ab43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:03.543183 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961111e7-1da7-465b-9e95-26525e01ab43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:03.544820 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961111e7-1da7-465b-9e95-26525e01ab43 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:03.561625 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-961111e7-1da7-465b-9e95-26525e01ab43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:15:03.561625 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:03.561625 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:03.561625 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:03.561625 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:03.561625 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:03.561625 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:03.561625 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:03.561625 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:03.561625 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:03.561625 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:03.561625 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:03.561625 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:15:03.561625 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:15:03.561625 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:15:03.561625 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:15:03.564004 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:03.564004 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:03.564004 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:03.564004 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:03.564004 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:03.564004 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:03.564004 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:03.564004 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:03.564004 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:03.564004 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:03.564004 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:03.564004 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:03.564004 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:03.564004 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:03.564004 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:03.564004 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:03.564004 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:15:03.565742 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:15:03.565742 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:15:03.565742 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:03.566068 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62b170b-d0ff-41de-849d-f770b8de4135 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:03.566203 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 369/739] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:15:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:15:03.566203 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15c9c6-f86b-4bab-a013-42e9f96663fc None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:03.566203 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15c9c6-f86b-4bab-a013-42e9f96663fc None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:03.566203 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15c9c6-f86b-4bab-a013-42e9f96663fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:03.592554 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-5d15c9c6-f86b-4bab-a013-42e9f96663fc None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:03.594059 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-5d15c9c6-f86b-4bab-a013-42e9f96663fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:03.599700 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:03.651566 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518d38b-4785-4f93-924c-9d9b2ac8a38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:03.652797 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518d38b-4785-4f93-924c-9d9b2ac8a38f None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:03.653301 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518d38b-4785-4f93-924c-9d9b2ac8a38f None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:03.653787 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518d38b-4785-4f93-924c-9d9b2ac8a38f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:03.669179 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7518d38b-4785-4f93-924c-9d9b2ac8a38f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:03.672077 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7518d38b-4785-4f93-924c-9d9b2ac8a38f None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:03.687328 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 370/740] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:15:03 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:15:03.688775 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d15c9c6-f86b-4bab-a013-42e9f96663fc None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:03.695977 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-7518d38b-4785-4f93-924c-9d9b2ac8a38f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:15:03.695977 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:03.695977 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:03.695977 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:03.695977 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:03.695977 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:03.695977 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:03.695977 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:03.695977 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:03.695977 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:03.695977 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:03.695977 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:03.695977 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:15:03.695977 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:15:03.695977 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:15:03.697218 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:15:03.697218 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:03.697218 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:03.697218 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:03.697218 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:03.697218 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:03.697218 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:03.697218 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:03.697218 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:03.697218 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:03.697218 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:03.697218 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:03.697218 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:03.697218 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:03.697218 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:03.697218 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:03.697218 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:03.698551 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:15:03.698551 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:15:03.698551 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:15:03.698551 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:15:03.698551 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:15:03.698551 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:15:03.698551 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:15:03.698551 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:15:03.704252 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 371/741] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 30 04:15:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:15:03.711563 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518d38b-4785-4f93-924c-9d9b2ac8a38f None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:03.782912 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:03.958466 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518d38b-4785-4f93-924c-9d9b2ac8a38f None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:03.983762 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d15c9c6-f86b-4bab-a013-42e9f96663fc None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:04.043369 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b980cdb-ee64-43b6-8c90-5155a51505a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:04.044486 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b980cdb-ee64-43b6-8c90-5155a51505a4 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:04.044986 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b980cdb-ee64-43b6-8c90-5155a51505a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:04.045368 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b980cdb-ee64-43b6-8c90-5155a51505a4 None admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:04.046113 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b980cdb-ee64-43b6-8c90-5155a51505a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:04.046422 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b980cdb-ee64-43b6-8c90-5155a51505a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:04.048014 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b980cdb-ee64-43b6-8c90-5155a51505a4 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:04.060802 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68faaba5-f6f0-4f7c-ba57-fb6656b80142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:04.061449 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68faaba5-f6f0-4f7c-ba57-fb6656b80142 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:04.061731 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68faaba5-f6f0-4f7c-ba57-fb6656b80142 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:04.062007 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68faaba5-f6f0-4f7c-ba57-fb6656b80142 None admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:04.062681 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68faaba5-f6f0-4f7c-ba57-fb6656b80142 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:04.062985 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68faaba5-f6f0-4f7c-ba57-fb6656b80142 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:04.064458 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68faaba5-f6f0-4f7c-ba57-fb6656b80142 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:04.067015 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 372/742] 10.222.0.91 () {56 vars in 1148 bytes} [Tue Aug 30 04:15:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:04.069783 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b980cdb-ee64-43b6-8c90-5155a51505a4 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:04.082856 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 371/743] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:15:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:04.089216 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68faaba5-f6f0-4f7c-ba57-fb6656b80142 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:04.118029 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:04.209308 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b980cdb-ee64-43b6-8c90-5155a51505a4 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:04.224119 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:04.236467 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68faaba5-f6f0-4f7c-ba57-fb6656b80142 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:04.258840 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2b8532-0a59-4769-a2a2-331573cfa5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:04.259582 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b8532-0a59-4769-a2a2-331573cfa5d4 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:04.259973 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b8532-0a59-4769-a2a2-331573cfa5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:04.261040 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b8532-0a59-4769-a2a2-331573cfa5d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:04.261893 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2b8532-0a59-4769-a2a2-331573cfa5d4 None admin] RBAC: Adding query filter params (role.id=c3eef5523b7a407082ffaa23a9753410, scope.project.id=4e05769361674c8fa995050150ad4cfa, user.id=1bc12faf48984335a3515dcde85b5cb1) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:04.262259 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2b8532-0a59-4769-a2a2-331573cfa5d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:04.264075 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2b8532-0a59-4769-a2a2-331573cfa5d4 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:04.276428 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c535fdb-4ff7-4421-84e7-c7bdc93fd496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:04.277294 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c535fdb-4ff7-4421-84e7-c7bdc93fd496 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:04.277463 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 373/744] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 30 04:15:04 2022] GET /identity/v3/role_assignments?user.id=1bc12faf48984335a3515dcde85b5cb1&scope.project.id=4e05769361674c8fa995050150ad4cfa&role.id=c3eef5523b7a407082ffaa23a9753410 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:15:04.277636 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c535fdb-4ff7-4421-84e7-c7bdc93fd496 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:04.278477 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c535fdb-4ff7-4421-84e7-c7bdc93fd496 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:04.278788 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2b8532-0a59-4769-a2a2-331573cfa5d4 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:04.287328 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c535fdb-4ff7-4421-84e7-c7bdc93fd496 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:04.289182 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c535fdb-4ff7-4421-84e7-c7bdc93fd496 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:04.303006 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-9c535fdb-4ff7-4421-84e7-c7bdc93fd496 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 04:15:04.303006 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:04.303006 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:04.303006 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:04.303006 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:04.303006 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:04.303006 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:04.303006 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:04.303006 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:04.303006 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:04.303006 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:04.303006 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:04.303006 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:15:04.303006 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:15:04.303006 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:15:04.303006 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:15:04.305347 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:04.305347 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:04.305347 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:15:04.305347 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:15:04.305347 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:15:04.305347 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:15:04.305347 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:04.305347 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:04.305347 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:04.305347 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:04.305347 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:04.305347 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:04.305347 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:04.305347 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:04.305347 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:04.305347 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:04.305347 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:04.305347 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:04.307854 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:04.307854 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:04.307854 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:15:04.307854 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:15:04.307854 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:15:04.307854 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:15:04.307854 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:15:04.307854 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:15:04.307854 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 04:15:04.307854 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:04.307854 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 372/745] 10.222.0.91 () {56 vars in 1096 bytes} [Tue Aug 30 04:15:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:15:04.315696 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c535fdb-4ff7-4421-84e7-c7bdc93fd496 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:04.504982 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2b8532-0a59-4769-a2a2-331573cfa5d4 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:04.508273 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:04.508455 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c535fdb-4ff7-4421-84e7-c7bdc93fd496 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:04.555940 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3bbb11-e823-4052-9514-cf93b97bc187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:04.556649 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3bbb11-e823-4052-9514-cf93b97bc187 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:04.556926 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3bbb11-e823-4052-9514-cf93b97bc187 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:04.558004 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3bbb11-e823-4052-9514-cf93b97bc187 None admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:04.558357 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7edad42-2703-4317-a9d7-3a7ff5a23d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:04.558784 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3bbb11-e823-4052-9514-cf93b97bc187 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:04.559094 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3bbb11-e823-4052-9514-cf93b97bc187 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:04.559406 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7edad42-2703-4317-a9d7-3a7ff5a23d08 None admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:04.559899 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7edad42-2703-4317-a9d7-3a7ff5a23d08 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:04.560397 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7edad42-2703-4317-a9d7-3a7ff5a23d08 None admin] PATH_INFO: `/v3/services` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:04.560621 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3bbb11-e823-4052-9514-cf93b97bc187 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:04.561547 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7edad42-2703-4317-a9d7-3a7ff5a23d08 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:04.568443 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7edad42-2703-4317-a9d7-3a7ff5a23d08 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:04.583547 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 373/746] 10.222.0.91 () {56 vars in 1135 bytes} [Tue Aug 30 04:15:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:04.591082 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3bbb11-e823-4052-9514-cf93b97bc187 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:04.612745 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 374/747] 10.222.0.91 () {60 vars in 1141 bytes} [Tue Aug 30 04:15:04 2022] POST /identity/v3/services => generated 240 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:15:04.617330 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:04.741718 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3bbb11-e823-4052-9514-cf93b97bc187 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:04.802447 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f034a1-6dad-4568-873b-1928065c08b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:04.803003 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f034a1-6dad-4568-873b-1928065c08b3 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:04.803284 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f034a1-6dad-4568-873b-1928065c08b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:04.803558 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f034a1-6dad-4568-873b-1928065c08b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:04.901954 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f034a1-6dad-4568-873b-1928065c08b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:04.903501 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f034a1-6dad-4568-873b-1928065c08b3 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:04.906945 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:05.046102 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 374/748] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 30 04:15:04 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 04:15:05.052858 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7edad42-2703-4317-a9d7-3a7ff5a23d08 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:05.186982 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7edad42-2703-4317-a9d7-3a7ff5a23d08 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:05.232745 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c96110-50f8-4a6e-ba9d-cc5ba519ccc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:05.233424 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c96110-50f8-4a6e-ba9d-cc5ba519ccc2 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:05.233704 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c96110-50f8-4a6e-ba9d-cc5ba519ccc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:05.233974 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c96110-50f8-4a6e-ba9d-cc5ba519ccc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:05.251663 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c96110-50f8-4a6e-ba9d-cc5ba519ccc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:05.253377 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c96110-50f8-4a6e-ba9d-cc5ba519ccc2 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:05.280283 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-d7c96110-50f8-4a6e-ba9d-cc5ba519ccc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:15:05.280283 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:05.280283 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:05.280283 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:05.280283 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:05.280283 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:05.280283 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:05.280283 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:05.280283 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:05.280283 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:05.280283 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:05.280283 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:05.280283 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:15:05.280283 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:15:05.280283 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:15:05.280283 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:15:05.281323 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:05.281323 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:05.281323 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:05.281323 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:05.281323 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:05.281323 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:05.281323 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:05.281323 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:05.281323 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:05.281323 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:05.281323 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:05.281323 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:05.281323 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:05.281323 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:05.281323 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:05.281323 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:05.281323 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:15:05.282213 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:15:05.282213 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:15:05.282213 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:15:05.282213 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 375/749] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:15:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:15:05.287705 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f034a1-6dad-4568-873b-1928065c08b3 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:05.345940 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5198b8-b802-447e-8eac-13be3dcb9ca0 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:05.346736 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5198b8-b802-447e-8eac-13be3dcb9ca0 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:05.347364 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5198b8-b802-447e-8eac-13be3dcb9ca0 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:05.349849 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 376/750] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:15:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:15:05.357449 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22398534-c448-43a6-8241-7ab6e91a713a None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:05.358456 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22398534-c448-43a6-8241-7ab6e91a713a None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:05.359100 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22398534-c448-43a6-8241-7ab6e91a713a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:05.406850 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-22398534-c448-43a6-8241-7ab6e91a713a None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:05.408496 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-22398534-c448-43a6-8241-7ab6e91a713a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:05.423151 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:05.431948 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f034a1-6dad-4568-873b-1928065c08b3 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:05.431948 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:05.481329 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d32777-3904-43a2-bc7d-bb32529c0d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:05.481970 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d32777-3904-43a2-bc7d-bb32529c0d4c None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:05.482251 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d32777-3904-43a2-bc7d-bb32529c0d4c None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:05.482524 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d32777-3904-43a2-bc7d-bb32529c0d4c None admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:05.483190 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d32777-3904-43a2-bc7d-bb32529c0d4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:05.486774 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d32777-3904-43a2-bc7d-bb32529c0d4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:05.488364 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d32777-3904-43a2-bc7d-bb32529c0d4c None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:05.525840 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 375/751] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:15:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:05.529069 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d32777-3904-43a2-bc7d-bb32529c0d4c None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:05.591542 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 377/752] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:15:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 04:15:05.699529 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d32777-3904-43a2-bc7d-bb32529c0d4c None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:05.747210 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e37b1a9-46b7-4cb5-ad0e-fbf38a2b1ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:05.747887 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37b1a9-46b7-4cb5-ad0e-fbf38a2b1ac7 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:05.748194 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37b1a9-46b7-4cb5-ad0e-fbf38a2b1ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:05.748477 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37b1a9-46b7-4cb5-ad0e-fbf38a2b1ac7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:05.761357 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e37b1a9-46b7-4cb5-ad0e-fbf38a2b1ac7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:05.763010 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e37b1a9-46b7-4cb5-ad0e-fbf38a2b1ac7 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:05.780787 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-4e37b1a9-46b7-4cb5-ad0e-fbf38a2b1ac7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:15:05.780787 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:05.780787 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:05.780787 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:05.780787 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:05.780787 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:05.780787 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:05.780787 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:05.780787 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:05.780787 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:05.780787 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:05.780787 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:05.780787 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:15:05.780787 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:15:05.780787 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:15:05.781760 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:15:05.781760 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:05.781760 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:05.781760 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:05.781760 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:05.781760 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:05.781760 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:05.781760 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:05.781760 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:05.781760 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:05.781760 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:05.781760 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:05.781760 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:05.781760 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:05.781760 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:05.781760 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:05.781760 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:05.782659 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:15:05.782659 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:15:05.782659 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:15:05.782659 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:15:05.782659 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:15:05.782659 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:15:05.782659 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:15:05.782659 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:05.782659 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 376/753] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 30 04:15:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:15:05.789159 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22398534-c448-43a6-8241-7ab6e91a713a None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:05.875485 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e37b1a9-46b7-4cb5-ad0e-fbf38a2b1ac7 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:05.946643 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:06.051492 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22398534-c448-43a6-8241-7ab6e91a713a None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:06.062205 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e37b1a9-46b7-4cb5-ad0e-fbf38a2b1ac7 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:06.112540 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e633222-e067-46dd-8f93-ae54e821b5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:06.114280 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e633222-e067-46dd-8f93-ae54e821b5e7 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:06.114896 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e633222-e067-46dd-8f93-ae54e821b5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:06.115535 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e633222-e067-46dd-8f93-ae54e821b5e7 None admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:06.117053 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e633222-e067-46dd-8f93-ae54e821b5e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:06.117769 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e633222-e067-46dd-8f93-ae54e821b5e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:06.120607 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e633222-e067-46dd-8f93-ae54e821b5e7 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:06.138620 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 378/754] 10.222.0.91 () {56 vars in 1148 bytes} [Tue Aug 30 04:15:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:15:06.140427 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a202a-8dcf-48dc-8321-40cdbaaa1ec2 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:06.140937 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a202a-8dcf-48dc-8321-40cdbaaa1ec2 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:06.141384 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a202a-8dcf-48dc-8321-40cdbaaa1ec2 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:06.147602 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 379/755] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:15:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:15:06.148979 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13a202a-8dcf-48dc-8321-40cdbaaa1ec2 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:06.149564 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc5a5b-0c45-410a-bb97-d74cd34f0575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:06.151409 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc5a5b-0c45-410a-bb97-d74cd34f0575 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:06.151409 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc5a5b-0c45-410a-bb97-d74cd34f0575 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:06.151951 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc5a5b-0c45-410a-bb97-d74cd34f0575 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:06.153121 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bc5a5b-0c45-410a-bb97-d74cd34f0575 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:06.154605 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:06.156842 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bc5a5b-0c45-410a-bb97-d74cd34f0575 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:06.183441 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-a1bc5a5b-0c45-410a-bb97-d74cd34f0575 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 04:15:06.183441 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:06.183441 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:15:06.183441 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:15:06.183441 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:15:06.183441 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:15:06.183441 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:15:06.183441 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:15:06.183441 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 04:15:06.183441 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:06.183441 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:15:06.183441 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:06.183441 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:06.183441 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:06.183441 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:06.183441 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:06.183441 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:06.184594 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:06.184594 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:06.184594 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:06.184594 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:06.184594 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:06.184594 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:06.184594 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:15:06.184594 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:15:06.184594 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:15:06.184594 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:15:06.184594 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:06.184594 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:06.184594 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:06.184594 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:06.184594 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:06.184594 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:06.185465 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:06.185465 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:06.185465 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:06.185465 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:06.185465 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:06.185465 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:06.185465 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:06.185465 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:06.185465 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:06.185465 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:06.185465 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:15:06.185465 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:15:06.185465 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 04:15:06.185465 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:06.186330 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 377/756] 10.222.0.91 () {56 vars in 1129 bytes} [Tue Aug 30 04:15:05 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:15:06.191611 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb80150-92f7-49ff-97d3-83adcafc7cbe None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:06.191611 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb80150-92f7-49ff-97d3-83adcafc7cbe None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:06.191611 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb80150-92f7-49ff-97d3-83adcafc7cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:06.234424 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-0fb80150-92f7-49ff-97d3-83adcafc7cbe None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:06.237385 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-0fb80150-92f7-49ff-97d3-83adcafc7cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:06.307487 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13a202a-8dcf-48dc-8321-40cdbaaa1ec2 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:06.349673 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4956cc46-d53f-422d-9c68-e6e88de8653a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:06.350373 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956cc46-d53f-422d-9c68-e6e88de8653a None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:06.350650 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956cc46-d53f-422d-9c68-e6e88de8653a None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:06.350919 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956cc46-d53f-422d-9c68-e6e88de8653a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:06.351669 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4956cc46-d53f-422d-9c68-e6e88de8653a None admin] RBAC: Adding query filter params (role.id=d8f440a82947486ebb20a633ebee736b, scope.project.id=4e05769361674c8fa995050150ad4cfa, user.id=94b50f9552124b07822ae63c1d553864) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:06.352011 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4956cc46-d53f-422d-9c68-e6e88de8653a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:06.353654 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4956cc46-d53f-422d-9c68-e6e88de8653a None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:06.366487 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 380/757] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 30 04:15:06 2022] GET /identity/v3/role_assignments?user.id=94b50f9552124b07822ae63c1d553864&scope.project.id=4e05769361674c8fa995050150ad4cfa&role.id=d8f440a82947486ebb20a633ebee736b => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:06.367616 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4956cc46-d53f-422d-9c68-e6e88de8653a None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:06.389739 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 378/758] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:15:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:15:06.499617 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:06.548572 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4956cc46-d53f-422d-9c68-e6e88de8653a None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:06.599108 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753f552b-f334-4901-9701-26c6425b958c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:06.599857 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f552b-f334-4901-9701-26c6425b958c None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:06.600159 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f552b-f334-4901-9701-26c6425b958c None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:06.600434 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f552b-f334-4901-9701-26c6425b958c None admin] PATH_INFO: `/v3/services` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:06.601102 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753f552b-f334-4901-9701-26c6425b958c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:06.601407 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753f552b-f334-4901-9701-26c6425b958c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:06.602887 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753f552b-f334-4901-9701-26c6425b958c None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:06.613712 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 381/759] 10.222.0.91 () {56 vars in 1124 bytes} [Tue Aug 30 04:15:06 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:06.624597 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb80150-92f7-49ff-97d3-83adcafc7cbe None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:06.664938 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:06.740617 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc81c9-6c2b-4ef9-93b5-41597a6064d6 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:06.741340 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc81c9-6c2b-4ef9-93b5-41597a6064d6 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:06.741822 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc81c9-6c2b-4ef9-93b5-41597a6064d6 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:06.746116 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 382/760] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:15:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:15:06.750231 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc69b1-9294-43d0-b4fa-0fa415084168 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:06.750537 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc69b1-9294-43d0-b4fa-0fa415084168 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:06.750704 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc69b1-9294-43d0-b4fa-0fa415084168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:06.780208 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-64bc69b1-9294-43d0-b4fa-0fa415084168 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:06.783076 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-64bc69b1-9294-43d0-b4fa-0fa415084168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:06.813555 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb80150-92f7-49ff-97d3-83adcafc7cbe None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:06.865540 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc453f7f-e302-429a-8324-5568de5c894f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:06.866895 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc453f7f-e302-429a-8324-5568de5c894f None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:06.867569 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc453f7f-e302-429a-8324-5568de5c894f None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:06.868326 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc453f7f-e302-429a-8324-5568de5c894f None admin] PATH_INFO: `/v3/services` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:06.870104 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc453f7f-e302-429a-8324-5568de5c894f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:06.871150 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc453f7f-e302-429a-8324-5568de5c894f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:06.873950 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc453f7f-e302-429a-8324-5568de5c894f None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:06.887967 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 379/761] 10.222.0.91 () {56 vars in 1124 bytes} [Tue Aug 30 04:15:06 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:06.889572 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc453f7f-e302-429a-8324-5568de5c894f None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:06.950512 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 383/762] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:15:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 04:15:06.952574 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc69b1-9294-43d0-b4fa-0fa415084168 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:07.064520 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:07.076331 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:07.113466 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc69b1-9294-43d0-b4fa-0fa415084168 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:07.142540 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc453f7f-e302-429a-8324-5568de5c894f None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:07.211048 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a0196-b388-4acd-bdc8-829426800f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:07.211692 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a0196-b388-4acd-bdc8-829426800f4e None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:07.211992 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a0196-b388-4acd-bdc8-829426800f4e None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:07.212270 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a0196-b388-4acd-bdc8-829426800f4e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:07.214525 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a0196-b388-4acd-bdc8-829426800f4e None admin] RBAC: Adding query filter params (interface=public, service_id=ad3a74e3bfa24895895514049097bfd1, region_id=RegionOne) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:07.214882 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a0196-b388-4acd-bdc8-829426800f4e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:07.216474 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a0196-b388-4acd-bdc8-829426800f4e None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:07.228137 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 384/763] 10.222.0.91 () {56 vars in 1251 bytes} [Tue Aug 30 04:15:06 2022] GET /identity/v3/endpoints?service_id=ad3a74e3bfa24895895514049097bfd1&interface=public®ion_id=RegionOne => generated 194 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:07.239142 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a0196-b388-4acd-bdc8-829426800f4e None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:07.265405 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a8e09c-a004-4f29-9e11-835f56877afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:07.266073 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a8e09c-a004-4f29-9e11-835f56877afa None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:07.266354 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a8e09c-a004-4f29-9e11-835f56877afa None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:07.266632 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a8e09c-a004-4f29-9e11-835f56877afa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:07.286162 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a8e09c-a004-4f29-9e11-835f56877afa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:15:07.293355 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-64a8e09c-a004-4f29-9e11-835f56877afa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:15:07.293355 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:07.293355 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:07.293355 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:07.293355 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:07.293355 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:07.293355 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:07.293355 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:07.293355 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:07.293355 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:07.293355 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:07.293355 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:07.293355 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:15:07.293355 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:15:07.293355 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:15:07.293355 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:15:07.294374 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:15:07.294374 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:15:07.294374 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:15:07.294374 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:15:07.294374 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:07.294374 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:07.294374 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:07.294374 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:07.294374 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:07.294374 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:07.294374 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:07.294374 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:07.294374 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:07.294374 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:07.294374 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:07.294374 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:07.295226 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:07.295226 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:07.295226 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:07.295226 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:07.295226 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:15:07.295226 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:15:07.295226 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:15:07.295226 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:15:07.295226 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:15:07.295226 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:15:07.295226 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:15:07.295226 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:07.298174 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 380/764] 10.222.0.91 () {56 vars in 1096 bytes} [Tue Aug 30 04:15:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 409 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:15:07.299425 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a8e09c-a004-4f29-9e11-835f56877afa None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:07.389009 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a0196-b388-4acd-bdc8-829426800f4e None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:07.428438 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:07.447058 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac496a62-1e84-46d9-a744-7307a6e0f14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:07.447501 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a8e09c-a004-4f29-9e11-835f56877afa None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:07.448551 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac496a62-1e84-46d9-a744-7307a6e0f14a None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:07.448852 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac496a62-1e84-46d9-a744-7307a6e0f14a None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:07.449131 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac496a62-1e84-46d9-a744-7307a6e0f14a None admin] PATH_INFO: `/v3/services` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:07.449815 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac496a62-1e84-46d9-a744-7307a6e0f14a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:07.452739 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac496a62-1e84-46d9-a744-7307a6e0f14a None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:07.464083 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 385/765] 10.222.0.91 () {56 vars in 1087 bytes} [Tue Aug 30 04:15:07 2022] GET /identity/v3/services => generated 772 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:07.466305 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac496a62-1e84-46d9-a744-7307a6e0f14a None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:07.568343 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e8c6b6-5349-4ec5-a5c0-3d0afb52e79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:07.574316 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8c6b6-5349-4ec5-a5c0-3d0afb52e79d None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:07.575150 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8c6b6-5349-4ec5-a5c0-3d0afb52e79d None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:07.575804 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8c6b6-5349-4ec5-a5c0-3d0afb52e79d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:07.614731 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e8c6b6-5349-4ec5-a5c0-3d0afb52e79d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:15:07.641224 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-d5e8c6b6-5349-4ec5-a5c0-3d0afb52e79d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:15:07.641224 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:07.641224 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:07.641224 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:07.641224 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:07.641224 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:07.641224 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:07.641224 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:07.641224 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:07.641224 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:07.641224 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:07.641224 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:07.641224 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:15:07.641224 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:15:07.641224 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:15:07.641224 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:15:07.643041 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:15:07.643041 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:15:07.643041 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:15:07.643041 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:15:07.643041 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:07.643041 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:07.643041 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:07.643041 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:07.643041 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:07.643041 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:07.643041 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:07.643041 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:07.643041 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:07.643041 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:07.643041 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:07.643041 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:07.644723 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:07.644723 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:07.644723 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:07.644723 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:07.644723 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:15:07.644723 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:15:07.644723 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:15:07.644723 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:15:07.644723 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:15:07.644723 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:15:07.644723 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:15:07.644723 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:07.650815 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 381/766] 10.222.0.91 () {56 vars in 1102 bytes} [Tue Aug 30 04:15:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:15:07.661878 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e8c6b6-5349-4ec5-a5c0-3d0afb52e79d None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:07.672042 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:07.801389 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac496a62-1e84-46d9-a744-7307a6e0f14a None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:07.848432 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e8c6b6-5349-4ec5-a5c0-3d0afb52e79d None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:07.854968 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f306fe-0880-4dc2-9a98-d8d09dc52f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:07.856064 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f306fe-0880-4dc2-9a98-d8d09dc52f92 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:07.856570 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f306fe-0880-4dc2-9a98-d8d09dc52f92 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:07.857068 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f306fe-0880-4dc2-9a98-d8d09dc52f92 None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:07.858011 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f306fe-0880-4dc2-9a98-d8d09dc52f92 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:07.858535 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f306fe-0880-4dc2-9a98-d8d09dc52f92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:07.860207 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f306fe-0880-4dc2-9a98-d8d09dc52f92 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:07.877578 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 386/767] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 30 04:15:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:07.882663 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583efad-101d-48d3-b0c5-c5d8ac6bc4c7 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:07.882663 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583efad-101d-48d3-b0c5-c5d8ac6bc4c7 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:07.882663 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583efad-101d-48d3-b0c5-c5d8ac6bc4c7 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:07.883939 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 387/768] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:15:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:15:07.885806 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0583efad-101d-48d3-b0c5-c5d8ac6bc4c7 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:07.918426 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46719c45-ac50-4126-988d-059d02ef5594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:07.919554 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46719c45-ac50-4126-988d-059d02ef5594 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:07.920171 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46719c45-ac50-4126-988d-059d02ef5594 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:07.920659 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46719c45-ac50-4126-988d-059d02ef5594 None admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:07.921885 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46719c45-ac50-4126-988d-059d02ef5594 None admin] RBAC: Adding query filter params (name=service) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:07.922897 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46719c45-ac50-4126-988d-059d02ef5594 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:07.925787 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46719c45-ac50-4126-988d-059d02ef5594 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:07.945307 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 382/769] 10.222.0.91 () {56 vars in 1103 bytes} [Tue Aug 30 04:15:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:07.948675 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78506e-93e9-42fd-beca-4f187f7358fa None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:07.950083 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78506e-93e9-42fd-beca-4f187f7358fa None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:07.950898 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78506e-93e9-42fd-beca-4f187f7358fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:07.980916 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-0a78506e-93e9-42fd-beca-4f187f7358fa None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:07.982990 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-0a78506e-93e9-42fd-beca-4f187f7358fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:07.995236 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:08.062623 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0583efad-101d-48d3-b0c5-c5d8ac6bc4c7 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:08.111494 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:08.112698 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e757143-145d-466b-a7ae-5039d5098076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:08.114338 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e757143-145d-466b-a7ae-5039d5098076 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:08.116628 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e757143-145d-466b-a7ae-5039d5098076 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:08.117184 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e757143-145d-466b-a7ae-5039d5098076 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:08.132627 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 383/770] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:15:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:15:08.134738 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a78506e-93e9-42fd-beca-4f187f7358fa None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:08.136270 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e757143-145d-466b-a7ae-5039d5098076 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:08.138472 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e757143-145d-466b-a7ae-5039d5098076 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:08.160294 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-8e757143-145d-466b-a7ae-5039d5098076 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:15:08.160294 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:08.160294 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:08.160294 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:08.160294 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:08.160294 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:08.160294 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:08.160294 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:08.160294 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:08.160294 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:08.160294 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:08.160294 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:08.160294 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:15:08.160294 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:15:08.160294 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:15:08.160294 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:15:08.161361 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:08.161361 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:08.161361 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:08.161361 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:08.161361 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:08.161361 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:08.161361 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:08.161361 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:08.161361 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:08.161361 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:08.161361 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:08.161361 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:08.161361 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:08.161361 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:08.161361 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:08.161361 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:08.161361 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:15:08.162271 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:15:08.162271 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:15:08.162271 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:15:08.164953 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 388/771] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:15:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:15:08.172723 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e757143-145d-466b-a7ae-5039d5098076 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:08.446791 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e757143-145d-466b-a7ae-5039d5098076 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:08.452406 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:08.491241 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a78506e-93e9-42fd-beca-4f187f7358fa None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:08.513283 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617a942c-bd9a-4a20-8328-3d2d7a4a59b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:08.514323 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a942c-bd9a-4a20-8328-3d2d7a4a59b6 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:08.514804 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a942c-bd9a-4a20-8328-3d2d7a4a59b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:08.515281 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a942c-bd9a-4a20-8328-3d2d7a4a59b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:08.516515 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617a942c-bd9a-4a20-8328-3d2d7a4a59b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:08.517047 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617a942c-bd9a-4a20-8328-3d2d7a4a59b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:08.519715 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617a942c-bd9a-4a20-8328-3d2d7a4a59b6 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:08.543387 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 389/772] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:15:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:08.553705 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617a942c-bd9a-4a20-8328-3d2d7a4a59b6 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:08.650776 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bdd84d-768e-4906-a8dd-c87f185ae5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:08.651812 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bdd84d-768e-4906-a8dd-c87f185ae5ff None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:08.652279 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bdd84d-768e-4906-a8dd-c87f185ae5ff None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:08.652737 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bdd84d-768e-4906-a8dd-c87f185ae5ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:08.705732 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bdd84d-768e-4906-a8dd-c87f185ae5ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:08.708510 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bdd84d-768e-4906-a8dd-c87f185ae5ff None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:08.748510 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-39bdd84d-768e-4906-a8dd-c87f185ae5ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:15:08.748510 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:08.748510 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:08.748510 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:08.748510 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:08.748510 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:08.748510 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:08.748510 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:08.748510 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:08.748510 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:08.748510 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:08.748510 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:08.748510 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:15:08.748510 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:15:08.748510 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:15:08.748510 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:15:08.749564 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:08.749564 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:08.749564 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:08.749564 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:08.749564 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:08.749564 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:08.749564 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:08.749564 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:08.749564 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:08.749564 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:08.749564 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:08.749564 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:08.749564 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:08.749564 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:08.749564 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:08.749564 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:08.749564 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:15:08.750909 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:15:08.750909 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:15:08.750909 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:08.750909 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 384/773] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:15:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 617 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:15:08.750909 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bdd84d-768e-4906-a8dd-c87f185ae5ff None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:08.771287 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617a942c-bd9a-4a20-8328-3d2d7a4a59b6 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:08.836747 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:08.841026 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a86d5dd-ea9d-496e-98b8-38421c512ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:08.842096 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a86d5dd-ea9d-496e-98b8-38421c512ca3 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:08.842581 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a86d5dd-ea9d-496e-98b8-38421c512ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:08.843053 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a86d5dd-ea9d-496e-98b8-38421c512ca3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:08.860210 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a86d5dd-ea9d-496e-98b8-38421c512ca3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:08.863218 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a86d5dd-ea9d-496e-98b8-38421c512ca3 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:08.884439 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bdd84d-768e-4906-a8dd-c87f185ae5ff None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:08.889834 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-6a86d5dd-ea9d-496e-98b8-38421c512ca3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 04:15:08.889834 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:08.889834 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:08.889834 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:08.889834 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:08.889834 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:08.889834 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:08.889834 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:08.889834 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:08.889834 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:08.889834 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:08.889834 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:08.889834 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:15:08.889834 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:15:08.889834 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:15:08.889834 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:15:08.890852 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:08.890852 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:08.890852 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:15:08.890852 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:15:08.890852 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:15:08.890852 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:15:08.890852 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:08.890852 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:08.890852 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:08.890852 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:08.890852 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:08.890852 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:08.890852 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:08.890852 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:08.890852 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:08.890852 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:08.890852 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:08.890852 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:08.891805 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:08.891805 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:08.891805 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:15:08.891805 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:15:08.891805 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:15:08.891805 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:15:08.891805 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:15:08.891805 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:15:08.891805 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 04:15:08.891805 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:15:08.893100 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 390/774] 10.222.0.91 () {56 vars in 1093 bytes} [Tue Aug 30 04:15:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:15:08.893879 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a86d5dd-ea9d-496e-98b8-38421c512ca3 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:08.931463 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5fe85-8a8a-4b1f-b3c3-f95c134eaf95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:08.932777 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5fe85-8a8a-4b1f-b3c3-f95c134eaf95 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:08.933468 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5fe85-8a8a-4b1f-b3c3-f95c134eaf95 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:08.933946 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5fe85-8a8a-4b1f-b3c3-f95c134eaf95 None admin] PATH_INFO: `/v3/services/network` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:08.934778 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b5fe85-8a8a-4b1f-b3c3-f95c134eaf95 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:08.936547 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b5fe85-8a8a-4b1f-b3c3-f95c134eaf95 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:08.945045 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:08.949408 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-81b5fe85-8a8a-4b1f-b3c3-f95c134eaf95 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 04:15:08.949408 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:08.949408 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:15:08.949408 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:15:08.949408 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:15:08.949408 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:15:08.949408 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:15:08.949408 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:15:08.949408 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 04:15:08.949408 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:08.949408 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:15:08.949408 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:08.949408 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:08.949408 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:08.949408 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:08.949408 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:08.949408 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:08.950659 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:08.950659 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:08.950659 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:08.950659 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:08.950659 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:08.950659 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:08.950659 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:15:08.950659 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:15:08.950659 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:15:08.950659 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:15:08.950659 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:08.950659 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:08.950659 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:08.950659 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:08.950659 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:08.950659 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:08.951721 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:08.951721 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:08.951721 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:08.951721 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:08.951721 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:08.951721 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:08.951721 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:08.951721 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:08.951721 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:08.951721 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:08.951721 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:15:08.951721 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:15:08.951721 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 04:15:08.951721 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:08.954798 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 385/775] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 30 04:15:08 2022] GET /identity/v3/services/network => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:15:08.956227 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5fe85-8a8a-4b1f-b3c3-f95c134eaf95 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:09.058324 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a86d5dd-ea9d-496e-98b8-38421c512ca3 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:09.088906 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5fe85-8a8a-4b1f-b3c3-f95c134eaf95 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:09.103404 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:09.106858 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d30753-3ffc-4d48-a014-d5caad3a89c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:09.107601 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d30753-3ffc-4d48-a014-d5caad3a89c5 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:09.108013 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d30753-3ffc-4d48-a014-d5caad3a89c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:09.108355 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d30753-3ffc-4d48-a014-d5caad3a89c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:09.109077 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d30753-3ffc-4d48-a014-d5caad3a89c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:09.109301 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d30753-3ffc-4d48-a014-d5caad3a89c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:09.110734 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d30753-3ffc-4d48-a014-d5caad3a89c5 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:09.124860 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 391/776] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:15:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:09.125752 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d30753-3ffc-4d48-a014-d5caad3a89c5 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:09.146387 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f108264-fab9-4f3b-a9ef-25a1fb5b29bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:09.147263 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f108264-fab9-4f3b-a9ef-25a1fb5b29bb None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:09.147678 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f108264-fab9-4f3b-a9ef-25a1fb5b29bb None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:09.148107 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f108264-fab9-4f3b-a9ef-25a1fb5b29bb None admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:09.149088 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f108264-fab9-4f3b-a9ef-25a1fb5b29bb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:09.149435 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f108264-fab9-4f3b-a9ef-25a1fb5b29bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:09.151773 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f108264-fab9-4f3b-a9ef-25a1fb5b29bb None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:09.175702 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 386/777] 10.222.0.91 () {56 vars in 1133 bytes} [Tue Aug 30 04:15:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:09.177132 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb655755-b55b-46f1-a06e-976b61f3351f None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:09.177420 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb655755-b55b-46f1-a06e-976b61f3351f None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:09.177694 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb655755-b55b-46f1-a06e-976b61f3351f None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:09.183905 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 387/778] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:15:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:15:09.185900 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb655755-b55b-46f1-a06e-976b61f3351f None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:09.248223 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:09.272250 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d30753-3ffc-4d48-a014-d5caad3a89c5 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:09.328868 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded9f62-0a71-4513-8cf3-fe87cbe4a76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:09.329763 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded9f62-0a71-4513-8cf3-fe87cbe4a76f None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:09.330163 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded9f62-0a71-4513-8cf3-fe87cbe4a76f None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:09.330625 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded9f62-0a71-4513-8cf3-fe87cbe4a76f None admin] PATH_INFO: `/v3/services` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:09.331661 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eded9f62-0a71-4513-8cf3-fe87cbe4a76f None admin] RBAC: Adding query filter params (name=network) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:09.332174 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eded9f62-0a71-4513-8cf3-fe87cbe4a76f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:09.334547 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eded9f62-0a71-4513-8cf3-fe87cbe4a76f None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:09.341759 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 392/779] 10.222.0.91 () {56 vars in 1112 bytes} [Tue Aug 30 04:15:09 2022] GET /identity/v3/services?name=network => generated 124 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:09.343048 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded9f62-0a71-4513-8cf3-fe87cbe4a76f None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:09.345904 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb655755-b55b-46f1-a06e-976b61f3351f None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:09.392888 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0879105-61b6-43f1-9924-aa2b976dbbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:09.393550 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0879105-61b6-43f1-9924-aa2b976dbbb0 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:09.393864 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0879105-61b6-43f1-9924-aa2b976dbbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:09.394132 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0879105-61b6-43f1-9924-aa2b976dbbb0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:09.403090 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0879105-61b6-43f1-9924-aa2b976dbbb0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:09.404697 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0879105-61b6-43f1-9924-aa2b976dbbb0 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:09.421342 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-b0879105-61b6-43f1-9924-aa2b976dbbb0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 04:15:09.421342 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:09.421342 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:09.421342 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:09.421342 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:09.421342 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:09.421342 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:09.421342 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:09.421342 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:09.421342 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:09.421342 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:09.421342 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:09.421342 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:15:09.421342 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:15:09.421342 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:15:09.421342 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:15:09.423249 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:09.423249 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:09.423249 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:15:09.423249 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:15:09.423249 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:15:09.423249 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:15:09.423249 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:09.423249 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:09.423249 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:09.423249 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:09.423249 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:09.423249 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:09.423249 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:09.423249 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:09.423249 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:09.423249 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:09.423249 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:09.423249 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:09.425144 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:09.425144 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:09.425144 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:15:09.425144 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:15:09.425144 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:15:09.425144 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:15:09.425144 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:15:09.425144 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:15:09.425144 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 04:15:09.425144 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:09.425144 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 388/780] 10.222.0.91 () {56 vars in 1117 bytes} [Tue Aug 30 04:15:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:15:09.426353 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fdc422-1cee-4615-b861-2edec16c02e6 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:09.426353 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fdc422-1cee-4615-b861-2edec16c02e6 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:09.426353 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fdc422-1cee-4615-b861-2edec16c02e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:09.451893 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-b6fdc422-1cee-4615-b861-2edec16c02e6 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:09.453855 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-b6fdc422-1cee-4615-b861-2edec16c02e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:09.481511 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded9f62-0a71-4513-8cf3-fe87cbe4a76f None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:09.487195 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:09.533461 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdba039-32f0-4733-92b8-88ef9380bfc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:09.534463 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdba039-32f0-4733-92b8-88ef9380bfc6 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:09.535020 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdba039-32f0-4733-92b8-88ef9380bfc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:09.535294 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdba039-32f0-4733-92b8-88ef9380bfc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:09.555950 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 389/781] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:15:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:15:09.555950 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fdc422-1cee-4615-b861-2edec16c02e6 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:09.560399 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdba039-32f0-4733-92b8-88ef9380bfc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:09.562134 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdba039-32f0-4733-92b8-88ef9380bfc6 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:09.571869 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:09.584882 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-0cdba039-32f0-4733-92b8-88ef9380bfc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:15:09.584882 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:09.584882 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:09.584882 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:09.584882 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:09.584882 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:09.584882 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:09.584882 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:09.584882 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:09.584882 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:09.584882 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:09.584882 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:09.584882 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:15:09.584882 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:15:09.584882 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:15:09.584882 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:15:09.586934 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:09.586934 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:09.586934 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:09.586934 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:09.586934 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:09.586934 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:09.586934 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:09.586934 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:09.586934 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:09.586934 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:09.586934 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:09.586934 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:09.586934 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:09.586934 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:09.586934 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:09.586934 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:09.586934 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:15:09.589707 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:15:09.589707 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:15:09.589707 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:15:09.593903 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 393/782] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:15:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:15:09.593903 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdba039-32f0-4733-92b8-88ef9380bfc6 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:09.751291 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fdc422-1cee-4615-b861-2edec16c02e6 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:09.798173 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdba039-32f0-4733-92b8-88ef9380bfc6 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:09.820959 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a638983-20b9-406d-b476-ff7668ed4c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:09.822187 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a638983-20b9-406d-b476-ff7668ed4c7a None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:09.823052 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a638983-20b9-406d-b476-ff7668ed4c7a None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:09.823685 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a638983-20b9-406d-b476-ff7668ed4c7a None admin] PATH_INFO: `/v3/services` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:09.825012 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a638983-20b9-406d-b476-ff7668ed4c7a None admin] RBAC: Adding query filter params (type=network) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:09.825725 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a638983-20b9-406d-b476-ff7668ed4c7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:09.828421 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a638983-20b9-406d-b476-ff7668ed4c7a None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:09.843357 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 390/783] 10.222.0.91 () {56 vars in 1112 bytes} [Tue Aug 30 04:15:09 2022] GET /identity/v3/services?type=network => generated 350 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:09.843357 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a638983-20b9-406d-b476-ff7668ed4c7a None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:09.871052 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c591a3-b4b2-48fb-9f52-69603f6b1fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:09.872430 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c591a3-b4b2-48fb-9f52-69603f6b1fcf None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:09.873200 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c591a3-b4b2-48fb-9f52-69603f6b1fcf None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:09.873934 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c591a3-b4b2-48fb-9f52-69603f6b1fcf None admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:09.875602 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c591a3-b4b2-48fb-9f52-69603f6b1fcf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:09.876123 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c591a3-b4b2-48fb-9f52-69603f6b1fcf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:09.878677 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c591a3-b4b2-48fb-9f52-69603f6b1fcf None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:09.889026 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:09.903519 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 394/784] 10.222.0.91 () {56 vars in 1149 bytes} [Tue Aug 30 04:15:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:09.905548 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c591a3-b4b2-48fb-9f52-69603f6b1fcf None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:09.985709 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:09.998534 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a638983-20b9-406d-b476-ff7668ed4c7a None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:10.039456 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c8d6e2-b238-41cb-95ee-93544ab08575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:10.040133 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c8d6e2-b238-41cb-95ee-93544ab08575 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:10.040509 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c8d6e2-b238-41cb-95ee-93544ab08575 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:10.040711 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c8d6e2-b238-41cb-95ee-93544ab08575 None admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:10.041623 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c8d6e2-b238-41cb-95ee-93544ab08575 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:10.042120 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c8d6e2-b238-41cb-95ee-93544ab08575 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:10.043969 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c8d6e2-b238-41cb-95ee-93544ab08575 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:10.055863 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c591a3-b4b2-48fb-9f52-69603f6b1fcf None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:10.063960 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 391/785] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:15:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:10.063960 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c8d6e2-b238-41cb-95ee-93544ab08575 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:10.118096 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c64a8da-2b97-4e6f-a3a1-22b549cdabee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:10.119101 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c64a8da-2b97-4e6f-a3a1-22b549cdabee None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:10.119550 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c64a8da-2b97-4e6f-a3a1-22b549cdabee None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:10.120036 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c64a8da-2b97-4e6f-a3a1-22b549cdabee None admin] PATH_INFO: `/v3/endpoints` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:10.121223 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c64a8da-2b97-4e6f-a3a1-22b549cdabee None admin] RBAC: Adding query filter params (interface=public, service_id=1f5af3f49f0d44319066c63ae7e14c2f, region_id=RegionOne) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:10.121712 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c64a8da-2b97-4e6f-a3a1-22b549cdabee None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:10.124156 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c64a8da-2b97-4e6f-a3a1-22b549cdabee None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:10.137893 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 395/786] 10.222.0.91 () {56 vars in 1251 bytes} [Tue Aug 30 04:15:09 2022] GET /identity/v3/endpoints?service_id=1f5af3f49f0d44319066c63ae7e14c2f&interface=public®ion_id=RegionOne => generated 194 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:10.137893 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c64a8da-2b97-4e6f-a3a1-22b549cdabee None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:10.185317 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:10.210072 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c8d6e2-b238-41cb-95ee-93544ab08575 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:10.253107 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f08930-63be-48b1-a80a-474ef3213766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:10.254111 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f08930-63be-48b1-a80a-474ef3213766 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:10.254556 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f08930-63be-48b1-a80a-474ef3213766 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:10.254936 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f08930-63be-48b1-a80a-474ef3213766 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:10.263665 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c64a8da-2b97-4e6f-a3a1-22b549cdabee None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:10.272516 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f08930-63be-48b1-a80a-474ef3213766 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:15:10.281847 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-a8f08930-63be-48b1-a80a-474ef3213766 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:15:10.281847 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:10.281847 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:10.281847 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:10.281847 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:10.281847 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:10.281847 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:10.281847 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:10.281847 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:10.281847 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:10.281847 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:10.281847 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:10.281847 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:15:10.281847 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:15:10.281847 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:15:10.281847 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:15:10.282949 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:15:10.282949 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:15:10.282949 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:15:10.282949 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:15:10.282949 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:10.282949 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:10.282949 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:10.282949 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:10.282949 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:10.282949 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:10.282949 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:10.282949 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:10.282949 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:10.282949 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:10.282949 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:10.282949 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:10.284254 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:10.284254 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:10.284254 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:10.284254 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:10.284254 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:15:10.284254 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:15:10.284254 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:15:10.284254 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:15:10.284254 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:15:10.284254 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:15:10.284254 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:15:10.284254 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:10.284254 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 392/787] 10.222.0.91 () {56 vars in 1096 bytes} [Tue Aug 30 04:15:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:15:10.285116 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f08930-63be-48b1-a80a-474ef3213766 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:10.301787 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:10.321301 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ccd6ff-6619-4d22-a5da-60351b8bfae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:10.321988 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ccd6ff-6619-4d22-a5da-60351b8bfae0 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:10.322444 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ccd6ff-6619-4d22-a5da-60351b8bfae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:10.322914 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ccd6ff-6619-4d22-a5da-60351b8bfae0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:10.335741 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ccd6ff-6619-4d22-a5da-60351b8bfae0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:10.337276 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ccd6ff-6619-4d22-a5da-60351b8bfae0 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:10.361773 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-f1ccd6ff-6619-4d22-a5da-60351b8bfae0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:15:10.361773 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:10.361773 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:10.361773 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:10.361773 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:10.361773 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:10.361773 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:10.361773 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:10.361773 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:10.361773 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:10.361773 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:10.361773 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:10.361773 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:15:10.361773 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:15:10.361773 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:15:10.361773 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:15:10.362940 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:10.362940 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:10.362940 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:10.362940 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:10.362940 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:10.362940 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:10.362940 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:10.362940 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:10.362940 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:10.362940 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:10.362940 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:10.362940 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:10.362940 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:10.362940 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:10.362940 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:10.362940 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:10.362940 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:15:10.363853 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:15:10.363853 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:15:10.363853 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:15:10.363853 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 396/788] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:15:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:15:10.365188 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6198a7-251c-46bf-85f5-4705a77d02d1 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:10.365547 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6198a7-251c-46bf-85f5-4705a77d02d1 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:10.365948 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6198a7-251c-46bf-85f5-4705a77d02d1 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:10.367403 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 397/789] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:15:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:15:10.368345 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6198a7-251c-46bf-85f5-4705a77d02d1 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:10.430718 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f08930-63be-48b1-a80a-474ef3213766 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:10.472907 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67322069-6c6f-4bc7-bfaf-2fba6782844f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:10.473745 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67322069-6c6f-4bc7-bfaf-2fba6782844f None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:10.474109 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67322069-6c6f-4bc7-bfaf-2fba6782844f None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:10.474475 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67322069-6c6f-4bc7-bfaf-2fba6782844f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:10.482686 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67322069-6c6f-4bc7-bfaf-2fba6782844f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:10.484224 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67322069-6c6f-4bc7-bfaf-2fba6782844f None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:10.496895 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-67322069-6c6f-4bc7-bfaf-2fba6782844f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:15:10.496895 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:10.496895 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:10.496895 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:10.496895 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:10.496895 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:10.496895 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:10.496895 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:10.496895 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:10.496895 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:10.496895 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:10.496895 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:10.496895 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:15:10.496895 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:15:10.496895 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:15:10.498032 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:15:10.498032 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:10.498032 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:10.498032 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:10.498032 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:10.498032 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:10.498032 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:10.498032 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:10.498032 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:10.498032 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:10.498032 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:10.498032 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:10.498032 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:10.498032 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:10.498032 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:10.498032 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:10.498032 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:10.499001 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:15:10.499001 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:15:10.499001 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:15:10.499001 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:15:10.499001 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:15:10.499001 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:15:10.499001 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:15:10.499001 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:10.499001 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 393/790] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 30 04:15:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:15:10.499001 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67322069-6c6f-4bc7-bfaf-2fba6782844f None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:10.501107 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6198a7-251c-46bf-85f5-4705a77d02d1 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:10.503127 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:10.546240 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2bbf75-f5cd-409c-b6e0-84695769b73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:10.546879 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2bbf75-f5cd-409c-b6e0-84695769b73e None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:10.547140 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2bbf75-f5cd-409c-b6e0-84695769b73e None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:10.547416 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2bbf75-f5cd-409c-b6e0-84695769b73e None admin] PATH_INFO: `/v3/services` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:10.548077 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2bbf75-f5cd-409c-b6e0-84695769b73e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:10.549479 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2bbf75-f5cd-409c-b6e0-84695769b73e None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:10.555266 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 398/791] 10.222.0.91 () {56 vars in 1087 bytes} [Tue Aug 30 04:15:10 2022] GET /identity/v3/services => generated 772 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:10.556325 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2bbf75-f5cd-409c-b6e0-84695769b73e None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:10.627889 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:10.648563 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67322069-6c6f-4bc7-bfaf-2fba6782844f None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:10.694391 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae79da-74ca-4461-ae54-bd5890225419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:10.695138 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae79da-74ca-4461-ae54-bd5890225419 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:10.695459 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae79da-74ca-4461-ae54-bd5890225419 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:10.695786 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae79da-74ca-4461-ae54-bd5890225419 None admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:10.696649 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ae79da-74ca-4461-ae54-bd5890225419 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:10.697161 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ae79da-74ca-4461-ae54-bd5890225419 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:10.698943 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ae79da-74ca-4461-ae54-bd5890225419 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:10.708984 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 394/792] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 30 04:15:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:10.710329 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2bc13-562b-43bf-a9e7-b8bc0a06f108 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:10.710650 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2bc13-562b-43bf-a9e7-b8bc0a06f108 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:10.711013 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2bc13-562b-43bf-a9e7-b8bc0a06f108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:10.736551 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2bbf75-f5cd-409c-b6e0-84695769b73e None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:10.738946 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-f6c2bc13-562b-43bf-a9e7-b8bc0a06f108 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:10.741229 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-f6c2bc13-562b-43bf-a9e7-b8bc0a06f108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:10.778295 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f51749b-5686-4d09-8707-1ee234226a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:10.778940 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f51749b-5686-4d09-8707-1ee234226a26 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:10.779213 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f51749b-5686-4d09-8707-1ee234226a26 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:10.779483 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f51749b-5686-4d09-8707-1ee234226a26 None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:10.780187 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f51749b-5686-4d09-8707-1ee234226a26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:10.780492 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f51749b-5686-4d09-8707-1ee234226a26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:10.781896 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f51749b-5686-4d09-8707-1ee234226a26 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:10.798026 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 399/793] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:15:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:10.799288 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f51749b-5686-4d09-8707-1ee234226a26 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:10.845379 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:10.866221 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 395/794] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:15:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:15:10.866221 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c2bc13-562b-43bf-a9e7-b8bc0a06f108 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:11.005133 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c2bc13-562b-43bf-a9e7-b8bc0a06f108 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:11.023092 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:11.035213 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f51749b-5686-4d09-8707-1ee234226a26 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:11.084500 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a0ede-7289-49fb-beda-03b7863c443e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:11.085890 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a0ede-7289-49fb-beda-03b7863c443e None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:11.086570 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a0ede-7289-49fb-beda-03b7863c443e None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:11.087229 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a0ede-7289-49fb-beda-03b7863c443e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:11.101432 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2a0ede-7289-49fb-beda-03b7863c443e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:11.103279 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2a0ede-7289-49fb-beda-03b7863c443e None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:11.106338 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a99bb-3989-444f-a348-3a037681a34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:11.107682 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a99bb-3989-444f-a348-3a037681a34b None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:11.108398 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a99bb-3989-444f-a348-3a037681a34b None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:11.109063 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a99bb-3989-444f-a348-3a037681a34b None admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:11.110657 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4a99bb-3989-444f-a348-3a037681a34b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:11.111429 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4a99bb-3989-444f-a348-3a037681a34b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:11.114521 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4a99bb-3989-444f-a348-3a037681a34b None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:11.123330 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-db2a0ede-7289-49fb-beda-03b7863c443e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:15:11.123330 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:11.123330 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:11.123330 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:11.123330 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:11.123330 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:11.123330 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:11.123330 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:11.123330 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:11.123330 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:11.123330 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:11.123330 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:11.123330 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:15:11.123330 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:15:11.123330 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:15:11.123330 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:15:11.125479 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:11.125479 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:11.125479 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:11.125479 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:11.125479 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:11.125479 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:11.125479 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:11.125479 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:11.125479 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:11.125479 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:11.125479 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:11.125479 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:11.125479 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:11.125479 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:11.125479 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:11.125479 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:11.125479 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:15:11.127759 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:15:11.127759 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:15:11.127759 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:11.131554 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 396/795] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:15:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:15:11.132992 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a0ede-7289-49fb-beda-03b7863c443e None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:11.146057 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 400/796] 10.222.0.91 () {56 vars in 1148 bytes} [Tue Aug 30 04:15:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:11.148611 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a99bb-3989-444f-a348-3a037681a34b None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:11.217947 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:11.287321 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a0ede-7289-49fb-beda-03b7863c443e None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:11.333565 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feb0904-8c21-4a8b-ad93-76eb22f0eb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:11.334291 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb0904-8c21-4a8b-ad93-76eb22f0eb50 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:11.334565 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb0904-8c21-4a8b-ad93-76eb22f0eb50 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:11.334832 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb0904-8c21-4a8b-ad93-76eb22f0eb50 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:11.343137 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a99bb-3989-444f-a348-3a037681a34b None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:11.343349 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feb0904-8c21-4a8b-ad93-76eb22f0eb50 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:11.344710 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feb0904-8c21-4a8b-ad93-76eb22f0eb50 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:11.359721 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-0feb0904-8c21-4a8b-ad93-76eb22f0eb50 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:15:11.359721 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:11.359721 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:11.359721 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:11.359721 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:11.359721 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:11.359721 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:11.359721 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:11.359721 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:11.359721 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:11.359721 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:11.359721 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:11.359721 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:15:11.359721 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:15:11.359721 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:15:11.361268 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:15:11.361268 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:11.361268 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:11.361268 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:11.361268 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:11.361268 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:11.361268 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:11.361268 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:11.361268 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:11.361268 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:11.361268 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:11.361268 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:11.361268 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:11.361268 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:11.361268 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:11.361268 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:11.361268 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:11.362668 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:15:11.362668 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:15:11.362668 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:15:11.362668 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:15:11.362668 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:15:11.362668 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:15:11.362668 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:15:11.362668 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:11.364394 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 397/797] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 30 04:15:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:15:11.366087 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feb0904-8c21-4a8b-ad93-76eb22f0eb50 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:11.398168 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70274b34-7645-434a-9ac8-44e096045626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:11.398795 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70274b34-7645-434a-9ac8-44e096045626 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:11.399070 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70274b34-7645-434a-9ac8-44e096045626 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:11.399340 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70274b34-7645-434a-9ac8-44e096045626 None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:11.400039 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70274b34-7645-434a-9ac8-44e096045626 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:11.400399 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70274b34-7645-434a-9ac8-44e096045626 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:11.401848 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70274b34-7645-434a-9ac8-44e096045626 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:11.415265 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 401/798] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:15:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:11.416133 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70274b34-7645-434a-9ac8-44e096045626 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:11.448818 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:11.527988 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feb0904-8c21-4a8b-ad93-76eb22f0eb50 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:11.541553 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:11.560707 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70274b34-7645-434a-9ac8-44e096045626 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:11.579894 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c10b2f-0cc9-4095-b6c3-c9534312c662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:11.580929 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c10b2f-0cc9-4095-b6c3-c9534312c662 None admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:11.581336 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c10b2f-0cc9-4095-b6c3-c9534312c662 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:11.581789 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c10b2f-0cc9-4095-b6c3-c9534312c662 None admin] PATH_INFO: `/v3/projects/4e05769361674c8fa995050150ad4cfa/users/d806295278ae4997b5c6968aa553290c/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:11.584191 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c10b2f-0cc9-4095-b6c3-c9534312c662 None admin] RBAC: Authorizing `identity:create_grant(project_id=4e05769361674c8fa995050150ad4cfa, user_id=d806295278ae4997b5c6968aa553290c, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:11.586197 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c10b2f-0cc9-4095-b6c3-c9534312c662 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:11.607455 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdafab2-9636-42ff-9d2f-ec84fcca1533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:11.608390 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 398/799] 10.222.0.91 () {58 vars in 1439 bytes} [Tue Aug 30 04:15:11 2022] PUT /identity/v3/projects/4e05769361674c8fa995050150ad4cfa/users/d806295278ae4997b5c6968aa553290c/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:15:11.608557 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdafab2-9636-42ff-9d2f-ec84fcca1533 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:11.608914 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdafab2-9636-42ff-9d2f-ec84fcca1533 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:11.609354 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdafab2-9636-42ff-9d2f-ec84fcca1533 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:11.610335 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdafab2-9636-42ff-9d2f-ec84fcca1533 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:11.610726 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c10b2f-0cc9-4095-b6c3-c9534312c662 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:11.612332 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdafab2-9636-42ff-9d2f-ec84fcca1533 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:11.633083 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-dbdafab2-9636-42ff-9d2f-ec84fcca1533 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 04:15:11.633083 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:11.633083 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:15:11.633083 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:15:11.633083 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:15:11.633083 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:15:11.633083 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:15:11.633083 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:15:11.633083 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 04:15:11.633083 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:15:11.633083 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:15:11.633083 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:15:11.633083 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:11.633083 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:11.633083 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:11.633083 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:11.633083 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:11.635453 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:11.635453 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:11.635453 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:11.635453 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:11.635453 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:11.635453 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:11.635453 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:15:11.635453 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:15:11.635453 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:15:11.635453 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:15:11.635453 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:11.635453 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:11.635453 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:11.635453 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:11.635453 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:11.635453 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:11.637203 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:11.637203 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:11.637203 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:11.637203 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:11.637203 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:11.637203 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:11.637203 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:11.637203 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:11.637203 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:11.637203 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:11.637203 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:15:11.637203 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:15:11.637203 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 04:15:11.637203 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:15:11.644183 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 402/800] 10.222.0.91 () {56 vars in 1129 bytes} [Tue Aug 30 04:15:11 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:15:11.646072 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdafab2-9636-42ff-9d2f-ec84fcca1533 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:11.822923 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:11.840755 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c10b2f-0cc9-4095-b6c3-c9534312c662 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:11.868243 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdafab2-9636-42ff-9d2f-ec84fcca1533 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:11.888953 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edac410-01b6-49c8-8662-cb1f429667a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:11.889702 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edac410-01b6-49c8-8662-cb1f429667a8 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:11.890187 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edac410-01b6-49c8-8662-cb1f429667a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:11.890536 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edac410-01b6-49c8-8662-cb1f429667a8 None admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:11.891839 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edac410-01b6-49c8-8662-cb1f429667a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:11.892266 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edac410-01b6-49c8-8662-cb1f429667a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:11.894199 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edac410-01b6-49c8-8662-cb1f429667a8 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:11.912818 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 399/801] 10.222.0.91 () {56 vars in 1148 bytes} [Tue Aug 30 04:15:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:11.914104 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edac410-01b6-49c8-8662-cb1f429667a8 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:11.946113 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43debc48-8b65-409b-a15a-0c02fc04f3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:11.947365 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43debc48-8b65-409b-a15a-0c02fc04f3d4 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:11.948976 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43debc48-8b65-409b-a15a-0c02fc04f3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:11.949470 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43debc48-8b65-409b-a15a-0c02fc04f3d4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:11.952440 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:11.969874 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43debc48-8b65-409b-a15a-0c02fc04f3d4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:11.972786 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43debc48-8b65-409b-a15a-0c02fc04f3d4 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:11.998605 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-43debc48-8b65-409b-a15a-0c02fc04f3d4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 04:15:11.998605 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:11.998605 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:11.998605 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:11.998605 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:11.998605 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:11.998605 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:11.998605 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:11.998605 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:11.998605 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:11.998605 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:11.998605 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:11.998605 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:15:11.998605 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:15:11.998605 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:15:11.998605 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:15:12.000707 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:12.000707 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:12.000707 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:15:12.000707 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:15:12.000707 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:15:12.000707 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:15:12.000707 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:12.000707 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:12.000707 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:12.000707 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:12.000707 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:12.000707 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:12.000707 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:12.000707 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:12.000707 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:12.000707 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:12.000707 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:12.000707 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:12.002729 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:12.002729 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:12.002729 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:15:12.002729 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:15:12.002729 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:15:12.002729 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:15:12.002729 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:15:12.002729 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:15:12.002729 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 04:15:12.002729 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:15:12.008223 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 403/802] 10.222.0.91 () {56 vars in 1096 bytes} [Tue Aug 30 04:15:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:15:12.009955 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43debc48-8b65-409b-a15a-0c02fc04f3d4 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:12.061652 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edac410-01b6-49c8-8662-cb1f429667a8 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:12.141643 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f7c33-3faf-4fc6-8f12-31524116d671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:12.142685 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f7c33-3faf-4fc6-8f12-31524116d671 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:12.143168 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f7c33-3faf-4fc6-8f12-31524116d671 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:12.143644 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f7c33-3faf-4fc6-8f12-31524116d671 None admin] PATH_INFO: `/v3/services` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:12.145117 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54f7c33-3faf-4fc6-8f12-31524116d671 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:12.145851 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54f7c33-3faf-4fc6-8f12-31524116d671 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:12.148737 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54f7c33-3faf-4fc6-8f12-31524116d671 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:12.164520 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 400/803] 10.222.0.91 () {56 vars in 1124 bytes} [Tue Aug 30 04:15:11 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:12.166399 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f7c33-3faf-4fc6-8f12-31524116d671 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:12.237335 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43debc48-8b65-409b-a15a-0c02fc04f3d4 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:12.293498 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c53169a-48b4-437b-be6d-a99e2eaffbcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:12.294565 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c53169a-48b4-437b-be6d-a99e2eaffbcb None admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:12.295044 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c53169a-48b4-437b-be6d-a99e2eaffbcb None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:12.295506 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c53169a-48b4-437b-be6d-a99e2eaffbcb None admin] PATH_INFO: `/v3/projects/4e05769361674c8fa995050150ad4cfa/users/1bc12faf48984335a3515dcde85b5cb1/roles/c3eef5523b7a407082ffaa23a9753410` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:12.318197 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:12.326980 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c53169a-48b4-437b-be6d-a99e2eaffbcb None admin] RBAC: Authorizing `identity:create_grant(project_id=4e05769361674c8fa995050150ad4cfa, user_id=1bc12faf48984335a3515dcde85b5cb1, role_id=c3eef5523b7a407082ffaa23a9753410)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:12.330946 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c53169a-48b4-437b-be6d-a99e2eaffbcb None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:12.367241 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 404/804] 10.222.0.91 () {58 vars in 1439 bytes} [Tue Aug 30 04:15:12 2022] PUT /identity/v3/projects/4e05769361674c8fa995050150ad4cfa/users/1bc12faf48984335a3515dcde85b5cb1/roles/c3eef5523b7a407082ffaa23a9753410 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:15:12.367241 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c53169a-48b4-437b-be6d-a99e2eaffbcb None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:12.372424 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:12.381290 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f7c33-3faf-4fc6-8f12-31524116d671 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:12.505437 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396d8ad3-d50c-4123-8846-e62ef9f728f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:12.506951 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d8ad3-d50c-4123-8846-e62ef9f728f0 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:12.507658 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d8ad3-d50c-4123-8846-e62ef9f728f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:12.508354 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d8ad3-d50c-4123-8846-e62ef9f728f0 None admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:12.510059 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396d8ad3-d50c-4123-8846-e62ef9f728f0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:12.511330 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396d8ad3-d50c-4123-8846-e62ef9f728f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:12.519951 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396d8ad3-d50c-4123-8846-e62ef9f728f0 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:12.581685 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 401/805] 10.222.0.91 () {56 vars in 1135 bytes} [Tue Aug 30 04:15:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 416 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:12.590697 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c53169a-48b4-437b-be6d-a99e2eaffbcb None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:12.591614 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396d8ad3-d50c-4123-8846-e62ef9f728f0 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:12.682288 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443edd93-24d3-4f8c-a899-e3981b8ac51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:12.683570 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443edd93-24d3-4f8c-a899-e3981b8ac51b None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:12.684226 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443edd93-24d3-4f8c-a899-e3981b8ac51b None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:12.684814 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443edd93-24d3-4f8c-a899-e3981b8ac51b None admin] PATH_INFO: `/v3/services` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:12.687060 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443edd93-24d3-4f8c-a899-e3981b8ac51b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:12.687755 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443edd93-24d3-4f8c-a899-e3981b8ac51b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:12.690595 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443edd93-24d3-4f8c-a899-e3981b8ac51b None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:12.701969 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 405/806] 10.222.0.91 () {56 vars in 1124 bytes} [Tue Aug 30 04:15:12 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:12.713067 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443edd93-24d3-4f8c-a899-e3981b8ac51b None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:12.895651 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396d8ad3-d50c-4123-8846-e62ef9f728f0 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:12.967170 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6accac-fb7a-443e-a3ad-32e78fd11c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:12.968293 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6accac-fb7a-443e-a3ad-32e78fd11c41 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:12.968799 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6accac-fb7a-443e-a3ad-32e78fd11c41 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:12.969247 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6accac-fb7a-443e-a3ad-32e78fd11c41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:12.996327 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6accac-fb7a-443e-a3ad-32e78fd11c41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:12.996327 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6accac-fb7a-443e-a3ad-32e78fd11c41 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:13.024999 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-6e6accac-fb7a-443e-a3ad-32e78fd11c41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:15:13.024999 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:13.024999 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:13.024999 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:13.024999 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:13.024999 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:13.024999 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:13.024999 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:13.024999 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:13.024999 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:13.024999 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:13.024999 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:13.024999 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:15:13.024999 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:15:13.024999 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:15:13.024999 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:15:13.027033 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:13.027033 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:13.027033 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:13.027033 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:13.027033 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:13.027033 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:13.027033 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:13.027033 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:13.027033 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:13.027033 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:13.027033 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:13.027033 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:13.027033 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:13.027033 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:13.027033 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:13.027033 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:13.027033 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:15:13.028902 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:15:13.028902 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:15:13.028902 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:13.028902 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 402/807] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:15:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 437 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:15:13.028902 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:13.036229 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6accac-fb7a-443e-a3ad-32e78fd11c41 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:13.075415 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:13.168616 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443edd93-24d3-4f8c-a899-e3981b8ac51b None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:13.210450 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6accac-fb7a-443e-a3ad-32e78fd11c41 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:13.242161 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc0b1c9-4405-49aa-bc38-0a7b6713a983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:13.244497 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc0b1c9-4405-49aa-bc38-0a7b6713a983 None admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:13.245454 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc0b1c9-4405-49aa-bc38-0a7b6713a983 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:13.246229 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc0b1c9-4405-49aa-bc38-0a7b6713a983 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:13.247717 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc0b1c9-4405-49aa-bc38-0a7b6713a983 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:13.250688 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc0b1c9-4405-49aa-bc38-0a7b6713a983 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:13.281328 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e390d530-f129-4bca-bd57-b9ffe7ba12fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:13.284549 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390d530-f129-4bca-bd57-b9ffe7ba12fe None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:13.285675 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390d530-f129-4bca-bd57-b9ffe7ba12fe None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:13.286117 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390d530-f129-4bca-bd57-b9ffe7ba12fe None admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:13.289353 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e390d530-f129-4bca-bd57-b9ffe7ba12fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:13.290337 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e390d530-f129-4bca-bd57-b9ffe7ba12fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:13.295040 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e390d530-f129-4bca-bd57-b9ffe7ba12fe None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:13.301569 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 406/808] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:15:12 2022] POST /identity/v3/endpoints => generated 346 bytes in 590 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:15:13.312017 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4705c3-262f-4634-8820-d4fe5b76956c None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:13.312017 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4705c3-262f-4634-8820-d4fe5b76956c None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:13.312017 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4705c3-262f-4634-8820-d4fe5b76956c None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:13.312017 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 407/809] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:15:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:15:13.319804 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b643f-4b94-4dd8-b0fa-7ba9a3114a0b None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:13.320662 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b643f-4b94-4dd8-b0fa-7ba9a3114a0b None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:13.321395 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b643f-4b94-4dd8-b0fa-7ba9a3114a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:13.345177 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 403/810] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:15:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:13.356992 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e390d530-f129-4bca-bd57-b9ffe7ba12fe None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:13.365503 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-a28b643f-4b94-4dd8-b0fa-7ba9a3114a0b None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:13.366781 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-a28b643f-4b94-4dd8-b0fa-7ba9a3114a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:13.606553 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 408/811] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:15:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 04:15:13.669541 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:13.756330 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e390d530-f129-4bca-bd57-b9ffe7ba12fe None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:13.828549 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3b88c-7879-49d3-86f3-a823bff19ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:13.829655 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3b88c-7879-49d3-86f3-a823bff19ade None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:13.830130 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3b88c-7879-49d3-86f3-a823bff19ade None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:13.830606 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3b88c-7879-49d3-86f3-a823bff19ade None admin] PATH_INFO: `/v3/projects/service` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:13.843790 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b3b88c-7879-49d3-86f3-a823bff19ade None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:13.846651 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b3b88c-7879-49d3-86f3-a823bff19ade None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:13.868379 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-c7b3b88c-7879-49d3-86f3-a823bff19ade None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:15:13.868379 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:13.868379 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:13.868379 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:13.868379 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:13.868379 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:13.868379 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:13.868379 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:13.868379 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:13.868379 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:13.868379 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:13.868379 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:13.868379 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:15:13.868379 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:15:13.868379 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:15:13.869747 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:15:13.869747 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:13.869747 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:13.869747 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:13.869747 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:13.869747 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:13.869747 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:13.869747 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:13.869747 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:13.869747 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:13.869747 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:13.869747 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:13.869747 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:13.869747 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:13.869747 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:13.869747 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:13.869747 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:13.870856 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:15:13.870856 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:15:13.870856 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:15:13.870856 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:15:13.870856 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:15:13.870856 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:15:13.870856 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:15:13.870856 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:13.870856 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 404/812] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 30 04:15:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 515 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:15:13.880142 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b643f-4b94-4dd8-b0fa-7ba9a3114a0b None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:13.942065 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:14.072943 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b643f-4b94-4dd8-b0fa-7ba9a3114a0b None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:14.165343 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c6edc6-f2e7-4122-8e3c-563fb05a7f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:14.166332 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6edc6-f2e7-4122-8e3c-563fb05a7f7a None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:14.166797 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6edc6-f2e7-4122-8e3c-563fb05a7f7a None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:14.167252 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6edc6-f2e7-4122-8e3c-563fb05a7f7a None admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:14.168954 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c6edc6-f2e7-4122-8e3c-563fb05a7f7a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:14.169494 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c6edc6-f2e7-4122-8e3c-563fb05a7f7a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:14.173715 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c6edc6-f2e7-4122-8e3c-563fb05a7f7a None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:14.200423 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 409/813] 10.222.0.91 () {56 vars in 1148 bytes} [Tue Aug 30 04:15:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:14.210379 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3b88c-7879-49d3-86f3-a823bff19ade None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:14.310384 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bcb333-2aff-4c14-ba71-d06393a1e509 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:14.311198 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bcb333-2aff-4c14-ba71-d06393a1e509 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:14.311336 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bcb333-2aff-4c14-ba71-d06393a1e509 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:14.314154 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 410/814] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:15:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:15:14.326125 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eeb011-028a-4d1e-9ab3-c93faeca8cad None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:14.327165 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eeb011-028a-4d1e-9ab3-c93faeca8cad None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:14.327708 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eeb011-028a-4d1e-9ab3-c93faeca8cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:14.371753 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-98eeb011-028a-4d1e-9ab3-c93faeca8cad None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:14.373766 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-98eeb011-028a-4d1e-9ab3-c93faeca8cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:14.449011 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3b88c-7879-49d3-86f3-a823bff19ade None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:14.499949 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:14.500225 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 411/815] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:15:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 04:15:14.500225 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eeb011-028a-4d1e-9ab3-c93faeca8cad None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:14.532317 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186fb9db-418d-4706-b94b-35dd50c6d521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:14.533053 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186fb9db-418d-4706-b94b-35dd50c6d521 None admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:14.533315 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186fb9db-418d-4706-b94b-35dd50c6d521 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:14.533580 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186fb9db-418d-4706-b94b-35dd50c6d521 None admin] PATH_INFO: `/v3/projects/4e05769361674c8fa995050150ad4cfa/users/94b50f9552124b07822ae63c1d553864/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:14.536722 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186fb9db-418d-4706-b94b-35dd50c6d521 None admin] RBAC: Authorizing `identity:create_grant(project_id=4e05769361674c8fa995050150ad4cfa, user_id=94b50f9552124b07822ae63c1d553864, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:14.538199 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186fb9db-418d-4706-b94b-35dd50c6d521 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:14.553844 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:14.565882 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 405/816] 10.222.0.91 () {58 vars in 1439 bytes} [Tue Aug 30 04:15:14 2022] PUT /identity/v3/projects/4e05769361674c8fa995050150ad4cfa/users/94b50f9552124b07822ae63c1d553864/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:15:14.684994 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eeb011-028a-4d1e-9ab3-c93faeca8cad None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:14.740219 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5e9f52-34b9-490b-9b92-a4db4d87cdc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:14.740792 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e9f52-34b9-490b-9b92-a4db4d87cdc3 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:14.741067 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e9f52-34b9-490b-9b92-a4db4d87cdc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:14.741336 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e9f52-34b9-490b-9b92-a4db4d87cdc3 None admin] PATH_INFO: `/v3/services/network` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:14.742039 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5e9f52-34b9-490b-9b92-a4db4d87cdc3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:14.743508 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5e9f52-34b9-490b-9b92-a4db4d87cdc3 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:14.754165 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-9e5e9f52-34b9-490b-9b92-a4db4d87cdc3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 04:15:14.754165 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:14.754165 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:15:14.754165 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:15:14.754165 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:15:14.754165 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:15:14.754165 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:15:14.754165 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:15:14.754165 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 04:15:14.754165 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:15:14.754165 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:15:14.754165 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:15:14.754165 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:14.754165 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:14.754165 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:14.754165 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:14.754165 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:14.756117 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:14.756117 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:14.756117 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:14.756117 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:14.756117 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:14.756117 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:14.756117 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:15:14.756117 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:15:14.756117 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:15:14.756117 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:15:14.756117 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:14.756117 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:14.756117 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:14.756117 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:14.756117 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:14.756117 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:14.757744 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:14.757744 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:14.757744 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:14.757744 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:14.757744 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:14.757744 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:14.757744 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:14.757744 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:14.757744 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:14.757744 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:14.757744 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:15:14.757744 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:15:14.757744 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 04:15:14.757744 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:15:14.757744 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 412/817] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 30 04:15:14 2022] GET /identity/v3/services/network => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:15:14.764727 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186fb9db-418d-4706-b94b-35dd50c6d521 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:14.893045 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186fb9db-418d-4706-b94b-35dd50c6d521 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:14.945918 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8872ec2a-9c3b-42c7-aa2a-4b634625dee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:14.947069 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872ec2a-9c3b-42c7-aa2a-4b634625dee0 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:14.947794 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872ec2a-9c3b-42c7-aa2a-4b634625dee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:14.948242 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872ec2a-9c3b-42c7-aa2a-4b634625dee0 None admin] PATH_INFO: `/v3/services` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:14.955235 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8872ec2a-9c3b-42c7-aa2a-4b634625dee0 None admin] RBAC: Adding query filter params (name=network) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:14.955235 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8872ec2a-9c3b-42c7-aa2a-4b634625dee0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:14.955235 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8872ec2a-9c3b-42c7-aa2a-4b634625dee0 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:14.956522 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 406/818] 10.222.0.91 () {56 vars in 1112 bytes} [Tue Aug 30 04:15:14 2022] GET /identity/v3/services?name=network => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:14.965144 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5e9f52-34b9-490b-9b92-a4db4d87cdc3 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:15.221022 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:15.231190 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8872ec2a-9c3b-42c7-aa2a-4b634625dee0 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:15.251960 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5e9f52-34b9-490b-9b92-a4db4d87cdc3 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:15.316998 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f470c-efc3-4a0a-99b0-3132fc359d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:15.318053 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f470c-efc3-4a0a-99b0-3132fc359d9f None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:15.318537 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f470c-efc3-4a0a-99b0-3132fc359d9f None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:15.319020 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f470c-efc3-4a0a-99b0-3132fc359d9f None admin] PATH_INFO: `/v3/services` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:15.320254 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87f470c-efc3-4a0a-99b0-3132fc359d9f None admin] RBAC: Adding query filter params (type=network) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:15.320779 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87f470c-efc3-4a0a-99b0-3132fc359d9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:15.323435 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87f470c-efc3-4a0a-99b0-3132fc359d9f None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:15.333704 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 413/819] 10.222.0.91 () {56 vars in 1112 bytes} [Tue Aug 30 04:15:14 2022] GET /identity/v3/services?type=network => generated 350 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:15.343138 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f470c-efc3-4a0a-99b0-3132fc359d9f None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:15.363099 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:15.479129 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8872ec2a-9c3b-42c7-aa2a-4b634625dee0 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:15.551441 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c04a6-f605-49d0-8bf2-26aeed16b8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:15.553063 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c04a6-f605-49d0-8bf2-26aeed16b8ff None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:15.553811 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c04a6-f605-49d0-8bf2-26aeed16b8ff None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:15.554587 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c04a6-f605-49d0-8bf2-26aeed16b8ff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:15.575312 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f470c-efc3-4a0a-99b0-3132fc359d9f None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:15.598535 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6c04a6-f605-49d0-8bf2-26aeed16b8ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:15:15.609579 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-3a6c04a6-f605-49d0-8bf2-26aeed16b8ff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:15:15.609579 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:15.609579 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:15.609579 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:15.609579 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:15.609579 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:15.609579 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:15.609579 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:15.609579 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:15.609579 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:15.609579 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:15.609579 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:15.609579 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:15:15.609579 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:15:15.609579 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:15:15.609579 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:15:15.611483 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:15:15.611483 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:15:15.611483 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:15:15.611483 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:15:15.611483 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:15.611483 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:15.611483 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:15.611483 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:15.611483 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:15.611483 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:15.611483 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:15.611483 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:15.611483 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:15.611483 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:15.611483 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:15.611483 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:15.613287 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:15.613287 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:15.613287 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:15.613287 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:15.613287 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:15:15.613287 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:15:15.613287 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:15:15.613287 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:15:15.613287 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:15:15.613287 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:15:15.613287 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:15:15.613287 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:15.618228 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 407/820] 10.222.0.91 () {56 vars in 1096 bytes} [Tue Aug 30 04:15:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:15:15.631028 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c04a6-f605-49d0-8bf2-26aeed16b8ff None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:15.704415 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087b5fa1-f956-4a7c-bee3-6752c66df831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:15.705457 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b5fa1-f956-4a7c-bee3-6752c66df831 None admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:15.705940 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b5fa1-f956-4a7c-bee3-6752c66df831 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:15.706352 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b5fa1-f956-4a7c-bee3-6752c66df831 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:15.707542 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087b5fa1-f956-4a7c-bee3-6752c66df831 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:15.710532 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087b5fa1-f956-4a7c-bee3-6752c66df831 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:15.752146 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 414/821] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:15:15 2022] POST /identity/v3/endpoints => generated 337 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:15:15.755044 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de89e102-ec20-4db0-b0b1-5e728c113671 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:15.755535 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de89e102-ec20-4db0-b0b1-5e728c113671 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:15.756047 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de89e102-ec20-4db0-b0b1-5e728c113671 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:15.759268 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 415/822] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:15:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:15:15.769588 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c0871-fff0-4b2d-8a05-7026701c21c7 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:15.770279 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c0871-fff0-4b2d-8a05-7026701c21c7 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:15.770862 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c0871-fff0-4b2d-8a05-7026701c21c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:15.818994 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-a78c0871-fff0-4b2d-8a05-7026701c21c7 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:15.831790 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-a78c0871-fff0-4b2d-8a05-7026701c21c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:15.843619 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:15.961089 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c04a6-f605-49d0-8bf2-26aeed16b8ff None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:15.974092 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:16.031887 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 416/823] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:15:15 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:15:16.039666 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5115cff-4839-44bf-89f6-3271a1d6933e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:16.040356 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5115cff-4839-44bf-89f6-3271a1d6933e None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:16.040688 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5115cff-4839-44bf-89f6-3271a1d6933e None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:16.041478 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5115cff-4839-44bf-89f6-3271a1d6933e None admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:16.042404 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5115cff-4839-44bf-89f6-3271a1d6933e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:16.042710 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5115cff-4839-44bf-89f6-3271a1d6933e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:16.044655 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5115cff-4839-44bf-89f6-3271a1d6933e None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:16.058713 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 408/824] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 30 04:15:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 429 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:16.064992 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c0871-fff0-4b2d-8a05-7026701c21c7 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:16.208945 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c0871-fff0-4b2d-8a05-7026701c21c7 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:16.289865 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797a901-550a-4c8d-b477-bac1489db06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:16.290812 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797a901-550a-4c8d-b477-bac1489db06a None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:16.291498 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797a901-550a-4c8d-b477-bac1489db06a None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:16.291996 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797a901-550a-4c8d-b477-bac1489db06a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:16.302058 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:16.333814 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e797a901-550a-4c8d-b477-bac1489db06a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:16.336724 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e797a901-550a-4c8d-b477-bac1489db06a None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:16.385375 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-e797a901-550a-4c8d-b477-bac1489db06a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:15:16.385375 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:16.385375 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:16.385375 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:16.385375 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:16.385375 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:16.385375 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:16.385375 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:16.385375 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:16.385375 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:16.385375 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:16.385375 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:16.385375 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:15:16.385375 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:15:16.385375 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:15:16.385375 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:15:16.387045 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:16.387045 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:16.387045 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:16.387045 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:16.387045 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:16.387045 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:16.387045 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:16.387045 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:16.387045 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:16.387045 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:16.387045 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:16.387045 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:16.387045 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:16.387045 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:16.387045 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:16.387045 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:16.387045 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:15:16.388538 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:15:16.388538 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:15:16.388538 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:15:16.388538 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 417/825] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:15:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:15:16.395039 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5115cff-4839-44bf-89f6-3271a1d6933e None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:16.547805 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797a901-550a-4c8d-b477-bac1489db06a None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:16.627976 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5115cff-4839-44bf-89f6-3271a1d6933e None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:16.700291 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ed8bf9-6dd5-416e-ba87-76774688b101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:16.701384 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed8bf9-6dd5-416e-ba87-76774688b101 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:16.701875 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed8bf9-6dd5-416e-ba87-76774688b101 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:16.702354 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed8bf9-6dd5-416e-ba87-76774688b101 None admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:16.703574 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ed8bf9-6dd5-416e-ba87-76774688b101 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:16.704163 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ed8bf9-6dd5-416e-ba87-76774688b101 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:16.706868 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ed8bf9-6dd5-416e-ba87-76774688b101 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:16.732160 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 409/826] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:15:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:16.732160 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d7938-8e0c-496b-bc4d-7721293faded None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:16.732594 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d7938-8e0c-496b-bc4d-7721293faded None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:16.732594 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d7938-8e0c-496b-bc4d-7721293faded None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:16.734241 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 410/827] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:15:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:15:16.739247 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d7938-8e0c-496b-bc4d-7721293faded None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:16.764481 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797a901-550a-4c8d-b477-bac1489db06a None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:16.782284 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:16.834200 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3b9615-468e-4ae1-b505-ad55e386319b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:16.835003 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b9615-468e-4ae1-b505-ad55e386319b None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:16.835422 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b9615-468e-4ae1-b505-ad55e386319b None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:16.835844 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b9615-468e-4ae1-b505-ad55e386319b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:16.854359 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3b9615-468e-4ae1-b505-ad55e386319b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:15:16.863184 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-0a3b9615-468e-4ae1-b505-ad55e386319b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:15:16.863184 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:16.863184 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:16.863184 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:16.863184 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:16.863184 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:16.863184 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:16.863184 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:16.863184 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:16.863184 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:16.863184 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:16.863184 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:16.863184 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:15:16.863184 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:15:16.863184 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:15:16.863184 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:15:16.865104 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:15:16.865104 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:15:16.865104 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:15:16.865104 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:15:16.865104 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:16.865104 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:16.865104 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:16.865104 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:16.865104 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:16.865104 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:16.865104 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:16.865104 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:16.865104 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:16.865104 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:16.865104 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:16.865104 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:16.867541 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:16.867541 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:16.867541 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:16.867541 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:16.867541 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:15:16.867541 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:15:16.867541 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:15:16.867541 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:15:16.867541 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:15:16.867541 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:15:16.867541 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:15:16.867541 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:15:16.867541 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 418/828] 10.222.0.91 () {56 vars in 1102 bytes} [Tue Aug 30 04:15:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:15:16.867541 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a6e1d-aca6-4d40-b56c-aa96363a8579 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:16.870671 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a6e1d-aca6-4d40-b56c-aa96363a8579 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:16.870671 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a6e1d-aca6-4d40-b56c-aa96363a8579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:16.893975 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-fd8a6e1d-aca6-4d40-b56c-aa96363a8579 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:16.895476 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-fd8a6e1d-aca6-4d40-b56c-aa96363a8579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:16.915745 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d7938-8e0c-496b-bc4d-7721293faded None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:16.961436 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2816e-6e6a-48ab-a677-929bb99260ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:16.962090 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2816e-6e6a-48ab-a677-929bb99260ec None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:16.962369 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2816e-6e6a-48ab-a677-929bb99260ec None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:16.962640 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2816e-6e6a-48ab-a677-929bb99260ec None admin] PATH_INFO: `/v3/users/nova` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:16.972972 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd2816e-6e6a-48ab-a677-929bb99260ec None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:16.974550 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd2816e-6e6a-48ab-a677-929bb99260ec None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:16.979052 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:16.990339 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-9fd2816e-6e6a-48ab-a677-929bb99260ec None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 04:15:16.990339 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:16.990339 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:16.990339 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:16.990339 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:16.990339 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:16.990339 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:16.990339 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:16.990339 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:16.990339 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:16.990339 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:16.990339 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:16.990339 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:15:16.990339 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:15:16.990339 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:15:16.990339 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:15:16.992272 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:16.992272 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:16.992272 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:15:16.992272 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:15:16.992272 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:15:16.992272 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:15:16.992272 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:16.992272 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:16.992272 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:16.992272 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:16.992272 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:16.992272 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:16.992272 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:16.992272 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:16.992272 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:16.992272 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:16.992272 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:16.992272 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:16.993324 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:16.993324 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:16.993324 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:15:16.993324 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:15:16.993324 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:15:16.993324 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:15:16.993324 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:15:16.993324 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:15:16.993324 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 04:15:16.993324 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:16.998287 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 411/829] 10.222.0.91 () {56 vars in 1093 bytes} [Tue Aug 30 04:15:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:15:16.999266 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2816e-6e6a-48ab-a677-929bb99260ec None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:17.021533 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 419/830] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:15:16 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:15:17.022183 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a6e1d-aca6-4d40-b56c-aa96363a8579 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:17.176442 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:17.210493 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2816e-6e6a-48ab-a677-929bb99260ec None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:17.231157 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a6e1d-aca6-4d40-b56c-aa96363a8579 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:17.282797 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb02fb-d83e-410d-8937-95c1ad995d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:17.283769 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb02fb-d83e-410d-8937-95c1ad995d5d None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:17.284344 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb02fb-d83e-410d-8937-95c1ad995d5d None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:17.285316 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb02fb-d83e-410d-8937-95c1ad995d5d None admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:17.286490 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fb02fb-d83e-410d-8937-95c1ad995d5d None admin] RBAC: Adding query filter params (name=service) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:17.286987 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fb02fb-d83e-410d-8937-95c1ad995d5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:17.289850 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fb02fb-d83e-410d-8937-95c1ad995d5d None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:17.302308 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ac3b1-f648-4203-89fb-8c11c7d018c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:17.303756 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ac3b1-f648-4203-89fb-8c11c7d018c6 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:17.304599 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ac3b1-f648-4203-89fb-8c11c7d018c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:17.305323 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ac3b1-f648-4203-89fb-8c11c7d018c6 None admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:17.307072 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0ac3b1-f648-4203-89fb-8c11c7d018c6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:17.308007 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 412/831] 10.222.0.91 () {56 vars in 1103 bytes} [Tue Aug 30 04:15:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:17.308572 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0ac3b1-f648-4203-89fb-8c11c7d018c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:17.311769 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0ac3b1-f648-4203-89fb-8c11c7d018c6 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:17.318492 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb02fb-d83e-410d-8937-95c1ad995d5d None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:17.341034 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 420/832] 10.222.0.91 () {56 vars in 1133 bytes} [Tue Aug 30 04:15:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:17.342702 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ac3b1-f648-4203-89fb-8c11c7d018c6 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:17.391167 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:17.481839 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb02fb-d83e-410d-8937-95c1ad995d5d None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:17.529144 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ac3b1-f648-4203-89fb-8c11c7d018c6 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:17.553690 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728b1e4e-5e58-463d-a1cd-b73f6c54fee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:17.555543 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b1e4e-5e58-463d-a1cd-b73f6c54fee3 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:17.556076 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b1e4e-5e58-463d-a1cd-b73f6c54fee3 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:17.556583 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b1e4e-5e58-463d-a1cd-b73f6c54fee3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:17.580077 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728b1e4e-5e58-463d-a1cd-b73f6c54fee3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:17.582017 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cec0ced-da1f-4d4d-aec8-3e8dd952a194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:17.582860 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728b1e4e-5e58-463d-a1cd-b73f6c54fee3 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:17.583147 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec0ced-da1f-4d4d-aec8-3e8dd952a194 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:17.583631 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec0ced-da1f-4d4d-aec8-3e8dd952a194 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:17.584152 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec0ced-da1f-4d4d-aec8-3e8dd952a194 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:17.584930 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cec0ced-da1f-4d4d-aec8-3e8dd952a194 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:17.586467 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cec0ced-da1f-4d4d-aec8-3e8dd952a194 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:17.597375 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-4cec0ced-da1f-4d4d-aec8-3e8dd952a194 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 04:15:17.597375 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:17.597375 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:15:17.597375 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:15:17.597375 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:15:17.597375 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:15:17.597375 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:15:17.597375 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:15:17.597375 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 04:15:17.597375 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:15:17.597375 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:15:17.597375 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:15:17.597375 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:17.597375 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:17.597375 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:17.597375 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:17.597375 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:17.599329 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:17.599329 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:17.599329 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:17.599329 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:17.599329 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:17.599329 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:17.599329 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:15:17.599329 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:15:17.599329 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:15:17.599329 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:15:17.599329 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:17.599329 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:17.599329 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:17.599329 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:17.599329 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:17.599329 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:17.600955 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:17.600955 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:17.600955 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:17.600955 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:17.600955 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:17.600955 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:17.600955 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:17.600955 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:17.600955 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:17.600955 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:17.600955 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:15:17.600955 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:15:17.600955 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 04:15:17.600955 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:15:17.600955 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 421/833] 10.222.0.91 () {56 vars in 1114 bytes} [Tue Aug 30 04:15:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:15:17.602517 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cec0ced-da1f-4d4d-aec8-3e8dd952a194 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:17.612465 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:17.628416 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-728b1e4e-5e58-463d-a1cd-b73f6c54fee3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:15:17.628416 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:17.628416 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:17.628416 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:17.628416 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:17.628416 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:17.628416 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:17.628416 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:17.628416 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:17.628416 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:17.628416 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:17.628416 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:17.628416 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:15:17.628416 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:15:17.628416 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:15:17.628416 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:15:17.630539 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:17.630539 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:17.630539 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:17.630539 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:17.630539 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:17.630539 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:17.630539 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:17.630539 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:17.630539 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:17.630539 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:17.630539 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:17.630539 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:17.630539 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:17.630539 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:17.630539 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:17.630539 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:17.630539 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:15:17.632330 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:15:17.632330 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:15:17.632330 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:17.632330 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 413/834] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:15:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:15:17.632776 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728b1e4e-5e58-463d-a1cd-b73f6c54fee3 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:17.840089 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728b1e4e-5e58-463d-a1cd-b73f6c54fee3 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:17.853274 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:17.857284 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cec0ced-da1f-4d4d-aec8-3e8dd952a194 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:17.887134 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9418d147-09d4-4033-a562-5d8f25ec8752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:17.888423 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418d147-09d4-4033-a562-5d8f25ec8752 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:17.888940 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418d147-09d4-4033-a562-5d8f25ec8752 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:17.889681 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418d147-09d4-4033-a562-5d8f25ec8752 None admin] PATH_INFO: `/v3/services` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:17.891091 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9418d147-09d4-4033-a562-5d8f25ec8752 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:17.891632 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9418d147-09d4-4033-a562-5d8f25ec8752 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:17.894323 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9418d147-09d4-4033-a562-5d8f25ec8752 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:17.902566 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 414/835] 10.222.0.91 () {56 vars in 1114 bytes} [Tue Aug 30 04:15:17 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:17.904015 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9418d147-09d4-4033-a562-5d8f25ec8752 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:17.909246 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbeb2bb-9312-47f0-8729-255ce64ae32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:17.910201 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbeb2bb-9312-47f0-8729-255ce64ae32d None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:17.910601 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbeb2bb-9312-47f0-8729-255ce64ae32d None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:17.911022 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbeb2bb-9312-47f0-8729-255ce64ae32d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:18.002301 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbeb2bb-9312-47f0-8729-255ce64ae32d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:18.003782 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbeb2bb-9312-47f0-8729-255ce64ae32d None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:18.021307 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:18.092829 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9418d147-09d4-4033-a562-5d8f25ec8752 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:18.145002 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7671d0-7073-4d3e-8229-f751b87949d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:18.145630 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7671d0-7073-4d3e-8229-f751b87949d0 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:18.145913 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7671d0-7073-4d3e-8229-f751b87949d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:18.146191 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7671d0-7073-4d3e-8229-f751b87949d0 None admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:18.146835 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7671d0-7073-4d3e-8229-f751b87949d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:18.147132 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7671d0-7073-4d3e-8229-f751b87949d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:18.148602 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7671d0-7073-4d3e-8229-f751b87949d0 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:18.158287 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:18.163552 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 422/836] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 30 04:15:17 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 04:15:18.163859 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 415/837] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:15:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:18.164946 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246f32d-ba3b-412b-a617-b45b80145966 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:18.165228 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246f32d-ba3b-412b-a617-b45b80145966 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:18.165498 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246f32d-ba3b-412b-a617-b45b80145966 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:18.166270 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7671d0-7073-4d3e-8229-f751b87949d0 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:18.167322 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 423/838] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:15:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:15:18.172686 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a246f32d-ba3b-412b-a617-b45b80145966 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:18.311249 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7671d0-7073-4d3e-8229-f751b87949d0 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:18.311540 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a246f32d-ba3b-412b-a617-b45b80145966 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:18.351718 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:18.357330 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db9552d-3820-425a-9c48-7384f355eb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:18.358033 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9552d-3820-425a-9c48-7384f355eb00 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:18.358270 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9552d-3820-425a-9c48-7384f355eb00 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:18.358533 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9552d-3820-425a-9c48-7384f355eb00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:18.367502 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38daa911-dc26-4693-a7de-e67667b66a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:18.368273 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38daa911-dc26-4693-a7de-e67667b66a24 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:18.368725 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38daa911-dc26-4693-a7de-e67667b66a24 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:18.369223 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38daa911-dc26-4693-a7de-e67667b66a24 None admin] PATH_INFO: `/v3/services` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:18.370008 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38daa911-dc26-4693-a7de-e67667b66a24 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:18.370473 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38daa911-dc26-4693-a7de-e67667b66a24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:18.371234 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db9552d-3820-425a-9c48-7384f355eb00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:18.372118 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38daa911-dc26-4693-a7de-e67667b66a24 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:18.372999 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db9552d-3820-425a-9c48-7384f355eb00 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:18.378538 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 416/839] 10.222.0.91 () {56 vars in 1114 bytes} [Tue Aug 30 04:15:18 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:18.379853 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38daa911-dc26-4693-a7de-e67667b66a24 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:18.393682 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-0db9552d-3820-425a-9c48-7384f355eb00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:15:18.393682 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:18.393682 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:18.393682 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:18.393682 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:18.393682 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:18.393682 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:18.393682 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:18.393682 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:18.393682 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:18.393682 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:18.393682 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:18.393682 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:15:18.393682 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:15:18.393682 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:15:18.393682 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:15:18.395526 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:18.395526 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:18.395526 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:18.395526 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:18.395526 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:18.395526 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:18.395526 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:18.395526 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:18.395526 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:18.395526 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:18.395526 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:18.395526 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:18.395526 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:18.395526 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:18.395526 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:18.395526 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:18.395526 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:15:18.398290 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:15:18.398290 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:15:18.398290 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:15:18.398290 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 424/840] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:15:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:15:18.400337 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74f25a-fb0b-49d0-bb6d-8b169b75da9b None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:18.401368 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74f25a-fb0b-49d0-bb6d-8b169b75da9b None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:18.401847 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74f25a-fb0b-49d0-bb6d-8b169b75da9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:18.428567 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-ac74f25a-fb0b-49d0-bb6d-8b169b75da9b None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:18.430653 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-ac74f25a-fb0b-49d0-bb6d-8b169b75da9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:18.524195 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:18.553531 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38daa911-dc26-4693-a7de-e67667b66a24 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:18.560355 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 425/841] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:15:18 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:15:18.561739 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac74f25a-fb0b-49d0-bb6d-8b169b75da9b None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:18.628051 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a4163e-7c22-41d9-9539-89c72c18da25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:18.629083 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a4163e-7c22-41d9-9539-89c72c18da25 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:18.629533 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a4163e-7c22-41d9-9539-89c72c18da25 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:18.629962 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a4163e-7c22-41d9-9539-89c72c18da25 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:18.656425 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a4163e-7c22-41d9-9539-89c72c18da25 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:18.659252 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a4163e-7c22-41d9-9539-89c72c18da25 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:18.685694 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-75a4163e-7c22-41d9-9539-89c72c18da25 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 04:15:18.685694 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:18.685694 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:18.685694 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:18.685694 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:18.685694 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:18.685694 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:18.685694 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:18.685694 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:18.685694 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:18.685694 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:18.685694 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:18.685694 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:15:18.685694 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:15:18.685694 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:15:18.685694 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:15:18.687612 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:18.687612 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:18.687612 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:15:18.687612 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:15:18.687612 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:15:18.687612 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:15:18.687612 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:18.687612 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:18.687612 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:18.687612 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:18.687612 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:18.687612 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:18.687612 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:18.687612 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:18.687612 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:18.687612 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:18.687612 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:18.687612 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:18.691153 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:18.691153 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:18.691153 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:15:18.691153 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:15:18.691153 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:15:18.691153 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:15:18.691153 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:15:18.691153 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:15:18.691153 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 04:15:18.691153 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:18.691153 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 417/842] 10.222.0.91 () {56 vars in 1117 bytes} [Tue Aug 30 04:15:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:15:18.697186 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a4163e-7c22-41d9-9539-89c72c18da25 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:18.734190 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac74f25a-fb0b-49d0-bb6d-8b169b75da9b None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:18.803387 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:18.810318 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5431eec2-e3e0-4873-9bc8-99665f4b72c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:18.811769 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431eec2-e3e0-4873-9bc8-99665f4b72c3 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:18.813870 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431eec2-e3e0-4873-9bc8-99665f4b72c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:18.814588 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431eec2-e3e0-4873-9bc8-99665f4b72c3 None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:18.816079 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5431eec2-e3e0-4873-9bc8-99665f4b72c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:18.816757 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5431eec2-e3e0-4873-9bc8-99665f4b72c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:18.819544 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5431eec2-e3e0-4873-9bc8-99665f4b72c3 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:18.840422 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 426/843] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:15:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:18.843275 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5431eec2-e3e0-4873-9bc8-99665f4b72c3 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:18.897501 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a4163e-7c22-41d9-9539-89c72c18da25 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:18.903332 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:18.947732 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7ee918-63ba-4cd5-8dda-fcac281dde49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:18.948682 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ee918-63ba-4cd5-8dda-fcac281dde49 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:18.949087 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ee918-63ba-4cd5-8dda-fcac281dde49 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:18.949500 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ee918-63ba-4cd5-8dda-fcac281dde49 None admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:18.950394 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7ee918-63ba-4cd5-8dda-fcac281dde49 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:18.950823 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7ee918-63ba-4cd5-8dda-fcac281dde49 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:18.952651 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7ee918-63ba-4cd5-8dda-fcac281dde49 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:18.977501 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 418/844] 10.222.0.91 () {56 vars in 1149 bytes} [Tue Aug 30 04:15:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:15:18.978885 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7ee918-63ba-4cd5-8dda-fcac281dde49 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:18.993288 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5431eec2-e3e0-4873-9bc8-99665f4b72c3 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:19.037434 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac6f935-939b-4f74-8397-24e8f67aa8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:19.038567 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac6f935-939b-4f74-8397-24e8f67aa8e2 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:19.039024 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac6f935-939b-4f74-8397-24e8f67aa8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:19.039435 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac6f935-939b-4f74-8397-24e8f67aa8e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:19.049231 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac6f935-939b-4f74-8397-24e8f67aa8e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:19.051161 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac6f935-939b-4f74-8397-24e8f67aa8e2 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:19.068527 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-bac6f935-939b-4f74-8397-24e8f67aa8e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:15:19.068527 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:19.068527 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:19.068527 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:19.068527 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:19.068527 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:19.068527 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:19.068527 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:19.068527 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:19.068527 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:19.068527 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:19.068527 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:19.068527 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:15:19.068527 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:15:19.068527 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:15:19.069638 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:15:19.069638 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:19.069638 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:19.069638 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:19.069638 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:19.069638 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:19.069638 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:19.069638 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:19.069638 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:19.069638 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:19.069638 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:19.069638 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:19.069638 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:19.069638 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:19.069638 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:19.069638 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:19.069638 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:19.070673 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:15:19.070673 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:15:19.070673 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:15:19.070673 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:15:19.070673 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:15:19.070673 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:15:19.070673 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:15:19.070673 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:15:19.076651 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 427/845] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 30 04:15:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:15:19.077880 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac6f935-939b-4f74-8397-24e8f67aa8e2 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:19.124501 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7ee918-63ba-4cd5-8dda-fcac281dde49 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:19.134411 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:19.171766 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc09f23-a5f3-4ede-8fae-b1bb24ce2b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:19.172334 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc09f23-a5f3-4ede-8fae-b1bb24ce2b97 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:19.172715 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc09f23-a5f3-4ede-8fae-b1bb24ce2b97 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:19.172887 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc09f23-a5f3-4ede-8fae-b1bb24ce2b97 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:19.185936 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc09f23-a5f3-4ede-8fae-b1bb24ce2b97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:15:19.190931 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-bdc09f23-a5f3-4ede-8fae-b1bb24ce2b97 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:15:19.190931 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:19.190931 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:19.190931 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:19.190931 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:19.190931 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:19.190931 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:19.190931 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:19.190931 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:19.190931 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:19.190931 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:19.190931 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:19.190931 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:15:19.190931 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:15:19.190931 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:15:19.190931 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:15:19.197231 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:15:19.197231 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:15:19.197231 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:15:19.197231 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:15:19.197231 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:19.197231 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:19.197231 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:19.197231 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:19.197231 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:19.197231 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:19.197231 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:19.197231 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:19.197231 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:19.197231 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:19.197231 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:19.197231 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:19.200532 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:19.200532 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:19.200532 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:19.200532 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:19.200532 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:15:19.200532 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:15:19.200532 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:15:19.200532 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:15:19.200532 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:15:19.200532 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:15:19.200532 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:15:19.200532 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:19.200532 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 419/846] 10.222.0.91 () {56 vars in 1096 bytes} [Tue Aug 30 04:15:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:15:19.200532 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc09f23-a5f3-4ede-8fae-b1bb24ce2b97 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:19.233704 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac6f935-939b-4f74-8397-24e8f67aa8e2 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:19.235717 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:19.285512 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4388330-b201-4d0c-890c-d563ae470c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:19.286528 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4388330-b201-4d0c-890c-d563ae470c5f None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:19.287044 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4388330-b201-4d0c-890c-d563ae470c5f None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:19.287562 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4388330-b201-4d0c-890c-d563ae470c5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:19.365380 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc09f23-a5f3-4ede-8fae-b1bb24ce2b97 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:19.408515 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4388330-b201-4d0c-890c-d563ae470c5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:19.410371 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4388330-b201-4d0c-890c-d563ae470c5f None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:19.417654 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a271a-9053-4d02-b33f-24e7a04e8250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:19.418871 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a271a-9053-4d02-b33f-24e7a04e8250 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:19.419311 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a271a-9053-4d02-b33f-24e7a04e8250 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:19.419873 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a271a-9053-4d02-b33f-24e7a04e8250 None admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:19.420747 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a271a-9053-4d02-b33f-24e7a04e8250 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:19.421207 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a271a-9053-4d02-b33f-24e7a04e8250 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:19.423355 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a271a-9053-4d02-b33f-24e7a04e8250 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:19.447189 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 420/847] 10.222.0.91 () {56 vars in 1148 bytes} [Tue Aug 30 04:15:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:19.447189 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a271a-9053-4d02-b33f-24e7a04e8250 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:19.480488 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:19.582777 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 428/848] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 30 04:15:19 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 04:15:19.584075 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4388330-b201-4d0c-890c-d563ae470c5f None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:19.587315 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:19.610656 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a271a-9053-4d02-b33f-24e7a04e8250 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:19.662245 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4074f704-3829-426c-b1ac-fb11e9684940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:19.663243 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074f704-3829-426c-b1ac-fb11e9684940 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:19.663685 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074f704-3829-426c-b1ac-fb11e9684940 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:19.664458 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074f704-3829-426c-b1ac-fb11e9684940 None admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:19.665568 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4074f704-3829-426c-b1ac-fb11e9684940 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:19.666197 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4074f704-3829-426c-b1ac-fb11e9684940 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:19.669184 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4074f704-3829-426c-b1ac-fb11e9684940 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:19.683705 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 421/849] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 30 04:15:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:19.684978 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4074f704-3829-426c-b1ac-fb11e9684940 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:19.766666 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4388330-b201-4d0c-890c-d563ae470c5f None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:19.818320 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baac9f82-e947-4de8-bc88-b6f9b507e2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:19.819257 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac9f82-e947-4de8-bc88-b6f9b507e2fa None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:19.819689 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac9f82-e947-4de8-bc88-b6f9b507e2fa None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:19.820194 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac9f82-e947-4de8-bc88-b6f9b507e2fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:19.821269 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baac9f82-e947-4de8-bc88-b6f9b507e2fa None admin] RBAC: Adding query filter params (role.id=d8f440a82947486ebb20a633ebee736b, scope.project.id=4e05769361674c8fa995050150ad4cfa, user.id=d806295278ae4997b5c6968aa553290c) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:19.821755 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baac9f82-e947-4de8-bc88-b6f9b507e2fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:19.824438 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baac9f82-e947-4de8-bc88-b6f9b507e2fa None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:19.832040 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:19.843954 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 429/850] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 30 04:15:19 2022] GET /identity/v3/role_assignments?user.id=d806295278ae4997b5c6968aa553290c&scope.project.id=4e05769361674c8fa995050150ad4cfa&role.id=d8f440a82947486ebb20a633ebee736b => generated 608 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:19.843954 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baac9f82-e947-4de8-bc88-b6f9b507e2fa None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:19.870245 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4074f704-3829-426c-b1ac-fb11e9684940 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:19.935330 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b66f8c1-91e5-4707-9635-9dadf7015d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:19.936467 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66f8c1-91e5-4707-9635-9dadf7015d74 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:19.937098 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66f8c1-91e5-4707-9635-9dadf7015d74 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:19.937601 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66f8c1-91e5-4707-9635-9dadf7015d74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:19.958592 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b66f8c1-91e5-4707-9635-9dadf7015d74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:19.961365 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b66f8c1-91e5-4707-9635-9dadf7015d74 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:19.972687 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:19.989811 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-0b66f8c1-91e5-4707-9635-9dadf7015d74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:15:19.989811 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:19.989811 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:19.989811 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:19.989811 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:19.989811 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:19.989811 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:19.989811 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:19.989811 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:19.989811 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:19.989811 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:19.989811 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:19.989811 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:15:19.989811 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:15:19.989811 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:15:19.989811 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:15:19.991744 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:19.991744 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:19.991744 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:19.991744 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:19.991744 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:19.991744 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:19.991744 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:19.991744 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:19.991744 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:19.991744 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:19.991744 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:19.991744 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:19.991744 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:19.991744 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:19.991744 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:19.991744 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:19.991744 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:15:19.993082 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:15:19.993082 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:15:19.993082 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:19.993082 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 422/851] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:15:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:15:20.003401 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b66f8c1-91e5-4707-9635-9dadf7015d74 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:20.050695 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baac9f82-e947-4de8-bc88-b6f9b507e2fa None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:20.119896 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4018a081-bc36-4ad5-b728-139fe49e3bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:20.120942 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4018a081-bc36-4ad5-b728-139fe49e3bf7 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:20.121382 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4018a081-bc36-4ad5-b728-139fe49e3bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:20.121780 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4018a081-bc36-4ad5-b728-139fe49e3bf7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:20.145577 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4018a081-bc36-4ad5-b728-139fe49e3bf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:20.148520 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4018a081-bc36-4ad5-b728-139fe49e3bf7 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:20.173972 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-4018a081-bc36-4ad5-b728-139fe49e3bf7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:15:20.173972 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:20.173972 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:20.173972 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:20.173972 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:20.173972 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:20.173972 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:20.173972 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:20.173972 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:20.173972 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:20.173972 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:20.173972 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:20.173972 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:15:20.173972 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:15:20.173972 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:15:20.173972 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:15:20.175790 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:20.175790 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:20.175790 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:20.175790 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:20.175790 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:20.175790 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:20.175790 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:20.175790 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:20.175790 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:20.175790 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:20.175790 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:20.175790 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:20.175790 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:20.175790 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:20.175790 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:20.175790 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:20.175790 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:15:20.177592 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:15:20.177592 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:15:20.177592 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:15:20.177592 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 430/852] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:15:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:15:20.189737 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4018a081-bc36-4ad5-b728-139fe49e3bf7 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:20.192914 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b66f8c1-91e5-4707-9635-9dadf7015d74 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:20.272098 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e36891-90d7-498d-98b5-f0a2b7a672f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:20.273896 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e36891-90d7-498d-98b5-f0a2b7a672f3 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:20.274399 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e36891-90d7-498d-98b5-f0a2b7a672f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:20.275256 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e36891-90d7-498d-98b5-f0a2b7a672f3 None admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:20.276713 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e36891-90d7-498d-98b5-f0a2b7a672f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:20.277245 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e36891-90d7-498d-98b5-f0a2b7a672f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:20.281134 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e36891-90d7-498d-98b5-f0a2b7a672f3 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:20.309478 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:20.320018 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 423/853] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:15:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:20.329262 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e36891-90d7-498d-98b5-f0a2b7a672f3 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:20.370724 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4018a081-bc36-4ad5-b728-139fe49e3bf7 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:20.393281 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:20.416712 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78619f99-5f2c-4877-9f15-81366c51ac8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:20.418685 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78619f99-5f2c-4877-9f15-81366c51ac8d None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:20.419103 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78619f99-5f2c-4877-9f15-81366c51ac8d None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:20.419511 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78619f99-5f2c-4877-9f15-81366c51ac8d None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:20.420455 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78619f99-5f2c-4877-9f15-81366c51ac8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:20.420988 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78619f99-5f2c-4877-9f15-81366c51ac8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:20.423722 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78619f99-5f2c-4877-9f15-81366c51ac8d None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:20.445760 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 431/854] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:15:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:20.447859 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78619f99-5f2c-4877-9f15-81366c51ac8d None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:20.506229 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e36891-90d7-498d-98b5-f0a2b7a672f3 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:20.547823 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eba8b96-9129-4217-b890-421e870e2aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:20.548518 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba8b96-9129-4217-b890-421e870e2aad None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:20.548795 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba8b96-9129-4217-b890-421e870e2aad None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:20.549066 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba8b96-9129-4217-b890-421e870e2aad None admin] PATH_INFO: `/v3/projects/service` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:20.557112 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eba8b96-9129-4217-b890-421e870e2aad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:20.558653 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eba8b96-9129-4217-b890-421e870e2aad None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:20.571374 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-6eba8b96-9129-4217-b890-421e870e2aad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:15:20.571374 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:20.571374 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:20.571374 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:20.571374 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:20.571374 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:20.571374 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:20.571374 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:20.571374 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:20.571374 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:20.571374 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:20.571374 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:20.571374 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:15:20.571374 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:15:20.571374 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:15:20.573242 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:15:20.573242 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:20.573242 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:20.573242 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:20.573242 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:20.573242 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:20.573242 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:20.573242 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:20.573242 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:20.573242 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:20.573242 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:20.573242 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:20.573242 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:20.573242 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:20.573242 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:20.573242 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:20.573242 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:20.574979 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:15:20.574979 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:15:20.574979 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:15:20.574979 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:15:20.574979 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:15:20.574979 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:15:20.574979 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:15:20.574979 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:20.574979 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 424/855] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 30 04:15:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:15:20.581842 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eba8b96-9129-4217-b890-421e870e2aad None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:20.654006 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:20.663725 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78619f99-5f2c-4877-9f15-81366c51ac8d None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:20.705834 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eba8b96-9129-4217-b890-421e870e2aad None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:20.739420 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a858f486-cf40-4aa2-a377-961123d53643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:20.741068 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a858f486-cf40-4aa2-a377-961123d53643 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:20.741817 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a858f486-cf40-4aa2-a377-961123d53643 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:20.742448 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a858f486-cf40-4aa2-a377-961123d53643 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:20.747800 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d81c6-f4d7-487c-9211-e42c72e9bb97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:20.748475 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d81c6-f4d7-487c-9211-e42c72e9bb97 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:20.748752 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d81c6-f4d7-487c-9211-e42c72e9bb97 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:20.749024 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d81c6-f4d7-487c-9211-e42c72e9bb97 None admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:20.749733 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792d81c6-f4d7-487c-9211-e42c72e9bb97 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:20.750039 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792d81c6-f4d7-487c-9211-e42c72e9bb97 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:20.751694 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792d81c6-f4d7-487c-9211-e42c72e9bb97 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:20.762349 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a858f486-cf40-4aa2-a377-961123d53643 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:20.765706 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a858f486-cf40-4aa2-a377-961123d53643 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:20.771951 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 425/856] 10.222.0.91 () {56 vars in 1148 bytes} [Tue Aug 30 04:15:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:15:20.776706 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d81c6-f4d7-487c-9211-e42c72e9bb97 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:20.802179 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-a858f486-cf40-4aa2-a377-961123d53643 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 04:15:20.802179 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:20.802179 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:20.802179 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:20.802179 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:20.802179 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:20.802179 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:20.802179 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:20.802179 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:20.802179 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:20.802179 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:20.802179 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:20.802179 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:15:20.802179 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:15:20.802179 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:15:20.802179 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:15:20.804290 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:20.804290 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:20.804290 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:15:20.804290 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:15:20.804290 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:15:20.804290 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:15:20.804290 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:20.804290 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:20.804290 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:20.804290 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:20.804290 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:20.804290 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:20.804290 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:20.804290 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:20.804290 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:20.804290 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:20.804290 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:20.804290 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:20.806295 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:20.806295 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:20.806295 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:15:20.806295 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:15:20.806295 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:15:20.806295 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:15:20.806295 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:15:20.806295 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:15:20.806295 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 04:15:20.806295 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:15:20.811577 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 432/857] 10.222.0.91 () {56 vars in 1096 bytes} [Tue Aug 30 04:15:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:15:20.818805 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a09472-dc4f-40a9-87de-0e8965204825 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:20.819243 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a09472-dc4f-40a9-87de-0e8965204825 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:20.819624 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a09472-dc4f-40a9-87de-0e8965204825 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:20.821946 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 433/858] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:15:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:15:20.822825 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a09472-dc4f-40a9-87de-0e8965204825 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:20.907376 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:20.951821 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d81c6-f4d7-487c-9211-e42c72e9bb97 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:20.991418 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a09472-dc4f-40a9-87de-0e8965204825 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:20.994932 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:21.021948 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ccae1-88ee-466f-8600-95cd263da816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:21.024470 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ccae1-88ee-466f-8600-95cd263da816 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:21.025096 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ccae1-88ee-466f-8600-95cd263da816 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:21.025641 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ccae1-88ee-466f-8600-95cd263da816 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:21.027750 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ccae1-88ee-466f-8600-95cd263da816 None admin] RBAC: Adding query filter params (role.id=c3eef5523b7a407082ffaa23a9753410, scope.project.id=4e05769361674c8fa995050150ad4cfa, user.id=1bc12faf48984335a3515dcde85b5cb1) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:21.028300 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ccae1-88ee-466f-8600-95cd263da816 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:21.031475 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ccae1-88ee-466f-8600-95cd263da816 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:21.039279 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e237d-22f0-4ccb-b4f6-d1b4e0e4dba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:21.040045 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e237d-22f0-4ccb-b4f6-d1b4e0e4dba2 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:21.040386 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e237d-22f0-4ccb-b4f6-d1b4e0e4dba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:21.040719 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e237d-22f0-4ccb-b4f6-d1b4e0e4dba2 None admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:21.041717 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2e237d-22f0-4ccb-b4f6-d1b4e0e4dba2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:21.042091 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2e237d-22f0-4ccb-b4f6-d1b4e0e4dba2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:21.044196 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2e237d-22f0-4ccb-b4f6-d1b4e0e4dba2 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:21.056196 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 426/859] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 30 04:15:20 2022] GET /identity/v3/role_assignments?user.id=1bc12faf48984335a3515dcde85b5cb1&scope.project.id=4e05769361674c8fa995050150ad4cfa&role.id=c3eef5523b7a407082ffaa23a9753410 => generated 608 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:21.056196 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d21e5d4-7c7c-453a-a58b-aaede9b54f80 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:21.056196 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d21e5d4-7c7c-453a-a58b-aaede9b54f80 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:21.056196 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d21e5d4-7c7c-453a-a58b-aaede9b54f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:21.078087 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 434/860] 10.222.0.91 () {56 vars in 1135 bytes} [Tue Aug 30 04:15:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:21.087500 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e237d-22f0-4ccb-b4f6-d1b4e0e4dba2 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:21.089931 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-2d21e5d4-7c7c-453a-a58b-aaede9b54f80 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:21.092907 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-2d21e5d4-7c7c-453a-a58b-aaede9b54f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:21.243658 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:21.249120 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 427/861] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:15:21 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:15:21.259293 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e237d-22f0-4ccb-b4f6-d1b4e0e4dba2 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:21.329274 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e10a6-ef96-4d41-8b1c-8f498caf64f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:21.329911 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e10a6-ef96-4d41-8b1c-8f498caf64f5 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:21.330202 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e10a6-ef96-4d41-8b1c-8f498caf64f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:21.330459 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e10a6-ef96-4d41-8b1c-8f498caf64f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:21.447617 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e10a6-ef96-4d41-8b1c-8f498caf64f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:21.451634 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e10a6-ef96-4d41-8b1c-8f498caf64f5 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:21.593186 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d21e5d4-7c7c-453a-a58b-aaede9b54f80 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:21.643166 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:21.661249 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 435/862] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 30 04:15:21 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 04:15:21.673887 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e10a6-ef96-4d41-8b1c-8f498caf64f5 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:21.751632 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d21e5d4-7c7c-453a-a58b-aaede9b54f80 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:21.793620 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:21.832743 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e10a6-ef96-4d41-8b1c-8f498caf64f5 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:21.847541 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656bb8c-6d5a-4959-bf68-5f449d8be6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:21.848138 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656bb8c-6d5a-4959-bf68-5f449d8be6fe None admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:21.848482 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656bb8c-6d5a-4959-bf68-5f449d8be6fe None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:21.848731 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656bb8c-6d5a-4959-bf68-5f449d8be6fe None admin] PATH_INFO: `/v3/services` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:21.849373 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7656bb8c-6d5a-4959-bf68-5f449d8be6fe None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:21.850844 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7656bb8c-6d5a-4959-bf68-5f449d8be6fe None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:21.880672 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 428/863] 10.222.0.91 () {60 vars in 1141 bytes} [Tue Aug 30 04:15:21 2022] POST /identity/v3/services => generated 251 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:15:21.919679 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3557c39-309a-4bc4-a349-15210b7558fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:21.921375 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3557c39-309a-4bc4-a349-15210b7558fb None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:21.922141 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3557c39-309a-4bc4-a349-15210b7558fb None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:21.922923 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3557c39-309a-4bc4-a349-15210b7558fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:21.945352 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3557c39-309a-4bc4-a349-15210b7558fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:21.948842 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3557c39-309a-4bc4-a349-15210b7558fb None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:21.981261 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-a3557c39-309a-4bc4-a349-15210b7558fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:15:21.981261 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:21.981261 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:21.981261 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:21.981261 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:21.981261 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:21.981261 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:21.981261 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:21.981261 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:21.981261 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:21.981261 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:21.981261 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:21.981261 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:15:21.981261 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:15:21.981261 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:15:21.981261 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:15:21.983118 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:21.983118 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:21.983118 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:21.983118 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:21.983118 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:21.983118 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:21.983118 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:21.983118 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:21.983118 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:21.983118 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:21.983118 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:21.983118 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:21.983118 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:21.983118 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:21.983118 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:21.983118 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:21.983118 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:15:21.984871 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:15:21.984871 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:15:21.984871 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:15:21.988673 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 436/864] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:15:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:15:21.998879 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656bb8c-6d5a-4959-bf68-5f449d8be6fe None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:22.200570 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656bb8c-6d5a-4959-bf68-5f449d8be6fe None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:22.240448 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20773d2-597b-4501-9f5f-25b965ff40dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:22.241085 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20773d2-597b-4501-9f5f-25b965ff40dd None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:22.241354 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20773d2-597b-4501-9f5f-25b965ff40dd None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:22.241628 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20773d2-597b-4501-9f5f-25b965ff40dd None admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:22.242297 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20773d2-597b-4501-9f5f-25b965ff40dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:22.242595 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20773d2-597b-4501-9f5f-25b965ff40dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:22.244143 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20773d2-597b-4501-9f5f-25b965ff40dd None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:22.258896 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 429/865] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:15:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:22.268124 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3557c39-309a-4bc4-a349-15210b7558fb None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:22.363861 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:22.473842 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3557c39-309a-4bc4-a349-15210b7558fb None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:22.543391 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c8d44-c152-4cc2-9226-b7be7c75b164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:22.544485 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c8d44-c152-4cc2-9226-b7be7c75b164 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:22.544961 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c8d44-c152-4cc2-9226-b7be7c75b164 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:22.545434 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c8d44-c152-4cc2-9226-b7be7c75b164 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:22.559738 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0c8d44-c152-4cc2-9226-b7be7c75b164 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:22.562749 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0c8d44-c152-4cc2-9226-b7be7c75b164 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:22.586909 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-cc0c8d44-c152-4cc2-9226-b7be7c75b164 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:15:22.586909 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:22.586909 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:22.586909 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:22.586909 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:22.586909 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:22.586909 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:22.586909 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:22.586909 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:22.586909 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:22.586909 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:22.586909 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:22.586909 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:15:22.586909 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:15:22.586909 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:15:22.588724 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:15:22.588724 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:22.588724 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:22.588724 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:22.588724 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:22.588724 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:22.588724 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:22.588724 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:22.588724 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:22.588724 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:22.588724 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:22.588724 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:22.588724 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:22.588724 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:22.588724 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:22.588724 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:22.588724 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:22.590193 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:15:22.590193 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:15:22.590193 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:15:22.590193 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:15:22.590193 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:15:22.590193 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:15:22.590193 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:15:22.590193 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:15:22.590193 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 437/866] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 30 04:15:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:15:22.600789 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20773d2-597b-4501-9f5f-25b965ff40dd None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:22.670302 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:22.768723 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20773d2-597b-4501-9f5f-25b965ff40dd None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:22.788519 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9cb853-5466-4822-9262-6c0356180464 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:22.788994 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9cb853-5466-4822-9262-6c0356180464 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:22.789409 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9cb853-5466-4822-9262-6c0356180464 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:22.800256 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 438/867] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:15:22 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:15:22.803443 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aafb57-0cbb-45d3-bb38-1a80f9de7e07 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:22.804128 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aafb57-0cbb-45d3-bb38-1a80f9de7e07 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:22.804696 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aafb57-0cbb-45d3-bb38-1a80f9de7e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:22.811948 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a397b1-8fd4-43cf-ad7b-077edb18e17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:22.812594 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a397b1-8fd4-43cf-ad7b-077edb18e17f None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:22.812875 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a397b1-8fd4-43cf-ad7b-077edb18e17f None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:22.813157 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a397b1-8fd4-43cf-ad7b-077edb18e17f None admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:22.813887 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a397b1-8fd4-43cf-ad7b-077edb18e17f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:22.814200 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a397b1-8fd4-43cf-ad7b-077edb18e17f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:22.816036 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a397b1-8fd4-43cf-ad7b-077edb18e17f None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:22.831264 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 430/868] 10.222.0.91 () {56 vars in 1148 bytes} [Tue Aug 30 04:15:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:22.841188 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a397b1-8fd4-43cf-ad7b-077edb18e17f None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:22.847281 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-46aafb57-0cbb-45d3-bb38-1a80f9de7e07 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:22.851955 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-46aafb57-0cbb-45d3-bb38-1a80f9de7e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:22.996110 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 439/869] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:15:22 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:15:23.032434 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:23.048242 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a397b1-8fd4-43cf-ad7b-077edb18e17f None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:23.115510 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf9c71d-2511-46aa-8b96-39733c97ec6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:23.117042 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf9c71d-2511-46aa-8b96-39733c97ec6b None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:23.117824 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf9c71d-2511-46aa-8b96-39733c97ec6b None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:23.118554 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf9c71d-2511-46aa-8b96-39733c97ec6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:23.120339 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf9c71d-2511-46aa-8b96-39733c97ec6b None admin] RBAC: Adding query filter params (role.id=d8f440a82947486ebb20a633ebee736b, scope.project.id=4e05769361674c8fa995050150ad4cfa, user.id=94b50f9552124b07822ae63c1d553864) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:23.121199 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf9c71d-2511-46aa-8b96-39733c97ec6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:23.124190 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf9c71d-2511-46aa-8b96-39733c97ec6b None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:23.137048 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 431/870] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 30 04:15:22 2022] GET /identity/v3/role_assignments?user.id=94b50f9552124b07822ae63c1d553864&scope.project.id=4e05769361674c8fa995050150ad4cfa&role.id=d8f440a82947486ebb20a633ebee736b => generated 608 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:15:23.481130 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a6fbf-4979-4e18-8624-5387f77e1e38 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:23.482656 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a6fbf-4979-4e18-8624-5387f77e1e38 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:23.483440 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a6fbf-4979-4e18-8624-5387f77e1e38 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:23.486688 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 440/871] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:15:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:15:23.488021 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf9c71d-2511-46aa-8b96-39733c97ec6b None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:23.498620 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866ffe4-487a-434b-9aa8-9de63befe845 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:23.499492 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866ffe4-487a-434b-9aa8-9de63befe845 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:23.500285 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866ffe4-487a-434b-9aa8-9de63befe845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:23.536576 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-1866ffe4-487a-434b-9aa8-9de63befe845 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:23.539995 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-1866ffe4-487a-434b-9aa8-9de63befe845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:23.614035 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:23.707244 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf9c71d-2511-46aa-8b96-39733c97ec6b None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:23.760491 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 441/872] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:15:23 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 04:15:23.834675 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ec6e0-d71d-4073-a028-70251a965e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:23.835437 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ec6e0-d71d-4073-a028-70251a965e81 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:23.835756 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ec6e0-d71d-4073-a028-70251a965e81 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:23.836011 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ec6e0-d71d-4073-a028-70251a965e81 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:23.836685 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115ec6e0-d71d-4073-a028-70251a965e81 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:23.839120 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115ec6e0-d71d-4073-a028-70251a965e81 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:23.873041 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-115ec6e0-d71d-4073-a028-70251a965e81 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 04:15:23.873041 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:23.873041 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:15:23.873041 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:15:23.873041 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:15:23.873041 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:15:23.873041 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:15:23.873041 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:15:23.873041 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 04:15:23.873041 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:23.873041 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:15:23.873041 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:23.873041 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:23.873041 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:23.873041 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:23.873041 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:23.874713 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:23.874713 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:23.874713 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:23.874713 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:23.874713 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:23.874713 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:23.874713 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:23.874713 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:15:23.874713 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:15:23.874713 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:15:23.874713 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:15:23.874713 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:23.874713 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:23.874713 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:23.874713 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:23.874713 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:23.874713 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:23.877364 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:23.877364 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:23.877364 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:23.877364 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:23.877364 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:23.877364 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:23.877364 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:23.877364 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:23.877364 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:23.877364 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:23.877364 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:15:23.877364 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:15:23.877364 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 04:15:23.877364 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:23.877364 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 432/873] 10.222.0.91 () {56 vars in 1132 bytes} [Tue Aug 30 04:15:23 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 389 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:15:23.897178 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1866ffe4-487a-434b-9aa8-9de63befe845 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:24.172502 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7413d4c-a330-4ca9-a5da-671aa4f52290 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:24.172779 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7413d4c-a330-4ca9-a5da-671aa4f52290 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:24.173143 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7413d4c-a330-4ca9-a5da-671aa4f52290 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:24.179420 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 433/874] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:15:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:15:24.180930 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11058ff-4f42-4e12-8e39-282f10846618 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:24.181221 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11058ff-4f42-4e12-8e39-282f10846618 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:24.181548 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11058ff-4f42-4e12-8e39-282f10846618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:24.226236 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-e11058ff-4f42-4e12-8e39-282f10846618 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:24.227520 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-e11058ff-4f42-4e12-8e39-282f10846618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:24.249801 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1866ffe4-487a-434b-9aa8-9de63befe845 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:24.280472 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:24.339326 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa506b7-7e1d-44d8-a980-9003c525e906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:24.339985 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa506b7-7e1d-44d8-a980-9003c525e906 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:24.340270 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa506b7-7e1d-44d8-a980-9003c525e906 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:24.340535 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa506b7-7e1d-44d8-a980-9003c525e906 None admin] PATH_INFO: `/v3/services` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:24.341197 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa506b7-7e1d-44d8-a980-9003c525e906 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:24.341492 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa506b7-7e1d-44d8-a980-9003c525e906 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:24.344726 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa506b7-7e1d-44d8-a980-9003c525e906 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:24.350575 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 434/875] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:15:24 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:15:24.351572 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11058ff-4f42-4e12-8e39-282f10846618 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:24.360506 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 442/876] 10.222.0.91 () {56 vars in 1126 bytes} [Tue Aug 30 04:15:23 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 465 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:24.371166 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa506b7-7e1d-44d8-a980-9003c525e906 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:24.428077 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:24.550243 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11058ff-4f42-4e12-8e39-282f10846618 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:24.567794 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa506b7-7e1d-44d8-a980-9003c525e906 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:24.613204 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca46cc6-73fb-4909-bedd-9319175ed1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:24.614214 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca46cc6-73fb-4909-bedd-9319175ed1b1 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:24.614677 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca46cc6-73fb-4909-bedd-9319175ed1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:24.615209 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca46cc6-73fb-4909-bedd-9319175ed1b1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:24.627940 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62b3c26-8607-4b8d-ac07-ae1fc6d689ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:24.629426 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b3c26-8607-4b8d-ac07-ae1fc6d689ab None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:24.630577 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b3c26-8607-4b8d-ac07-ae1fc6d689ab None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:24.631390 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b3c26-8607-4b8d-ac07-ae1fc6d689ab None admin] PATH_INFO: `/v3/services` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:24.633043 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62b3c26-8607-4b8d-ac07-ae1fc6d689ab None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:24.633889 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62b3c26-8607-4b8d-ac07-ae1fc6d689ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:24.636827 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62b3c26-8607-4b8d-ac07-ae1fc6d689ab None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:24.645506 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca46cc6-73fb-4909-bedd-9319175ed1b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:15:24.647663 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 443/877] 10.222.0.91 () {56 vars in 1126 bytes} [Tue Aug 30 04:15:24 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:24.655118 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-7ca46cc6-73fb-4909-bedd-9319175ed1b1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 04:15:24.655118 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:24.655118 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:24.655118 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:24.655118 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:24.655118 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:24.655118 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:24.655118 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:24.655118 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:24.655118 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:24.655118 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:24.655118 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:24.655118 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:15:24.655118 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:15:24.655118 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:15:24.655118 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:15:24.656546 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:15:24.656546 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:15:24.656546 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:15:24.656546 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:15:24.656546 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:24.656546 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:24.656546 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:24.656546 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:24.656546 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:24.656546 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:24.656546 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:24.656546 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:24.656546 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:24.656546 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:24.656546 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:24.656546 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:24.658251 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:24.658251 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:24.658251 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:24.658251 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:24.658251 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:15:24.658251 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:15:24.658251 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:15:24.658251 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:15:24.658251 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:15:24.658251 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:15:24.658251 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 04:15:24.658251 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:24.664052 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 435/878] 10.222.0.91 () {56 vars in 1120 bytes} [Tue Aug 30 04:15:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:15:24.667147 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62b3c26-8607-4b8d-ac07-ae1fc6d689ab None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:24.768678 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca46cc6-73fb-4909-bedd-9319175ed1b1 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:24.798687 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:24.840058 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:24.857852 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62b3c26-8607-4b8d-ac07-ae1fc6d689ab None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:24.913773 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa5a56d-7395-47c4-a400-586caf182840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:24.914407 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5a56d-7395-47c4-a400-586caf182840 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:24.914706 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5a56d-7395-47c4-a400-586caf182840 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:24.914970 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5a56d-7395-47c4-a400-586caf182840 None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:24.915762 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa5a56d-7395-47c4-a400-586caf182840 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:24.916253 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa5a56d-7395-47c4-a400-586caf182840 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:24.918468 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa5a56d-7395-47c4-a400-586caf182840 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:24.934159 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 444/879] 10.222.0.91 () {56 vars in 1115 bytes} [Tue Aug 30 04:15:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:24.943888 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa5a56d-7395-47c4-a400-586caf182840 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:24.948864 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca46cc6-73fb-4909-bedd-9319175ed1b1 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:25.002747 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aefaf11-9066-48b5-9be2-29d06c137481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:25.004297 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aefaf11-9066-48b5-9be2-29d06c137481 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:25.005119 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aefaf11-9066-48b5-9be2-29d06c137481 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:25.005820 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aefaf11-9066-48b5-9be2-29d06c137481 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:25.007041 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aefaf11-9066-48b5-9be2-29d06c137481 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:25.010088 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aefaf11-9066-48b5-9be2-29d06c137481 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:25.026921 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-6aefaf11-9066-48b5-9be2-29d06c137481 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 04:15:25.026921 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:25.026921 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:15:25.026921 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:15:25.026921 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:15:25.026921 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:15:25.026921 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:15:25.026921 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:15:25.026921 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 04:15:25.026921 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:25.026921 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:15:25.026921 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:25.026921 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:25.026921 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:25.026921 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:25.026921 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:25.026921 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:25.028992 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:25.028992 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:25.028992 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:25.028992 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:25.028992 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:25.028992 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:25.028992 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:15:25.028992 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:15:25.028992 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:15:25.028992 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:15:25.028992 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:25.028992 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:25.028992 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:25.028992 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:25.028992 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:25.028992 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:25.031002 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:25.031002 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:25.031002 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:25.031002 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:25.031002 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:25.031002 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:25.031002 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:25.031002 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:25.031002 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:25.031002 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:25.031002 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:15:25.031002 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:15:25.031002 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 04:15:25.031002 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:25.031002 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 436/880] 10.222.0.91 () {56 vars in 1114 bytes} [Tue Aug 30 04:15:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:15:25.036827 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aefaf11-9066-48b5-9be2-29d06c137481 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:25.159679 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa5a56d-7395-47c4-a400-586caf182840 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:25.193780 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:25.210572 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d0538-9ce2-43be-874d-1e3aee456be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:25.211612 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d0538-9ce2-43be-874d-1e3aee456be8 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:25.212077 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d0538-9ce2-43be-874d-1e3aee456be8 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:25.212494 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d0538-9ce2-43be-874d-1e3aee456be8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:25.226248 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041d0538-9ce2-43be-874d-1e3aee456be8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:25.228029 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041d0538-9ce2-43be-874d-1e3aee456be8 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:25.242029 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aefaf11-9066-48b5-9be2-29d06c137481 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:25.246465 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-041d0538-9ce2-43be-874d-1e3aee456be8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:15:25.246465 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:25.246465 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:25.246465 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:25.246465 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:25.246465 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:25.246465 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:25.246465 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:25.246465 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:25.246465 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:25.246465 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:25.246465 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:25.246465 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:15:25.246465 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:15:25.246465 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:15:25.246465 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:15:25.247699 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:25.247699 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:25.247699 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:25.247699 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:25.247699 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:25.247699 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:25.247699 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:25.247699 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:25.247699 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:25.247699 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:25.247699 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:25.247699 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:25.247699 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:25.247699 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:25.247699 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:25.247699 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:25.247699 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:15:25.248689 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:15:25.248689 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:15:25.248689 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:15:25.251231 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 445/881] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:15:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:15:25.259954 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d0538-9ce2-43be-874d-1e3aee456be8 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:25.268826 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:25.316722 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30937c05-800d-4d19-8392-fa964efa6cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:25.317658 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30937c05-800d-4d19-8392-fa964efa6cbd None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:25.318109 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30937c05-800d-4d19-8392-fa964efa6cbd None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:25.318585 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30937c05-800d-4d19-8392-fa964efa6cbd None admin] PATH_INFO: `/v3/services` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:25.319754 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30937c05-800d-4d19-8392-fa964efa6cbd None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:25.320296 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30937c05-800d-4d19-8392-fa964efa6cbd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:25.322941 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30937c05-800d-4d19-8392-fa964efa6cbd None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:25.336479 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 437/882] 10.222.0.91 () {56 vars in 1114 bytes} [Tue Aug 30 04:15:25 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:15:25.342384 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30937c05-800d-4d19-8392-fa964efa6cbd None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:25.392303 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d0538-9ce2-43be-874d-1e3aee456be8 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:25.439873 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c314fab3-4393-4ffd-bf38-cc133e3f7672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:25.440651 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c314fab3-4393-4ffd-bf38-cc133e3f7672 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:25.441251 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c314fab3-4393-4ffd-bf38-cc133e3f7672 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:25.441646 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c314fab3-4393-4ffd-bf38-cc133e3f7672 None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:25.442551 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c314fab3-4393-4ffd-bf38-cc133e3f7672 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:25.442925 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c314fab3-4393-4ffd-bf38-cc133e3f7672 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:25.444519 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c314fab3-4393-4ffd-bf38-cc133e3f7672 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:25.461938 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 446/883] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:15:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:15:25.465990 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0a593-ccde-4268-827b-91a365753e04 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:25.466471 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0a593-ccde-4268-827b-91a365753e04 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:25.466939 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0a593-ccde-4268-827b-91a365753e04 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:25.470489 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 447/884] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:15:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:15:25.471963 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b0a593-ccde-4268-827b-91a365753e04 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:25.546638 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30937c05-800d-4d19-8392-fa964efa6cbd None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:25.584391 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:25.616003 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4687a4-ae0c-4d88-ba89-4bdb09744c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:25.616947 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4687a4-ae0c-4d88-ba89-4bdb09744c7c None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:25.620192 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4687a4-ae0c-4d88-ba89-4bdb09744c7c None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:25.620192 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4687a4-ae0c-4d88-ba89-4bdb09744c7c None admin] PATH_INFO: `/v3/services` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:25.620192 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4687a4-ae0c-4d88-ba89-4bdb09744c7c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:25.620192 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4687a4-ae0c-4d88-ba89-4bdb09744c7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:25.623517 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4687a4-ae0c-4d88-ba89-4bdb09744c7c None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:25.631420 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 438/885] 10.222.0.91 () {56 vars in 1114 bytes} [Tue Aug 30 04:15:25 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:25.632981 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6b9d8-a759-48d6-9739-4c95dcb9e86d None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:25.633420 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6b9d8-a759-48d6-9739-4c95dcb9e86d None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:25.633920 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6b9d8-a759-48d6-9739-4c95dcb9e86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:25.648992 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:25.665034 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-1fb6b9d8-a759-48d6-9739-4c95dcb9e86d None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:25.666945 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-1fb6b9d8-a759-48d6-9739-4c95dcb9e86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:25.674314 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b0a593-ccde-4268-827b-91a365753e04 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:25.743190 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9750f9-8687-4a59-ad0e-043da59bd76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:25.744329 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9750f9-8687-4a59-ad0e-043da59bd76c None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:25.744791 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9750f9-8687-4a59-ad0e-043da59bd76c None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:25.745377 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9750f9-8687-4a59-ad0e-043da59bd76c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:25.759975 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9750f9-8687-4a59-ad0e-043da59bd76c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:25.761328 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 439/886] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:15:25 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:15:25.762429 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9750f9-8687-4a59-ad0e-043da59bd76c None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:25.766027 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb6b9d8-a759-48d6-9739-4c95dcb9e86d None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:25.794455 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-fd9750f9-8687-4a59-ad0e-043da59bd76c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 04:15:25.794455 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:25.794455 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:25.794455 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:25.794455 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:25.794455 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:25.794455 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:25.794455 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:25.794455 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:25.794455 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:25.794455 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:25.794455 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:25.794455 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:15:25.794455 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:15:25.794455 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:15:25.794455 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:15:25.796368 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:25.796368 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:25.796368 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:15:25.796368 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:15:25.796368 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:15:25.796368 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:15:25.796368 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:25.796368 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:25.796368 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:25.796368 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:25.796368 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:25.796368 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:25.796368 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:25.796368 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:25.796368 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:25.796368 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:25.796368 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:25.796368 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:25.798176 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:25.798176 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:25.798176 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:15:25.798176 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:15:25.798176 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:15:25.798176 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:15:25.798176 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:15:25.798176 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:15:25.798176 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 04:15:25.798176 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:15:25.798176 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 448/887] 10.222.0.91 () {56 vars in 1117 bytes} [Tue Aug 30 04:15:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:15:25.807006 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9750f9-8687-4a59-ad0e-043da59bd76c None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:25.990638 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9750f9-8687-4a59-ad0e-043da59bd76c None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:25.992298 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb6b9d8-a759-48d6-9739-4c95dcb9e86d None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:26.028147 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:26.041182 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30fa35a-d831-4481-a598-953c620044a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:26.042140 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30fa35a-d831-4481-a598-953c620044a9 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:26.043611 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30fa35a-d831-4481-a598-953c620044a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:26.044103 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30fa35a-d831-4481-a598-953c620044a9 None admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:26.045375 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30fa35a-d831-4481-a598-953c620044a9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:26.045905 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30fa35a-d831-4481-a598-953c620044a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:26.047973 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30fa35a-d831-4481-a598-953c620044a9 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:26.064555 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965e7e8b-2a77-40c1-a980-ef074797805f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:26.065751 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e7e8b-2a77-40c1-a980-ef074797805f None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:26.066284 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e7e8b-2a77-40c1-a980-ef074797805f None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:26.066794 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e7e8b-2a77-40c1-a980-ef074797805f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:26.068167 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965e7e8b-2a77-40c1-a980-ef074797805f None admin] RBAC: Adding query filter params (interface=public, service_id=5ca40e866876485695202ac1118c3e80, region_id=RegionOne) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:26.068804 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965e7e8b-2a77-40c1-a980-ef074797805f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:26.071529 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965e7e8b-2a77-40c1-a980-ef074797805f None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:26.074781 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 449/888] 10.222.0.91 () {56 vars in 1149 bytes} [Tue Aug 30 04:15:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:26.083490 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30fa35a-d831-4481-a598-953c620044a9 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:26.087287 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:26.092173 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 440/889] 10.222.0.91 () {56 vars in 1251 bytes} [Tue Aug 30 04:15:25 2022] GET /identity/v3/endpoints?service_id=5ca40e866876485695202ac1118c3e80&interface=public®ion_id=RegionOne => generated 194 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:26.100463 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965e7e8b-2a77-40c1-a980-ef074797805f None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:26.233717 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30fa35a-d831-4481-a598-953c620044a9 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:26.283964 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965e7e8b-2a77-40c1-a980-ef074797805f None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:26.305135 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e6ec4-2150-4ca1-a2cf-f5ef9e24f65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:26.306229 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e6ec4-2150-4ca1-a2cf-f5ef9e24f65d None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:26.306919 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e6ec4-2150-4ca1-a2cf-f5ef9e24f65d None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:26.307375 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e6ec4-2150-4ca1-a2cf-f5ef9e24f65d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:26.326014 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1385ab-86a0-4ec8-a132-2a10139f815b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:26.326337 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1385ab-86a0-4ec8-a132-2a10139f815b None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:26.326519 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1385ab-86a0-4ec8-a132-2a10139f815b None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:26.326683 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1385ab-86a0-4ec8-a132-2a10139f815b None admin] PATH_INFO: `/v3/services` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:26.327413 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1385ab-86a0-4ec8-a132-2a10139f815b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:26.328827 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1385ab-86a0-4ec8-a132-2a10139f815b None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:26.347970 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 441/890] 10.222.0.91 () {56 vars in 1087 bytes} [Tue Aug 30 04:15:26 2022] GET /identity/v3/services => generated 1011 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:15:26.347970 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1385ab-86a0-4ec8-a132-2a10139f815b None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:26.431413 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:26.463948 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570e6ec4-2150-4ca1-a2cf-f5ef9e24f65d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:26.466722 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570e6ec4-2150-4ca1-a2cf-f5ef9e24f65d None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:26.477369 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:26.582961 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1385ab-86a0-4ec8-a132-2a10139f815b None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:26.664705 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb301ec4-cd17-473a-9aca-1b8e703744b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:26.666165 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb301ec4-cd17-473a-9aca-1b8e703744b1 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:26.666812 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb301ec4-cd17-473a-9aca-1b8e703744b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:26.667479 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb301ec4-cd17-473a-9aca-1b8e703744b1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:26.669073 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb301ec4-cd17-473a-9aca-1b8e703744b1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:26.671796 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb301ec4-cd17-473a-9aca-1b8e703744b1 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:26.688679 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-bb301ec4-cd17-473a-9aca-1b8e703744b1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 04:15:26.688679 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:26.688679 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:15:26.688679 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:15:26.688679 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:15:26.688679 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:15:26.688679 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:15:26.688679 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:15:26.688679 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 04:15:26.688679 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:26.688679 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:15:26.688679 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:26.688679 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:26.688679 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:26.688679 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:26.688679 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:26.688679 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:26.690740 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:26.690740 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:26.690740 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:26.690740 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:26.690740 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:26.690740 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:26.690740 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:15:26.690740 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:15:26.690740 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:15:26.690740 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:15:26.690740 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:26.690740 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:26.690740 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:26.690740 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:26.690740 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:26.690740 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:26.693058 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:26.693058 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:26.693058 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:26.693058 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:26.693058 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:26.693058 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:26.693058 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:26.693058 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:26.693058 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:26.693058 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:26.693058 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:15:26.693058 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:15:26.693058 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 04:15:26.693058 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:26.695992 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 442/891] 10.222.0.91 () {56 vars in 1126 bytes} [Tue Aug 30 04:15:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:15:26.703962 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 450/892] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 30 04:15:26 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 620 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 04:15:26.704887 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb301ec4-cd17-473a-9aca-1b8e703744b1 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:26.711756 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e6ec4-2150-4ca1-a2cf-f5ef9e24f65d None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:26.909306 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:26.920016 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb301ec4-cd17-473a-9aca-1b8e703744b1 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:26.955732 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e6ec4-2150-4ca1-a2cf-f5ef9e24f65d None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:26.976463 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:26.998833 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c630891-7a91-4caa-b24d-a7d4f8dddb72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:27.000016 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c630891-7a91-4caa-b24d-a7d4f8dddb72 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:27.000836 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c630891-7a91-4caa-b24d-a7d4f8dddb72 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:27.001302 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c630891-7a91-4caa-b24d-a7d4f8dddb72 None admin] PATH_INFO: `/v3/services` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:27.002475 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c630891-7a91-4caa-b24d-a7d4f8dddb72 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:27.003002 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c630891-7a91-4caa-b24d-a7d4f8dddb72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:27.005630 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c630891-7a91-4caa-b24d-a7d4f8dddb72 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:27.015966 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 443/893] 10.222.0.91 () {56 vars in 1122 bytes} [Tue Aug 30 04:15:26 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:27.025324 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c630891-7a91-4caa-b24d-a7d4f8dddb72 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:27.051297 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741583b3-30d1-471c-af92-84c7da8ff66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:27.052395 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741583b3-30d1-471c-af92-84c7da8ff66f None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:27.052891 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741583b3-30d1-471c-af92-84c7da8ff66f None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:27.053380 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741583b3-30d1-471c-af92-84c7da8ff66f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:27.074839 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741583b3-30d1-471c-af92-84c7da8ff66f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:27.077680 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741583b3-30d1-471c-af92-84c7da8ff66f None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:27.108179 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-741583b3-30d1-471c-af92-84c7da8ff66f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:15:27.108179 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:27.108179 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:27.108179 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:27.108179 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:27.108179 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:27.108179 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:27.108179 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:27.108179 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:27.108179 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:27.108179 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:27.108179 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:27.108179 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:15:27.108179 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:15:27.108179 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:15:27.108179 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:15:27.110053 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:27.110053 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:27.110053 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:27.110053 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:27.110053 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:27.110053 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:27.110053 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:27.110053 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:27.110053 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:27.110053 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:27.110053 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:27.110053 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:27.110053 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:27.110053 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:27.110053 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:27.110053 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:27.110053 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:15:27.112133 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:15:27.112133 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:15:27.112133 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:15:27.116108 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 451/894] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:15:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 400 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:15:27.119882 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741583b3-30d1-471c-af92-84c7da8ff66f None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:27.250760 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c630891-7a91-4caa-b24d-a7d4f8dddb72 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:27.312477 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd41c82-23a3-4491-a45c-ff869d5b0746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:27.313117 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd41c82-23a3-4491-a45c-ff869d5b0746 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:27.313400 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd41c82-23a3-4491-a45c-ff869d5b0746 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:27.313678 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd41c82-23a3-4491-a45c-ff869d5b0746 None admin] PATH_INFO: `/v3/services` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:27.314324 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd41c82-23a3-4491-a45c-ff869d5b0746 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:27.314625 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd41c82-23a3-4491-a45c-ff869d5b0746 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:27.316086 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd41c82-23a3-4491-a45c-ff869d5b0746 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:27.328029 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 444/895] 10.222.0.91 () {56 vars in 1122 bytes} [Tue Aug 30 04:15:27 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:15:27.328029 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58896aa8-7855-43b1-8a36-b88ff96cf12c None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:27.328029 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58896aa8-7855-43b1-8a36-b88ff96cf12c None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:27.328029 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58896aa8-7855-43b1-8a36-b88ff96cf12c None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:27.328029 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 445/896] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:15:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:15:27.331266 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ff1cd-fd15-4132-9571-080ee9f84993 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:27.331520 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ff1cd-fd15-4132-9571-080ee9f84993 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:27.331827 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ff1cd-fd15-4132-9571-080ee9f84993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:27.335698 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741583b3-30d1-471c-af92-84c7da8ff66f None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:27.353131 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-791ff1cd-fd15-4132-9571-080ee9f84993 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:27.354847 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-791ff1cd-fd15-4132-9571-080ee9f84993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:27.403675 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983462e1-39e6-4684-ad12-727870df6443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:27.404358 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983462e1-39e6-4684-ad12-727870df6443 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:27.404637 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983462e1-39e6-4684-ad12-727870df6443 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:27.404908 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983462e1-39e6-4684-ad12-727870df6443 None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:27.405610 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983462e1-39e6-4684-ad12-727870df6443 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:27.405910 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983462e1-39e6-4684-ad12-727870df6443 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:27.407537 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983462e1-39e6-4684-ad12-727870df6443 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:27.410725 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:27.439995 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 452/897] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:15:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:27.444224 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983462e1-39e6-4684-ad12-727870df6443 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:27.445931 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:27.483227 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 446/898] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:15:27 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 04:15:27.664316 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983462e1-39e6-4684-ad12-727870df6443 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:27.737017 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c52d529-90e5-4be6-8457-6d989708852d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:27.739425 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52d529-90e5-4be6-8457-6d989708852d None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:27.740163 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52d529-90e5-4be6-8457-6d989708852d None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:27.740881 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52d529-90e5-4be6-8457-6d989708852d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:27.755449 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c52d529-90e5-4be6-8457-6d989708852d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:27.758643 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c52d529-90e5-4be6-8457-6d989708852d None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:27.784107 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-7c52d529-90e5-4be6-8457-6d989708852d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:15:27.784107 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:27.784107 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:27.784107 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:27.784107 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:27.784107 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:27.784107 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:27.784107 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:27.784107 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:27.784107 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:27.784107 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:27.784107 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:27.784107 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:15:27.784107 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:15:27.784107 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:15:27.785860 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:15:27.785860 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:27.785860 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:27.785860 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:27.785860 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:27.785860 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:27.785860 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:27.785860 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:27.785860 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:27.785860 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:27.785860 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:27.785860 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:27.785860 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:27.785860 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:27.785860 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:27.785860 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:27.785860 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:27.787625 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:15:27.787625 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:15:27.787625 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:15:27.787625 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:15:27.787625 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:15:27.787625 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:15:27.787625 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:15:27.787625 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:15:27.793318 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 453/899] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 30 04:15:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:15:27.803465 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791ff1cd-fd15-4132-9571-080ee9f84993 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:27.962533 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c52d529-90e5-4be6-8457-6d989708852d None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:28.009901 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791ff1cd-fd15-4132-9571-080ee9f84993 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:28.037584 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:28.079262 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86660e6a-0d7f-47ea-9ff3-3f06c808d085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:28.080407 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86660e6a-0d7f-47ea-9ff3-3f06c808d085 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:28.081106 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86660e6a-0d7f-47ea-9ff3-3f06c808d085 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:28.081547 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86660e6a-0d7f-47ea-9ff3-3f06c808d085 None admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:28.083304 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86660e6a-0d7f-47ea-9ff3-3f06c808d085 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:28.083484 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86660e6a-0d7f-47ea-9ff3-3f06c808d085 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:28.086272 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86660e6a-0d7f-47ea-9ff3-3f06c808d085 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:28.098286 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c52d529-90e5-4be6-8457-6d989708852d None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:28.111330 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 447/900] 10.222.0.91 () {56 vars in 1148 bytes} [Tue Aug 30 04:15:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:28.121253 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86660e6a-0d7f-47ea-9ff3-3f06c808d085 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:28.149038 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e911a-59fb-4443-8c29-f20fd71bab6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:28.149674 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e911a-59fb-4443-8c29-f20fd71bab6e None admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:28.149946 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e911a-59fb-4443-8c29-f20fd71bab6e None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:28.150277 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e911a-59fb-4443-8c29-f20fd71bab6e None admin] PATH_INFO: `/v3/services` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:28.151511 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7e911a-59fb-4443-8c29-f20fd71bab6e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:28.153653 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7e911a-59fb-4443-8c29-f20fd71bab6e None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:28.179944 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 454/901] 10.222.0.91 () {60 vars in 1141 bytes} [Tue Aug 30 04:15:27 2022] POST /identity/v3/services => generated 269 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:15:28.225799 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:28.340794 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86660e6a-0d7f-47ea-9ff3-3f06c808d085 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:28.429428 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ff0b5-ee1b-40a8-9280-6c3692db5de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:28.429428 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ff0b5-ee1b-40a8-9280-6c3692db5de4 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:28.429885 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ff0b5-ee1b-40a8-9280-6c3692db5de4 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:28.430033 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ff0b5-ee1b-40a8-9280-6c3692db5de4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:28.431199 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960ff0b5-ee1b-40a8-9280-6c3692db5de4 None admin] RBAC: Adding query filter params (role.id=d110827932ac4a4db66e89e29c8b6115, scope.project.id=4e05769361674c8fa995050150ad4cfa, user.id=1bc12faf48984335a3515dcde85b5cb1) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:28.432035 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960ff0b5-ee1b-40a8-9280-6c3692db5de4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:28.434447 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960ff0b5-ee1b-40a8-9280-6c3692db5de4 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:28.446376 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 448/902] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 30 04:15:28 2022] GET /identity/v3/role_assignments?user.id=1bc12faf48984335a3515dcde85b5cb1&scope.project.id=4e05769361674c8fa995050150ad4cfa&role.id=d110827932ac4a4db66e89e29c8b6115 => generated 259 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:28.849650 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396ed1e-46d0-42ae-a803-be11ce511faa None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:28.849650 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396ed1e-46d0-42ae-a803-be11ce511faa None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:28.850614 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396ed1e-46d0-42ae-a803-be11ce511faa None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:28.852987 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 455/903] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:15:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:15:28.857661 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb73333-9c5d-4d43-b8c1-fba3fa06c59b None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:28.858073 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb73333-9c5d-4d43-b8c1-fba3fa06c59b None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:28.858309 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb73333-9c5d-4d43-b8c1-fba3fa06c59b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:28.884295 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-efb73333-9c5d-4d43-b8c1-fba3fa06c59b None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:28.886208 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-efb73333-9c5d-4d43-b8c1-fba3fa06c59b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:29.023890 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 449/904] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:15:28 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:15:29.299463 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1396ed1e-46d0-42ae-a803-be11ce511faa None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:29.426333 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1396ed1e-46d0-42ae-a803-be11ce511faa None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:29.448717 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:29.491878 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b32a7-9be6-4945-9880-4973d9846d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:29.493681 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b32a7-9be6-4945-9880-4973d9846d30 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:29.494885 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b32a7-9be6-4945-9880-4973d9846d30 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:29.495693 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b32a7-9be6-4945-9880-4973d9846d30 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:29.497522 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b32a7-9be6-4945-9880-4973d9846d30 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:29.500752 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b32a7-9be6-4945-9880-4973d9846d30 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:29.519102 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-245b32a7-9be6-4945-9880-4973d9846d30 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 04:15:29.519102 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:29.519102 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:15:29.519102 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:15:29.519102 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:15:29.519102 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:15:29.519102 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:15:29.519102 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:15:29.519102 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 04:15:29.519102 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:15:29.519102 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:15:29.519102 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:15:29.519102 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:29.519102 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:29.519102 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:29.519102 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:29.519102 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:29.521108 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:29.521108 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:29.521108 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:29.521108 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:29.521108 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:29.521108 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:29.521108 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:15:29.521108 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:15:29.521108 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:15:29.521108 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:15:29.521108 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:29.521108 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:29.521108 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:29.521108 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:29.521108 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:29.521108 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:29.522821 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:29.522821 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:29.522821 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:29.522821 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:29.522821 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:29.522821 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:29.522821 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:29.522821 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:29.522821 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:29.522821 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:29.522821 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:15:29.522821 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:15:29.522821 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 04:15:29.522821 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:15:29.528327 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 456/905] 10.222.0.91 () {56 vars in 1114 bytes} [Tue Aug 30 04:15:29 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:15:29.536263 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb73333-9c5d-4d43-b8c1-fba3fa06c59b None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:29.574450 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:29.658046 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb73333-9c5d-4d43-b8c1-fba3fa06c59b None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:29.697880 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e665744-0620-4816-8ad6-9e879cea2cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:29.698791 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e665744-0620-4816-8ad6-9e879cea2cce None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:29.699071 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e665744-0620-4816-8ad6-9e879cea2cce None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:29.699340 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e665744-0620-4816-8ad6-9e879cea2cce None admin] PATH_INFO: `/v3/services` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:29.700851 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e665744-0620-4816-8ad6-9e879cea2cce None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:29.700851 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e665744-0620-4816-8ad6-9e879cea2cce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:29.701765 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e665744-0620-4816-8ad6-9e879cea2cce None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:29.707987 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 450/906] 10.222.0.91 () {56 vars in 1114 bytes} [Tue Aug 30 04:15:29 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:29.717745 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b32a7-9be6-4945-9880-4973d9846d30 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:29.887505 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b32a7-9be6-4945-9880-4973d9846d30 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:29.954620 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645211eb-f9f8-4aa7-8891-1d7d09166b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:29.955684 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645211eb-f9f8-4aa7-8891-1d7d09166b1f None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:29.956271 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645211eb-f9f8-4aa7-8891-1d7d09166b1f None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:29.956743 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645211eb-f9f8-4aa7-8891-1d7d09166b1f None admin] PATH_INFO: `/v3/services` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:29.957912 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645211eb-f9f8-4aa7-8891-1d7d09166b1f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:29.958432 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645211eb-f9f8-4aa7-8891-1d7d09166b1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:29.961089 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645211eb-f9f8-4aa7-8891-1d7d09166b1f None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:29.971993 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 457/907] 10.222.0.91 () {56 vars in 1114 bytes} [Tue Aug 30 04:15:29 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:29.977750 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e665744-0620-4816-8ad6-9e879cea2cce None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:30.096277 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:30.100413 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e665744-0620-4816-8ad6-9e879cea2cce None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:30.196756 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97060588-6c25-4372-95dd-a177e476e6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:30.197983 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97060588-6c25-4372-95dd-a177e476e6d1 None admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:30.198470 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97060588-6c25-4372-95dd-a177e476e6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:30.199045 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97060588-6c25-4372-95dd-a177e476e6d1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:30.200358 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97060588-6c25-4372-95dd-a177e476e6d1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:30.203023 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97060588-6c25-4372-95dd-a177e476e6d1 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:30.248287 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 451/908] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:15:29 2022] POST /identity/v3/endpoints => generated 346 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:15:30.256890 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3fcf8-1a86-4a56-9db5-f0929fee3c3a None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:30.257216 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3fcf8-1a86-4a56-9db5-f0929fee3c3a None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:30.257467 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3fcf8-1a86-4a56-9db5-f0929fee3c3a None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:30.260720 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 458/909] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:15:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:15:30.265848 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779ea79-f23d-4b29-b454-5c22666e057d None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:30.266297 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779ea79-f23d-4b29-b454-5c22666e057d None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:30.266540 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779ea79-f23d-4b29-b454-5c22666e057d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:30.288092 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-a779ea79-f23d-4b29-b454-5c22666e057d None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:30.289467 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-a779ea79-f23d-4b29-b454-5c22666e057d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:30.427073 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 452/910] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:15:30 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:15:30.505332 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1790669-8506-4ae5-9d22-ed31e1add1e6 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:30.505332 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1790669-8506-4ae5-9d22-ed31e1add1e6 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:30.505332 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1790669-8506-4ae5-9d22-ed31e1add1e6 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:30.506186 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 459/911] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:15:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:15:30.512528 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb56bed-77bb-408f-a26d-1cf068513440 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:30.513170 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb56bed-77bb-408f-a26d-1cf068513440 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:30.513641 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb56bed-77bb-408f-a26d-1cf068513440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:30.535225 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-bcb56bed-77bb-408f-a26d-1cf068513440 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:30.536784 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-bcb56bed-77bb-408f-a26d-1cf068513440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:30.669208 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 453/912] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:15:30 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:15:30.836623 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1790669-8506-4ae5-9d22-ed31e1add1e6 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:30.933577 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:30.968955 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb56bed-77bb-408f-a26d-1cf068513440 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:30.994878 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:31.047539 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1790669-8506-4ae5-9d22-ed31e1add1e6 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:31.092483 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb56bed-77bb-408f-a26d-1cf068513440 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:31.115432 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2478ce0f-ad25-446b-a0c8-ed8bf4958882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:31.116534 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478ce0f-ad25-446b-a0c8-ed8bf4958882 None admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:31.116994 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478ce0f-ad25-446b-a0c8-ed8bf4958882 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:31.117453 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478ce0f-ad25-446b-a0c8-ed8bf4958882 None admin] PATH_INFO: `/v3/services` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:31.118717 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2478ce0f-ad25-446b-a0c8-ed8bf4958882 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:31.121672 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2478ce0f-ad25-446b-a0c8-ed8bf4958882 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:31.137130 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9d5c52-0b23-4728-8a4b-6d099880a535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:31.137836 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d5c52-0b23-4728-8a4b-6d099880a535 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:31.138089 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d5c52-0b23-4728-8a4b-6d099880a535 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:31.138359 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d5c52-0b23-4728-8a4b-6d099880a535 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:31.139026 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9d5c52-0b23-4728-8a4b-6d099880a535 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:31.140574 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9d5c52-0b23-4728-8a4b-6d099880a535 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:31.151449 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-be9d5c52-0b23-4728-8a4b-6d099880a535 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 04:15:31.151449 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:31.151449 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:15:31.151449 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:15:31.151449 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:15:31.151449 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:15:31.151449 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:15:31.151449 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:15:31.151449 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 04:15:31.151449 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:31.151449 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:15:31.151449 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:31.151449 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:31.151449 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:31.151449 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:31.151449 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:31.152913 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:31.152913 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:31.152913 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:31.152913 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:31.152913 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:31.152913 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:31.152913 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:31.152913 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:15:31.152913 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:15:31.152913 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:15:31.152913 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:15:31.152913 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:31.152913 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:31.152913 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:31.152913 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:31.152913 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:31.152913 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:31.154389 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:31.154389 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:31.154389 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:31.154389 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:31.154389 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:31.154389 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:31.154389 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:31.154389 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:31.154389 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:31.154389 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:31.154389 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:15:31.154389 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:15:31.154389 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 04:15:31.154389 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:31.157548 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 460/914] 10.222.0.91 () {60 vars in 1141 bytes} [Tue Aug 30 04:15:30 2022] POST /identity/v3/services => generated 241 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:15:31.157822 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 454/914] 10.222.0.91 () {56 vars in 1132 bytes} [Tue Aug 30 04:15:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:15:31.160158 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2478ce0f-ad25-446b-a0c8-ed8bf4958882 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:31.383821 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:31.392832 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2478ce0f-ad25-446b-a0c8-ed8bf4958882 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:31.461911 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c611da7f-44ef-49dc-9b1a-b4b0ff34ec37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:31.463646 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611da7f-44ef-49dc-9b1a-b4b0ff34ec37 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:31.464189 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611da7f-44ef-49dc-9b1a-b4b0ff34ec37 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:31.464679 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611da7f-44ef-49dc-9b1a-b4b0ff34ec37 None admin] PATH_INFO: `/v3/services` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:31.465934 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c611da7f-44ef-49dc-9b1a-b4b0ff34ec37 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:31.466462 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c611da7f-44ef-49dc-9b1a-b4b0ff34ec37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:31.469118 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c611da7f-44ef-49dc-9b1a-b4b0ff34ec37 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:31.479301 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 461/915] 10.222.0.91 () {56 vars in 1126 bytes} [Tue Aug 30 04:15:31 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:31.485155 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9d5c52-0b23-4728-8a4b-6d099880a535 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:31.494942 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301c5a3-bf59-4645-ab14-8f5d4021597b None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:31.495411 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301c5a3-bf59-4645-ab14-8f5d4021597b None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:31.495858 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301c5a3-bf59-4645-ab14-8f5d4021597b None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:31.498798 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 462/916] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:15:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:15:31.507542 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a5a38-6018-458c-b720-67565497ea4d None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:31.508045 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a5a38-6018-458c-b720-67565497ea4d None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:31.508517 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a5a38-6018-458c-b720-67565497ea4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:31.540449 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-d78a5a38-6018-458c-b720-67565497ea4d None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:31.542631 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-d78a5a38-6018-458c-b720-67565497ea4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:31.627867 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:31.666653 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 463/917] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:15:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:15:31.672971 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9d5c52-0b23-4728-8a4b-6d099880a535 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:31.741594 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c728ea-b03f-4c75-b119-c44addd20a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:31.743102 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c728ea-b03f-4c75-b119-c44addd20a19 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:31.743873 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c728ea-b03f-4c75-b119-c44addd20a19 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:31.744896 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c728ea-b03f-4c75-b119-c44addd20a19 None admin] PATH_INFO: `/v3/services` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:31.746593 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c728ea-b03f-4c75-b119-c44addd20a19 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:31.747459 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c728ea-b03f-4c75-b119-c44addd20a19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:31.750409 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c728ea-b03f-4c75-b119-c44addd20a19 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:31.761049 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 455/918] 10.222.0.91 () {56 vars in 1126 bytes} [Tue Aug 30 04:15:31 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:31.771620 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78a5a38-6018-458c-b720-67565497ea4d None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:31.947820 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c728ea-b03f-4c75-b119-c44addd20a19 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:31.959854 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:31.969039 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78a5a38-6018-458c-b720-67565497ea4d None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:32.029910 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba09c86-404c-490d-8492-8fd2cc5c8be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:32.030978 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba09c86-404c-490d-8492-8fd2cc5c8be2 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:32.031523 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba09c86-404c-490d-8492-8fd2cc5c8be2 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:32.032045 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba09c86-404c-490d-8492-8fd2cc5c8be2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:32.033003 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba09c86-404c-490d-8492-8fd2cc5c8be2 None admin] RBAC: Adding query filter params (interface=public, service_id=3020276559a84c469fd2477d4ae7e1f4, region_id=RegionOne) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:32.033611 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba09c86-404c-490d-8492-8fd2cc5c8be2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:32.035270 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba09c86-404c-490d-8492-8fd2cc5c8be2 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:32.048423 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 464/919] 10.222.0.91 () {56 vars in 1251 bytes} [Tue Aug 30 04:15:31 2022] GET /identity/v3/endpoints?service_id=3020276559a84c469fd2477d4ae7e1f4&interface=public®ion_id=RegionOne => generated 194 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:32.049797 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba09c86-404c-490d-8492-8fd2cc5c8be2 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:32.117471 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c728ea-b03f-4c75-b119-c44addd20a19 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:32.197216 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4792d66-458b-499c-a73f-2a1653a3f870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:32.198423 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4792d66-458b-499c-a73f-2a1653a3f870 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:32.198860 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4792d66-458b-499c-a73f-2a1653a3f870 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:32.199312 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4792d66-458b-499c-a73f-2a1653a3f870 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:32.215387 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:32.227647 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4792d66-458b-499c-a73f-2a1653a3f870 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:15:32.235860 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba09c86-404c-490d-8492-8fd2cc5c8be2 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:32.238987 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-e4792d66-458b-499c-a73f-2a1653a3f870 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 04:15:32.238987 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:32.238987 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:32.238987 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:32.238987 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:32.238987 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:32.238987 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:32.238987 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:32.238987 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:32.238987 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:32.238987 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:32.238987 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:32.238987 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:15:32.238987 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:15:32.238987 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:15:32.238987 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:15:32.241166 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:15:32.241166 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:15:32.241166 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:15:32.241166 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:15:32.241166 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:32.241166 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:32.241166 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:32.241166 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:32.241166 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:32.241166 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:32.241166 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:32.241166 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:32.241166 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:32.241166 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:32.241166 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:32.241166 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:32.242824 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:32.242824 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:32.242824 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:32.242824 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:32.242824 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:15:32.242824 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:15:32.242824 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:15:32.242824 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:15:32.242824 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:15:32.242824 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:15:32.242824 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 04:15:32.242824 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:32.247112 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 456/920] 10.222.0.91 () {56 vars in 1120 bytes} [Tue Aug 30 04:15:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:15:32.253304 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4792d66-458b-499c-a73f-2a1653a3f870 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:32.322841 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d97278-18d4-4df6-9798-fc69b7dd93b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:32.324544 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d97278-18d4-4df6-9798-fc69b7dd93b5 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:32.325359 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d97278-18d4-4df6-9798-fc69b7dd93b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:32.326121 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d97278-18d4-4df6-9798-fc69b7dd93b5 None admin] PATH_INFO: `/v3/services` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:32.327460 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d97278-18d4-4df6-9798-fc69b7dd93b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:32.330406 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d97278-18d4-4df6-9798-fc69b7dd93b5 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:32.348875 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 465/921] 10.222.0.91 () {56 vars in 1087 bytes} [Tue Aug 30 04:15:32 2022] GET /identity/v3/services => generated 1497 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:15:32.426238 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb685086-925f-4f64-974f-c18ee910e060 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:32.426513 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb685086-925f-4f64-974f-c18ee910e060 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:32.426882 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb685086-925f-4f64-974f-c18ee910e060 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:32.432921 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 466/922] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:15:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:15:32.435420 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfadb7a-d5c8-4d92-bfee-ed683e77e5be None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:32.435825 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfadb7a-d5c8-4d92-bfee-ed683e77e5be None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:32.436196 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfadb7a-d5c8-4d92-bfee-ed683e77e5be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:32.447510 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4792d66-458b-499c-a73f-2a1653a3f870 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:32.464235 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-cdfadb7a-d5c8-4d92-bfee-ed683e77e5be None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:32.465589 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-cdfadb7a-d5c8-4d92-bfee-ed683e77e5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:32.490668 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:32.520022 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f582fcf7-4a75-4f94-9f22-8a3fed8f9ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:32.521074 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582fcf7-4a75-4f94-9f22-8a3fed8f9ecd None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:32.521563 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582fcf7-4a75-4f94-9f22-8a3fed8f9ecd None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:32.522059 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582fcf7-4a75-4f94-9f22-8a3fed8f9ecd None admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:32.523004 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f582fcf7-4a75-4f94-9f22-8a3fed8f9ecd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:32.523547 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f582fcf7-4a75-4f94-9f22-8a3fed8f9ecd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:32.525706 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f582fcf7-4a75-4f94-9f22-8a3fed8f9ecd None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:32.544580 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 457/923] 10.222.0.91 () {56 vars in 1115 bytes} [Tue Aug 30 04:15:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:32.546515 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f582fcf7-4a75-4f94-9f22-8a3fed8f9ecd None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:32.595941 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 467/924] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:15:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:15:32.637253 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:32.715085 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f582fcf7-4a75-4f94-9f22-8a3fed8f9ecd None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:32.758497 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8f41ee-4087-426c-81ad-728014ea41a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:32.759188 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f41ee-4087-426c-81ad-728014ea41a4 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:32.759464 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f41ee-4087-426c-81ad-728014ea41a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:32.759867 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f41ee-4087-426c-81ad-728014ea41a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:32.773499 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8f41ee-4087-426c-81ad-728014ea41a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:32.775055 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8f41ee-4087-426c-81ad-728014ea41a4 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:32.797521 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-9c8f41ee-4087-426c-81ad-728014ea41a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:15:32.797521 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:32.797521 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:32.797521 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:32.797521 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:32.797521 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:32.797521 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:32.797521 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:32.797521 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:32.797521 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:32.797521 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:32.797521 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:32.797521 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:15:32.797521 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:15:32.797521 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:15:32.797521 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:15:32.799600 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:32.799600 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:32.799600 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:32.799600 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:32.799600 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:32.799600 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:32.799600 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:32.799600 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:32.799600 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:32.799600 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:32.799600 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:32.799600 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:32.799600 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:32.799600 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:32.799600 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:32.799600 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:32.799600 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:15:32.801416 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:15:32.801416 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:15:32.801416 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:32.801416 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 458/925] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:15:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:15:32.805279 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfadb7a-d5c8-4d92-bfee-ed683e77e5be None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:32.884548 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8f41ee-4087-426c-81ad-728014ea41a4 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:32.981812 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfadb7a-d5c8-4d92-bfee-ed683e77e5be None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:33.041242 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba5ca36-e840-4083-b05c-e94ac24d1248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:33.043670 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba5ca36-e840-4083-b05c-e94ac24d1248 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:33.044638 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba5ca36-e840-4083-b05c-e94ac24d1248 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:33.044861 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8f41ee-4087-426c-81ad-728014ea41a4 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:33.045387 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba5ca36-e840-4083-b05c-e94ac24d1248 None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:33.046355 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba5ca36-e840-4083-b05c-e94ac24d1248 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:33.046903 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba5ca36-e840-4083-b05c-e94ac24d1248 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:33.049096 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba5ca36-e840-4083-b05c-e94ac24d1248 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:33.067709 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 468/926] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:15:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:33.073542 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba5ca36-e840-4083-b05c-e94ac24d1248 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:33.076801 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:33.094310 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:33.122787 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746ab77c-2d60-4133-b892-68453af53a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:33.124415 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ab77c-2d60-4133-b892-68453af53a4e None admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:33.125200 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ab77c-2d60-4133-b892-68453af53a4e None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:33.126024 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ab77c-2d60-4133-b892-68453af53a4e None admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:33.127530 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746ab77c-2d60-4133-b892-68453af53a4e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:33.130678 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746ab77c-2d60-4133-b892-68453af53a4e None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:33.136136 dv-cinder-854265-2-smb devstack@keystone.service[81547]: WARNING keystone.server.flask.common [None req-746ab77c-2d60-4133-b892-68453af53a4e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 30 04:15:33.174830 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.sql.core [None req-746ab77c-2d60-4133-b892-68453af53a4e None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 30 04:15:33.174830 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 30 04:15:33.174830 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [parameters: {'id': 'e9a65e5aa9854ce3b87c3d6daf038bd7', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 30 04:15:33.174830 dv-cinder-854265-2-smb devstack@keystone.service[81547]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81547) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 30 04:15:33.203654 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba5ca36-e840-4083-b05c-e94ac24d1248 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:33.209555 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-746ab77c-2d60-4133-b892-68453af53a4e None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e9a65e5aa9854ce3b87c3d6daf038bd7.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e9a65e5aa9854ce3b87c3d6daf038bd7. Aug 30 04:15:33.209555 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:33.209555 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 04:15:33.209555 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 04:15:33.209555 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 04:15:33.209555 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 04:15:33.209555 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 04:15:33.209555 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 04:15:33.209555 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 04:15:33.209555 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application conn.query(q) Aug 30 04:15:33.209555 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 04:15:33.209555 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 04:15:33.209555 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 04:15:33.211588 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application result.read() Aug 30 04:15:33.211588 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 04:15:33.211588 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 04:15:33.211588 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 04:15:33.211588 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 04:15:33.211588 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 04:15:33.211588 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 04:15:33.211588 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 04:15:33.211588 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 04:15:33.211588 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 30 04:15:33.211588 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:33.211588 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 30 04:15:33.211588 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:33.211588 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:33.211588 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 30 04:15:33.211588 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 30 04:15:33.211588 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 30 04:15:33.211588 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 30 04:15:33.213892 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 04:15:33.213892 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application next(self.gen) Aug 30 04:15:33.213892 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 30 04:15:33.213892 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application yield resource Aug 30 04:15:33.213892 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 04:15:33.213892 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application next(self.gen) Aug 30 04:15:33.213892 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 30 04:15:33.213892 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application self.session.rollback() Aug 30 04:15:33.213892 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 04:15:33.213892 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application self.force_reraise() Aug 30 04:15:33.213892 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 04:15:33.213892 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise self.value Aug 30 04:15:33.213892 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 30 04:15:33.213892 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 30 04:15:33.213892 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 30 04:15:33.213892 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application session.commit() Aug 30 04:15:33.213892 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 30 04:15:33.215681 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 30 04:15:33.215681 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 30 04:15:33.215681 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application self._prepare_impl() Aug 30 04:15:33.215681 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 30 04:15:33.215681 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application self.session.flush() Aug 30 04:15:33.215681 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 30 04:15:33.215681 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application self._flush(objects) Aug 30 04:15:33.215681 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 30 04:15:33.215681 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 30 04:15:33.215681 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 30 04:15:33.215681 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application compat.raise_( Aug 30 04:15:33.215681 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 04:15:33.215681 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception Aug 30 04:15:33.215681 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 30 04:15:33.215681 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application flush_context.execute() Aug 30 04:15:33.215681 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 30 04:15:33.215681 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rec.execute(self) Aug 30 04:15:33.219711 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 30 04:15:33.219711 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 30 04:15:33.219711 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 30 04:15:33.219711 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 30 04:15:33.219711 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 30 04:15:33.219711 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 30 04:15:33.219711 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 30 04:15:33.219711 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 30 04:15:33.219711 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 30 04:15:33.219711 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 30 04:15:33.219711 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 30 04:15:33.219711 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 30 04:15:33.219711 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 30 04:15:33.219711 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 30 04:15:33.219711 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 30 04:15:33.225623 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 30 04:15:33.225623 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 04:15:33.225623 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception Aug 30 04:15:33.225623 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 04:15:33.225623 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 04:15:33.225623 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 04:15:33.225623 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 04:15:33.225623 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 04:15:33.225623 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 04:15:33.225623 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 04:15:33.225623 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application conn.query(q) Aug 30 04:15:33.225623 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 04:15:33.225623 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 04:15:33.225623 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 04:15:33.225623 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application result.read() Aug 30 04:15:33.225623 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 04:15:33.225623 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 04:15:33.229268 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 04:15:33.229268 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 04:15:33.229268 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 04:15:33.229268 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 04:15:33.229268 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 04:15:33.229268 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 04:15:33.229268 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 30 04:15:33.229268 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 30 04:15:33.229268 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [parameters: {'id': 'e9a65e5aa9854ce3b87c3d6daf038bd7', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 30 04:15:33.229268 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 30 04:15:33.229268 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:33.229268 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:15:33.229268 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:33.229268 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:33.229268 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 30 04:15:33.235161 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 30 04:15:33.235161 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 30 04:15:33.235161 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 30 04:15:33.235161 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 30 04:15:33.235161 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:33.235161 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:15:33.235161 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:33.235161 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:33.235161 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:33.235161 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:33.235161 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:33.235161 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:33.235161 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:33.235161 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:33.235161 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:33.235161 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:33.235161 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:33.238795 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:33.238795 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 30 04:15:33.238795 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 30 04:15:33.238795 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:33.238795 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:33.238795 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 30 04:15:33.238795 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 30 04:15:33.238795 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e9a65e5aa9854ce3b87c3d6daf038bd7. Aug 30 04:15:33.238795 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:33.238795 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 459/927] 10.222.0.91 () {60 vars in 1140 bytes} [Tue Aug 30 04:15:32 2022] POST /identity/v3/projects => generated 262 bytes in 351 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:15:33.242300 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746ab77c-2d60-4133-b892-68453af53a4e None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:33.253540 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d750589-812e-4342-8f72-d5a4cf914478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:33.254261 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d750589-812e-4342-8f72-d5a4cf914478 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:33.254583 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d750589-812e-4342-8f72-d5a4cf914478 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:33.254843 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d750589-812e-4342-8f72-d5a4cf914478 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:33.265188 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d750589-812e-4342-8f72-d5a4cf914478 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:33.266757 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d750589-812e-4342-8f72-d5a4cf914478 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:33.280916 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-1d750589-812e-4342-8f72-d5a4cf914478 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 04:15:33.280916 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:33.280916 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:33.280916 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:33.280916 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:33.280916 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:33.280916 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:33.280916 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:33.280916 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:33.280916 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:33.280916 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:33.280916 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:33.280916 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:15:33.280916 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:15:33.280916 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:15:33.280916 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:15:33.282900 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:33.282900 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:33.282900 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:15:33.282900 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:15:33.282900 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:15:33.282900 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:15:33.282900 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:33.282900 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:33.282900 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:33.282900 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:33.282900 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:33.282900 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:33.282900 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:33.282900 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:33.282900 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:33.282900 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:33.282900 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:33.282900 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:33.284829 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:33.284829 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:33.284829 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:15:33.284829 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:15:33.284829 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:15:33.284829 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:15:33.284829 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:15:33.284829 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:15:33.284829 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 04:15:33.284829 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:15:33.284829 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 469/928] 10.222.0.91 () {56 vars in 1117 bytes} [Tue Aug 30 04:15:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:15:33.290836 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d750589-812e-4342-8f72-d5a4cf914478 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:33.413639 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746ab77c-2d60-4133-b892-68453af53a4e None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:33.454149 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:33.472393 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58735037-1128-4340-beae-e8921d0f228a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:33.473260 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58735037-1128-4340-beae-e8921d0f228a None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:33.473599 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58735037-1128-4340-beae-e8921d0f228a None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:33.473974 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58735037-1128-4340-beae-e8921d0f228a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:33.483185 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58735037-1128-4340-beae-e8921d0f228a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:33.485426 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58735037-1128-4340-beae-e8921d0f228a None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:33.500816 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-58735037-1128-4340-beae-e8921d0f228a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:15:33.500816 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:33.500816 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:33.500816 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:33.500816 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:33.500816 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:33.500816 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:33.500816 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:33.500816 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:33.500816 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:33.500816 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:33.500816 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:33.500816 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:15:33.500816 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:15:33.500816 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:15:33.502357 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:15:33.502357 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:33.502357 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:33.502357 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:33.502357 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:33.502357 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:33.502357 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:33.502357 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:33.502357 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:33.502357 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:33.502357 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:33.502357 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:33.502357 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:33.502357 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:33.502357 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:33.502357 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:33.502357 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:33.504367 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:15:33.504367 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:15:33.504367 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:15:33.504367 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:15:33.504367 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:15:33.504367 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:15:33.504367 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:15:33.504367 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:33.506781 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 460/929] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 30 04:15:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:15:33.507785 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58735037-1128-4340-beae-e8921d0f228a None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:33.528542 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d750589-812e-4342-8f72-d5a4cf914478 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:33.553778 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:33.600480 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a320a0e-9ebe-40c2-b4db-76b7fdf0b5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:33.601723 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a320a0e-9ebe-40c2-b4db-76b7fdf0b5e4 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:33.602258 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a320a0e-9ebe-40c2-b4db-76b7fdf0b5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:33.602777 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a320a0e-9ebe-40c2-b4db-76b7fdf0b5e4 None admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:33.604363 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a320a0e-9ebe-40c2-b4db-76b7fdf0b5e4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:33.605244 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a320a0e-9ebe-40c2-b4db-76b7fdf0b5e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:33.608162 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a320a0e-9ebe-40c2-b4db-76b7fdf0b5e4 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:33.659038 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58735037-1128-4340-beae-e8921d0f228a None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:33.661821 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 470/930] 10.222.0.91 () {56 vars in 1149 bytes} [Tue Aug 30 04:15:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:33.663992 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167c895-d760-4bed-a9fd-7771626f6c5d None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:33.664487 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167c895-d760-4bed-a9fd-7771626f6c5d None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:33.664971 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167c895-d760-4bed-a9fd-7771626f6c5d None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:33.668220 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 471/931] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:15:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:15:33.670668 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1167c895-d760-4bed-a9fd-7771626f6c5d None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:33.706927 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87c4bf6-0567-4426-a98a-a0c18c83032d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:33.707553 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c4bf6-0567-4426-a98a-a0c18c83032d None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:33.707827 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c4bf6-0567-4426-a98a-a0c18c83032d None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:33.708196 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c4bf6-0567-4426-a98a-a0c18c83032d None admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:33.708893 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87c4bf6-0567-4426-a98a-a0c18c83032d None admin] RBAC: Adding query filter params (name=service) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:33.709193 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87c4bf6-0567-4426-a98a-a0c18c83032d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:33.710672 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87c4bf6-0567-4426-a98a-a0c18c83032d None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:33.744241 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 461/932] 10.222.0.91 () {56 vars in 1112 bytes} [Tue Aug 30 04:15:33 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:33.744241 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80209b73-8c00-4afe-90e9-ffd6423d2825 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:33.744241 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80209b73-8c00-4afe-90e9-ffd6423d2825 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:33.744241 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80209b73-8c00-4afe-90e9-ffd6423d2825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:33.780588 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-80209b73-8c00-4afe-90e9-ffd6423d2825 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:33.783941 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-80209b73-8c00-4afe-90e9-ffd6423d2825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:33.835019 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1167c895-d760-4bed-a9fd-7771626f6c5d None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:33.885479 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:33.894265 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0290ddd-779e-4078-995b-ed638d694365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:33.895272 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0290ddd-779e-4078-995b-ed638d694365 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:33.895612 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0290ddd-779e-4078-995b-ed638d694365 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:33.895994 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0290ddd-779e-4078-995b-ed638d694365 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:33.911824 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0290ddd-779e-4078-995b-ed638d694365 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:33.915102 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0290ddd-779e-4078-995b-ed638d694365 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:33.929058 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 462/933] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:15:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:15:33.945650 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-a0290ddd-779e-4078-995b-ed638d694365 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:15:33.945650 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:33.945650 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:33.945650 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:33.945650 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:33.945650 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:33.945650 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:33.945650 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:33.945650 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:33.945650 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:33.945650 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:33.945650 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:33.945650 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:15:33.945650 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:15:33.945650 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:15:33.945650 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:15:33.946691 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:33.946691 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:33.946691 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:33.946691 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:33.946691 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:33.946691 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:33.946691 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:33.946691 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:33.946691 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:33.946691 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:33.946691 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:33.946691 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:33.946691 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:33.946691 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:33.946691 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:33.946691 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:33.946691 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:15:33.947733 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:15:33.947733 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:15:33.947733 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:15:33.949631 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 472/934] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:15:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:15:33.959962 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80209b73-8c00-4afe-90e9-ffd6423d2825 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:33.989702 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:34.113122 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80209b73-8c00-4afe-90e9-ffd6423d2825 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:34.156505 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b86b0d-7b98-426f-b8f2-064d85bf6bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:34.157413 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b86b0d-7b98-426f-b8f2-064d85bf6bb3 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:34.157878 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b86b0d-7b98-426f-b8f2-064d85bf6bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:34.158343 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b86b0d-7b98-426f-b8f2-064d85bf6bb3 None admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:34.159324 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b86b0d-7b98-426f-b8f2-064d85bf6bb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:34.159795 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b86b0d-7b98-426f-b8f2-064d85bf6bb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:34.161428 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b86b0d-7b98-426f-b8f2-064d85bf6bb3 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:34.176477 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 463/935] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:15:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:34.185561 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0290ddd-779e-4078-995b-ed638d694365 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:34.305089 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b86b0d-7b98-426f-b8f2-064d85bf6bb3 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:34.390269 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0290ddd-779e-4078-995b-ed638d694365 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:34.405836 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:34.432210 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b86b0d-7b98-426f-b8f2-064d85bf6bb3 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:34.458902 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164daf42-6677-4e14-916f-3d7905cdf686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:34.459943 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164daf42-6677-4e14-916f-3d7905cdf686 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:34.460550 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164daf42-6677-4e14-916f-3d7905cdf686 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:34.460930 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164daf42-6677-4e14-916f-3d7905cdf686 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:34.474448 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05448583-3d24-4774-bdb8-de67e36bc298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:34.474990 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164daf42-6677-4e14-916f-3d7905cdf686 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:34.475750 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05448583-3d24-4774-bdb8-de67e36bc298 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:34.476341 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05448583-3d24-4774-bdb8-de67e36bc298 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:34.476813 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05448583-3d24-4774-bdb8-de67e36bc298 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:34.477689 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05448583-3d24-4774-bdb8-de67e36bc298 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:34.477820 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164daf42-6677-4e14-916f-3d7905cdf686 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:34.480084 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05448583-3d24-4774-bdb8-de67e36bc298 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:34.491502 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-05448583-3d24-4774-bdb8-de67e36bc298 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 04:15:34.491502 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:34.491502 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:15:34.491502 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:15:34.491502 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:15:34.491502 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:15:34.491502 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:15:34.491502 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:15:34.491502 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 04:15:34.491502 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:34.491502 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:15:34.491502 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:34.491502 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:34.491502 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:34.491502 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:34.491502 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:34.491502 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:34.492683 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:34.492683 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:34.492683 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:34.492683 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:34.492683 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:34.492683 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:34.492683 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:15:34.492683 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:15:34.492683 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:15:34.492683 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:15:34.492683 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:34.492683 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:34.492683 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:34.492683 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:34.492683 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:34.492683 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:34.493541 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:34.493541 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:34.493541 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:34.493541 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:34.493541 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:34.493541 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:34.493541 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:34.493541 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:34.493541 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:34.493541 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:34.493541 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:15:34.493541 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:15:34.493541 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 04:15:34.493541 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:34.501650 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-164daf42-6677-4e14-916f-3d7905cdf686 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:15:34.501650 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:34.501650 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:34.501650 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:34.501650 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:34.501650 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:34.501650 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:34.501650 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:34.501650 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:34.501650 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:34.501650 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:34.501650 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:34.501650 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:15:34.501650 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:15:34.501650 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:15:34.502656 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:15:34.502656 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:34.502656 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:34.502656 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:34.502656 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:34.502656 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:34.502656 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:34.502656 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:34.502656 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:34.502656 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:34.502656 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:34.502656 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:34.502656 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:34.502656 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:34.502656 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:34.502656 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:34.502656 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:34.503569 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:15:34.503569 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:15:34.503569 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:15:34.503569 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:15:34.503569 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:15:34.503569 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:15:34.503569 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:15:34.503569 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:15:34.504860 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 464/937] 10.222.0.91 () {56 vars in 1126 bytes} [Tue Aug 30 04:15:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:15:34.506113 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05448583-3d24-4774-bdb8-de67e36bc298 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:34.508280 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 473/937] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 30 04:15:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:15:34.513549 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164daf42-6677-4e14-916f-3d7905cdf686 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:34.595423 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:34.664542 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05448583-3d24-4774-bdb8-de67e36bc298 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:34.703276 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164daf42-6677-4e14-916f-3d7905cdf686 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:34.727286 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4956fe73-33f6-4a3f-8eb1-6303d977cf23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:34.728241 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956fe73-33f6-4a3f-8eb1-6303d977cf23 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:34.728695 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956fe73-33f6-4a3f-8eb1-6303d977cf23 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:34.729143 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956fe73-33f6-4a3f-8eb1-6303d977cf23 None admin] PATH_INFO: `/v3/services` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:34.730138 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4956fe73-33f6-4a3f-8eb1-6303d977cf23 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:34.730621 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4956fe73-33f6-4a3f-8eb1-6303d977cf23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:34.732971 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4956fe73-33f6-4a3f-8eb1-6303d977cf23 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:34.746390 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 465/938] 10.222.0.91 () {56 vars in 1122 bytes} [Tue Aug 30 04:15:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:34.746390 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d3c5b-5c49-439c-9799-aebb41c5c179 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:34.746390 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d3c5b-5c49-439c-9799-aebb41c5c179 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:34.746390 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d3c5b-5c49-439c-9799-aebb41c5c179 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:34.746390 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 466/939] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:15:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:15:34.748408 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d3c5b-5c49-439c-9799-aebb41c5c179 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:34.761331 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:34.769858 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a88bf2-9621-4818-9caa-d25cc0ce709c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:34.771125 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a88bf2-9621-4818-9caa-d25cc0ce709c None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:34.771362 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a88bf2-9621-4818-9caa-d25cc0ce709c None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:34.771761 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a88bf2-9621-4818-9caa-d25cc0ce709c None admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:34.772836 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a88bf2-9621-4818-9caa-d25cc0ce709c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:34.773337 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a88bf2-9621-4818-9caa-d25cc0ce709c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:34.775086 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a88bf2-9621-4818-9caa-d25cc0ce709c None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:34.797585 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 474/940] 10.222.0.91 () {56 vars in 1148 bytes} [Tue Aug 30 04:15:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:34.800448 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd88d6-a278-4f7a-afdc-b6ffd845c2ec None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:34.800921 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd88d6-a278-4f7a-afdc-b6ffd845c2ec None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:34.801385 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd88d6-a278-4f7a-afdc-b6ffd845c2ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:34.825500 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-b8fd88d6-a278-4f7a-afdc-b6ffd845c2ec None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:34.826744 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-b8fd88d6-a278-4f7a-afdc-b6ffd845c2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:34.890217 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d3c5b-5c49-439c-9799-aebb41c5c179 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:34.915152 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 475/941] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:15:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:15:34.915720 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd88d6-a278-4f7a-afdc-b6ffd845c2ec None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:34.955625 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:34.967574 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb4287-1d5e-4cc0-b111-b0ab7908f711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:34.969534 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb4287-1d5e-4cc0-b111-b0ab7908f711 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:34.969821 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb4287-1d5e-4cc0-b111-b0ab7908f711 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:34.970102 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb4287-1d5e-4cc0-b111-b0ab7908f711 None admin] PATH_INFO: `/v3/services` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:34.970774 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb4287-1d5e-4cc0-b111-b0ab7908f711 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:34.971081 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb4287-1d5e-4cc0-b111-b0ab7908f711 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:34.972778 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb4287-1d5e-4cc0-b111-b0ab7908f711 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:34.980189 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 467/942] 10.222.0.91 () {56 vars in 1122 bytes} [Tue Aug 30 04:15:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:34.989253 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb4287-1d5e-4cc0-b111-b0ab7908f711 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:35.059349 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd88d6-a278-4f7a-afdc-b6ffd845c2ec None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:35.099209 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:35.111021 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be3046-6f3c-4630-b185-7b7e72d53b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:35.112581 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be3046-6f3c-4630-b185-7b7e72d53b6a None admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:35.112725 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be3046-6f3c-4630-b185-7b7e72d53b6a None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:35.113131 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be3046-6f3c-4630-b185-7b7e72d53b6a None admin] PATH_INFO: `/v3/projects/4e05769361674c8fa995050150ad4cfa/users/1bc12faf48984335a3515dcde85b5cb1/roles/d110827932ac4a4db66e89e29c8b6115` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:35.117365 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be3046-6f3c-4630-b185-7b7e72d53b6a None admin] RBAC: Authorizing `identity:create_grant(project_id=4e05769361674c8fa995050150ad4cfa, user_id=1bc12faf48984335a3515dcde85b5cb1, role_id=d110827932ac4a4db66e89e29c8b6115)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:35.120169 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be3046-6f3c-4630-b185-7b7e72d53b6a None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:35.148542 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 476/943] 10.222.0.91 () {58 vars in 1439 bytes} [Tue Aug 30 04:15:34 2022] PUT /identity/v3/projects/4e05769361674c8fa995050150ad4cfa/users/1bc12faf48984335a3515dcde85b5cb1/roles/d110827932ac4a4db66e89e29c8b6115 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:15:35.158969 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb4287-1d5e-4cc0-b111-b0ab7908f711 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:35.200060 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be3046-6f3c-4630-b185-7b7e72d53b6a None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:35.218507 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d06bfa-1a7a-4fe9-8d13-19d646e4c217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:35.220291 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d06bfa-1a7a-4fe9-8d13-19d646e4c217 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:35.221143 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d06bfa-1a7a-4fe9-8d13-19d646e4c217 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:35.221925 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d06bfa-1a7a-4fe9-8d13-19d646e4c217 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:35.223825 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d06bfa-1a7a-4fe9-8d13-19d646e4c217 None admin] RBAC: Adding query filter params (interface=public, service_id=7101815f58234e3d8ff00444a2072e9b, region_id=RegionOne) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:35.224911 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d06bfa-1a7a-4fe9-8d13-19d646e4c217 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:35.227525 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d06bfa-1a7a-4fe9-8d13-19d646e4c217 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:35.239965 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 468/944] 10.222.0.91 () {56 vars in 1251 bytes} [Tue Aug 30 04:15:34 2022] GET /identity/v3/endpoints?service_id=7101815f58234e3d8ff00444a2072e9b&interface=public®ion_id=RegionOne => generated 194 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:15:35.246136 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d06bfa-1a7a-4fe9-8d13-19d646e4c217 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:35.392318 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:35.400003 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d06bfa-1a7a-4fe9-8d13-19d646e4c217 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:35.413462 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be3046-6f3c-4630-b185-7b7e72d53b6a None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:35.482265 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3408688b-93df-4b50-8a5f-e17320174670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:35.482839 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa896fbb-573c-4b3b-b2b3-001895b6d5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:35.483664 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3408688b-93df-4b50-8a5f-e17320174670 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:35.483845 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa896fbb-573c-4b3b-b2b3-001895b6d5f1 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:35.484246 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa896fbb-573c-4b3b-b2b3-001895b6d5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:35.484347 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3408688b-93df-4b50-8a5f-e17320174670 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:35.484629 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa896fbb-573c-4b3b-b2b3-001895b6d5f1 None admin] PATH_INFO: `/v3/services` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:35.484728 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3408688b-93df-4b50-8a5f-e17320174670 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:35.485558 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa896fbb-573c-4b3b-b2b3-001895b6d5f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:35.485807 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3408688b-93df-4b50-8a5f-e17320174670 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:35.487805 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa896fbb-573c-4b3b-b2b3-001895b6d5f1 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:35.488208 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3408688b-93df-4b50-8a5f-e17320174670 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:35.491156 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:35.504952 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-3408688b-93df-4b50-8a5f-e17320174670 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 04:15:35.504952 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:35.504952 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:15:35.504952 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:15:35.504952 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:15:35.504952 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:15:35.504952 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:15:35.504952 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:15:35.504952 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 04:15:35.504952 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:15:35.504952 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:15:35.504952 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:15:35.504952 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:35.504952 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:35.504952 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:35.504952 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:35.505998 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:35.505998 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:35.505998 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:35.505998 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:35.505998 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:35.505998 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:35.505998 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:35.505998 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:15:35.505998 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:15:35.505998 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:15:35.505998 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:15:35.505998 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:35.505998 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:35.505998 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:35.505998 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:35.505998 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:35.505998 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:35.506950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:35.506950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:35.506950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:35.506950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:35.506950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:35.506950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:35.506950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:35.506950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:35.506950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:35.506950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:35.506950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:15:35.506950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:15:35.506950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 04:15:35.506950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:15:35.507744 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 469/945] 10.222.0.91 () {56 vars in 1087 bytes} [Tue Aug 30 04:15:35 2022] GET /identity/v3/services => generated 1497 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:15:35.507827 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 477/946] 10.222.0.91 () {56 vars in 1132 bytes} [Tue Aug 30 04:15:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:15:35.518008 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa896fbb-573c-4b3b-b2b3-001895b6d5f1 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:35.678236 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa896fbb-573c-4b3b-b2b3-001895b6d5f1 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:35.722930 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce6257c-615d-4419-96bc-ee7765684343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:35.724022 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce6257c-615d-4419-96bc-ee7765684343 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:35.724568 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce6257c-615d-4419-96bc-ee7765684343 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:35.725061 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce6257c-615d-4419-96bc-ee7765684343 None admin] PATH_INFO: `/v3/services` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:35.725962 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce6257c-615d-4419-96bc-ee7765684343 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:35.726486 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce6257c-615d-4419-96bc-ee7765684343 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:35.728180 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce6257c-615d-4419-96bc-ee7765684343 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:35.735441 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 470/947] 10.222.0.91 () {56 vars in 1126 bytes} [Tue Aug 30 04:15:35 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:35.745770 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3408688b-93df-4b50-8a5f-e17320174670 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:35.963175 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3408688b-93df-4b50-8a5f-e17320174670 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:36.034438 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c275dad-8a96-4586-8898-7a0f929f12d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:36.035378 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c275dad-8a96-4586-8898-7a0f929f12d6 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:36.035859 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c275dad-8a96-4586-8898-7a0f929f12d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:36.036388 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c275dad-8a96-4586-8898-7a0f929f12d6 None admin] PATH_INFO: `/v3/services` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:36.037597 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c275dad-8a96-4586-8898-7a0f929f12d6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:36.038134 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c275dad-8a96-4586-8898-7a0f929f12d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:36.040851 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c275dad-8a96-4586-8898-7a0f929f12d6 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:36.056150 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 478/948] 10.222.0.91 () {56 vars in 1126 bytes} [Tue Aug 30 04:15:35 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:36.061668 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce6257c-615d-4419-96bc-ee7765684343 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:36.088767 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d56490-099a-4f91-8b15-3905968ec869 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:36.089315 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d56490-099a-4f91-8b15-3905968ec869 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:36.089832 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d56490-099a-4f91-8b15-3905968ec869 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:36.093127 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 479/949] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:15:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:15:36.099531 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48c3b2-c79e-406a-96df-c11637f14ffe None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:36.100034 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48c3b2-c79e-406a-96df-c11637f14ffe None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:36.100678 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48c3b2-c79e-406a-96df-c11637f14ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:36.136176 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-ce48c3b2-c79e-406a-96df-c11637f14ffe None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:36.138661 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-ce48c3b2-c79e-406a-96df-c11637f14ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:36.159176 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:36.176043 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:36.217144 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce6257c-615d-4419-96bc-ee7765684343 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:36.281553 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 480/950] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:15:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:15:36.290669 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396369c8-79e4-4dea-9eca-ea9ebe45d080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:36.293548 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396369c8-79e4-4dea-9eca-ea9ebe45d080 None admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:36.294159 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396369c8-79e4-4dea-9eca-ea9ebe45d080 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:36.294821 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396369c8-79e4-4dea-9eca-ea9ebe45d080 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:36.296275 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396369c8-79e4-4dea-9eca-ea9ebe45d080 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:36.299132 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396369c8-79e4-4dea-9eca-ea9ebe45d080 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:36.340236 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 471/951] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:15:36 2022] POST /identity/v3/endpoints => generated 347 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:15:36.595213 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce48c3b2-c79e-406a-96df-c11637f14ffe None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:36.794852 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce48c3b2-c79e-406a-96df-c11637f14ffe None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:36.874325 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a363780-23a6-44f1-8f7f-8d25f6667126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:36.875398 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a363780-23a6-44f1-8f7f-8d25f6667126 None admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:36.875889 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a363780-23a6-44f1-8f7f-8d25f6667126 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:36.876427 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a363780-23a6-44f1-8f7f-8d25f6667126 None admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:36.877672 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a363780-23a6-44f1-8f7f-8d25f6667126 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:36.880544 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a363780-23a6-44f1-8f7f-8d25f6667126 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:36.885282 dv-cinder-854265-2-smb devstack@keystone.service[81546]: WARNING keystone.server.flask.common [None req-0a363780-23a6-44f1-8f7f-8d25f6667126 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 30 04:15:36.908421 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.sql.core [None req-0a363780-23a6-44f1-8f7f-8d25f6667126 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 30 04:15:36.908421 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 30 04:15:36.908421 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [parameters: {'user_id': 'c272687e710c45eb8b925ac2304375a0', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 30 04:15:36.908421 dv-cinder-854265-2-smb devstack@keystone.service[81546]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81546) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 30 04:15:36.920487 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-0a363780-23a6-44f1-8f7f-8d25f6667126 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 30 04:15:36.920487 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:36.920487 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 04:15:36.920487 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 04:15:36.920487 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 04:15:36.920487 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 04:15:36.920487 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 04:15:36.920487 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 04:15:36.920487 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 04:15:36.920487 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application conn.query(q) Aug 30 04:15:36.920487 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 04:15:36.920487 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 04:15:36.920487 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 04:15:36.920487 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application result.read() Aug 30 04:15:36.920487 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 04:15:36.921493 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 04:15:36.921493 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 04:15:36.921493 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 04:15:36.921493 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 04:15:36.921493 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 04:15:36.921493 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 04:15:36.921493 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 04:15:36.921493 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 30 04:15:36.921493 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:15:36.921493 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 30 04:15:36.921493 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:15:36.921493 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:36.921493 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 30 04:15:36.921493 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 30 04:15:36.921493 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 30 04:15:36.921493 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 30 04:15:36.921493 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 04:15:36.921493 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application next(self.gen) Aug 30 04:15:36.922515 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 30 04:15:36.922515 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application yield resource Aug 30 04:15:36.922515 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 04:15:36.922515 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application next(self.gen) Aug 30 04:15:36.922515 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 30 04:15:36.922515 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self.session.rollback() Aug 30 04:15:36.922515 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 04:15:36.922515 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self.force_reraise() Aug 30 04:15:36.922515 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 04:15:36.922515 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise self.value Aug 30 04:15:36.922515 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 30 04:15:36.922515 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 30 04:15:36.922515 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 30 04:15:36.922515 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application session.commit() Aug 30 04:15:36.922515 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 30 04:15:36.922515 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 30 04:15:36.922515 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 30 04:15:36.923520 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._prepare_impl() Aug 30 04:15:36.923520 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 30 04:15:36.923520 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self.session.flush() Aug 30 04:15:36.923520 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 30 04:15:36.923520 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._flush(objects) Aug 30 04:15:36.923520 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 30 04:15:36.923520 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 30 04:15:36.923520 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 30 04:15:36.923520 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application compat.raise_( Aug 30 04:15:36.923520 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 04:15:36.923520 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception Aug 30 04:15:36.923520 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 30 04:15:36.923520 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application flush_context.execute() Aug 30 04:15:36.923520 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 30 04:15:36.923520 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rec.execute(self) Aug 30 04:15:36.923520 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 30 04:15:36.923520 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 30 04:15:36.925813 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 30 04:15:36.925813 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 30 04:15:36.925813 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 30 04:15:36.925813 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 30 04:15:36.925813 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 30 04:15:36.925813 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 30 04:15:36.925813 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 30 04:15:36.925813 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 30 04:15:36.925813 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 30 04:15:36.925813 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 30 04:15:36.925813 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 30 04:15:36.925813 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 30 04:15:36.925813 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 30 04:15:36.925813 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 30 04:15:36.925813 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 04:15:36.925813 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception Aug 30 04:15:36.927889 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 04:15:36.927889 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 04:15:36.927889 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 04:15:36.927889 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 04:15:36.927889 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 04:15:36.927889 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 04:15:36.927889 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 04:15:36.927889 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application conn.query(q) Aug 30 04:15:36.927889 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 04:15:36.927889 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 04:15:36.927889 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 04:15:36.927889 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application result.read() Aug 30 04:15:36.927889 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 04:15:36.927889 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 04:15:36.927889 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 04:15:36.927889 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 04:15:36.930038 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 04:15:36.930038 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 04:15:36.930038 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 04:15:36.930038 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 04:15:36.930038 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 30 04:15:36.930038 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 30 04:15:36.930038 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [parameters: {'user_id': 'c272687e710c45eb8b925ac2304375a0', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 30 04:15:36.930038 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 30 04:15:36.930038 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:15:36.930038 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:15:36.930038 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:15:36.930038 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:36.930038 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:36.930038 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:36.930038 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:36.940269 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:36.940269 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:36.940269 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:36.940269 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:36.940269 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:36.940269 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:36.940269 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:36.940269 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 30 04:15:36.940269 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 30 04:15:36.940269 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:36.940269 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:36.940269 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:15:36.940269 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:15:36.940269 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:15:36.940269 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:15:36.940269 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 30 04:15:36.940269 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 30 04:15:36.942771 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 30 04:15:36.942771 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 30 04:15:36.942771 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 30 04:15:36.942771 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 30 04:15:36.942771 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 30 04:15:36.942771 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:15:36.942771 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 481/952] 10.222.0.91 () {60 vars in 1131 bytes} [Tue Aug 30 04:15:36 2022] POST /identity/v3/users => generated 160 bytes in 329 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:15:36.944066 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396369c8-79e4-4dea-9eca-ea9ebe45d080 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:37.077458 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396369c8-79e4-4dea-9eca-ea9ebe45d080 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:37.098784 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:37.121158 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e5f8e9-f749-4d43-b4c7-35bfb371c602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:37.121819 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5f8e9-f749-4d43-b4c7-35bfb371c602 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:37.122167 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5f8e9-f749-4d43-b4c7-35bfb371c602 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:37.122446 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5f8e9-f749-4d43-b4c7-35bfb371c602 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:37.131549 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e5f8e9-f749-4d43-b4c7-35bfb371c602 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:37.133099 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e5f8e9-f749-4d43-b4c7-35bfb371c602 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:37.147469 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-a0e5f8e9-f749-4d43-b4c7-35bfb371c602 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 04:15:37.147469 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:37.147469 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:37.147469 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:37.147469 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:37.147469 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:37.147469 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:37.147469 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:37.147469 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:37.147469 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:37.147469 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:37.147469 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:37.147469 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:15:37.147469 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:15:37.147469 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:15:37.147469 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:15:37.149158 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:37.149158 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:37.149158 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:15:37.149158 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:15:37.149158 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:15:37.149158 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:15:37.149158 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:37.149158 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:37.149158 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:37.149158 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:37.149158 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:37.149158 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:37.149158 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:37.149158 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:37.149158 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:37.149158 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:37.149158 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:37.149158 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:37.151157 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:37.151157 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:37.151157 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:15:37.151157 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:15:37.151157 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:15:37.151157 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:15:37.151157 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:15:37.151157 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:15:37.151157 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 04:15:37.151157 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:37.151157 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 472/953] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 30 04:15:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:15:37.157459 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a363780-23a6-44f1-8f7f-8d25f6667126 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:37.171852 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:37.342758 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a363780-23a6-44f1-8f7f-8d25f6667126 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:37.414427 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57461e0-58b7-4f1f-b2b4-351420b876a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:37.416173 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57461e0-58b7-4f1f-b2b4-351420b876a5 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:37.416987 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57461e0-58b7-4f1f-b2b4-351420b876a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:37.417747 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57461e0-58b7-4f1f-b2b4-351420b876a5 None admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:37.419802 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57461e0-58b7-4f1f-b2b4-351420b876a5 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:37.420703 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57461e0-58b7-4f1f-b2b4-351420b876a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:37.424336 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57461e0-58b7-4f1f-b2b4-351420b876a5 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:37.506892 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 482/954] 10.222.0.91 () {56 vars in 1101 bytes} [Tue Aug 30 04:15:37 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:37.814435 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611182cc-fa6f-4952-b87e-70f23d842593 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:37.814629 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611182cc-fa6f-4952-b87e-70f23d842593 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:37.814934 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611182cc-fa6f-4952-b87e-70f23d842593 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:37.816494 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 473/955] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:15:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:15:37.822447 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0a14e-23cc-4bdf-925f-93c795032dab None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:37.822715 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0a14e-23cc-4bdf-925f-93c795032dab None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:37.822845 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0a14e-23cc-4bdf-925f-93c795032dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:37.842869 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-6ff0a14e-23cc-4bdf-925f-93c795032dab None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:37.844600 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-6ff0a14e-23cc-4bdf-925f-93c795032dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:37.920086 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:37.930119 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 483/956] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:15:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:15:38.205471 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611182cc-fa6f-4952-b87e-70f23d842593 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:38.307609 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc04b1-c743-4780-8b11-d0da77055572 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:38.308380 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc04b1-c743-4780-8b11-d0da77055572 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:38.308851 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc04b1-c743-4780-8b11-d0da77055572 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:38.311185 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 484/957] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:15:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:15:38.319570 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8619867-d5f6-48b5-9f91-603006a87abe None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:38.320057 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8619867-d5f6-48b5-9f91-603006a87abe None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:38.320525 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8619867-d5f6-48b5-9f91-603006a87abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:38.350730 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-f8619867-d5f6-48b5-9f91-603006a87abe None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:38.352372 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-f8619867-d5f6-48b5-9f91-603006a87abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:38.368291 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611182cc-fa6f-4952-b87e-70f23d842593 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:38.412489 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950b738d-07dc-435f-a626-b261018e1704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:38.413167 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b738d-07dc-435f-a626-b261018e1704 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:38.413445 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b738d-07dc-435f-a626-b261018e1704 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:38.413707 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b738d-07dc-435f-a626-b261018e1704 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:38.414308 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950b738d-07dc-435f-a626-b261018e1704 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:38.415741 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950b738d-07dc-435f-a626-b261018e1704 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:38.427593 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-950b738d-07dc-435f-a626-b261018e1704 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 04:15:38.427593 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:38.427593 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:15:38.427593 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:15:38.427593 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:15:38.427593 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:15:38.427593 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:15:38.427593 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:15:38.427593 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 04:15:38.427593 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:38.427593 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:15:38.427593 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:38.427593 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:38.427593 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:38.427593 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:38.427593 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:38.427593 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:38.432744 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:38.432744 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:38.432744 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:38.432744 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:38.432744 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:38.432744 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:38.432744 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:15:38.432744 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:15:38.432744 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:15:38.432744 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:15:38.432744 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:38.432744 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:38.432744 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:38.432744 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:38.432744 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:38.432744 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:38.433753 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:38.433753 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:38.433753 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:38.433753 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:38.433753 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:38.433753 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:38.433753 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:38.433753 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:38.433753 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:38.433753 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:38.433753 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:15:38.433753 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:15:38.433753 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 04:15:38.433753 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:38.433753 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 474/958] 10.222.0.91 () {56 vars in 1126 bytes} [Tue Aug 30 04:15:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:15:38.438297 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950b738d-07dc-435f-a626-b261018e1704 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:38.490978 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 485/959] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:15:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 04:15:38.520694 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:38.640441 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950b738d-07dc-435f-a626-b261018e1704 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:38.711798 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be632af7-dcad-423c-a466-474795105fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:38.712891 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be632af7-dcad-423c-a466-474795105fc8 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:38.713288 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be632af7-dcad-423c-a466-474795105fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:38.713842 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be632af7-dcad-423c-a466-474795105fc8 None admin] PATH_INFO: `/v3/services` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:38.714809 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be632af7-dcad-423c-a466-474795105fc8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:38.715279 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be632af7-dcad-423c-a466-474795105fc8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:38.717844 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be632af7-dcad-423c-a466-474795105fc8 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:38.727498 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 475/960] 10.222.0.91 () {56 vars in 1122 bytes} [Tue Aug 30 04:15:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:38.736782 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8619867-d5f6-48b5-9f91-603006a87abe None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:38.771496 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be632af7-dcad-423c-a466-474795105fc8 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:38.915634 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8619867-d5f6-48b5-9f91-603006a87abe None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:38.937479 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be632af7-dcad-423c-a466-474795105fc8 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:38.950412 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:38.962320 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:38.972506 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c88e9-1188-4580-a97c-4190c5bf4bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:38.973128 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c88e9-1188-4580-a97c-4190c5bf4bb5 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:38.973388 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c88e9-1188-4580-a97c-4190c5bf4bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:38.973656 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c88e9-1188-4580-a97c-4190c5bf4bb5 None admin] PATH_INFO: `/v3/services` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:38.974318 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451c88e9-1188-4580-a97c-4190c5bf4bb5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:38.974611 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451c88e9-1188-4580-a97c-4190c5bf4bb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:38.976062 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451c88e9-1188-4580-a97c-4190c5bf4bb5 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:38.984312 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 486/961] 10.222.0.91 () {56 vars in 1122 bytes} [Tue Aug 30 04:15:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:38.986286 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5061db1-e913-401b-ac04-28a860fcc07d None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:38.986812 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5061db1-e913-401b-ac04-28a860fcc07d None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:38.987267 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5061db1-e913-401b-ac04-28a860fcc07d None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:38.989906 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 487/962] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:15:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:15:38.992521 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5061db1-e913-401b-ac04-28a860fcc07d None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:39.001428 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d7b972-179f-41e8-b611-6a8607ba5d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:39.002200 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7b972-179f-41e8-b611-6a8607ba5d12 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:39.002530 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7b972-179f-41e8-b611-6a8607ba5d12 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:39.002959 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7b972-179f-41e8-b611-6a8607ba5d12 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:39.021683 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d7b972-179f-41e8-b611-6a8607ba5d12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:15:39.029067 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-30d7b972-179f-41e8-b611-6a8607ba5d12 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 04:15:39.029067 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:39.029067 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:39.029067 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:39.029067 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:39.029067 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:39.029067 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:39.029067 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:39.029067 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:39.029067 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:39.029067 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:39.029067 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:39.029067 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:15:39.029067 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:15:39.029067 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:15:39.029067 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:15:39.030737 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:15:39.030737 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:15:39.030737 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:15:39.030737 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:15:39.030737 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:39.030737 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:39.030737 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:39.030737 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:39.030737 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:39.030737 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:39.030737 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:39.030737 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:39.030737 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:39.030737 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:39.030737 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:39.030737 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:39.032248 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:39.032248 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:39.032248 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:39.032248 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:39.032248 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:15:39.032248 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:15:39.032248 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:15:39.032248 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:15:39.032248 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:15:39.032248 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:15:39.032248 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 04:15:39.032248 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:39.032248 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 476/963] 10.222.0.91 () {56 vars in 1120 bytes} [Tue Aug 30 04:15:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:15:39.032248 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba429fd4-c529-4cf2-9938-d87e455baa2d None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:39.033666 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba429fd4-c529-4cf2-9938-d87e455baa2d None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:39.033666 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba429fd4-c529-4cf2-9938-d87e455baa2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:39.064758 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-ba429fd4-c529-4cf2-9938-d87e455baa2d None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:39.066511 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-ba429fd4-c529-4cf2-9938-d87e455baa2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:39.150034 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5061db1-e913-401b-ac04-28a860fcc07d None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:39.157774 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 477/964] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:15:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:15:39.158687 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba429fd4-c529-4cf2-9938-d87e455baa2d None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:39.213047 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c11615-f3cc-445e-96b2-b06a39e1f653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:39.214033 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c11615-f3cc-445e-96b2-b06a39e1f653 None admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:39.214444 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c11615-f3cc-445e-96b2-b06a39e1f653 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:39.214865 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c11615-f3cc-445e-96b2-b06a39e1f653 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:39.215849 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c11615-f3cc-445e-96b2-b06a39e1f653 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:39.218277 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c11615-f3cc-445e-96b2-b06a39e1f653 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:39.263958 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 488/965] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:15:38 2022] POST /identity/v3/endpoints => generated 349 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:15:39.322275 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:39.331984 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba429fd4-c529-4cf2-9938-d87e455baa2d None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:39.388260 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c3fe15-05f5-4303-947d-f16f72d7174f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:39.389044 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3fe15-05f5-4303-947d-f16f72d7174f None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:39.389209 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3fe15-05f5-4303-947d-f16f72d7174f None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:39.389443 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3fe15-05f5-4303-947d-f16f72d7174f None admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:39.390175 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c3fe15-05f5-4303-947d-f16f72d7174f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:39.390473 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c3fe15-05f5-4303-947d-f16f72d7174f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:39.392017 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c3fe15-05f5-4303-947d-f16f72d7174f None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:39.404316 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 478/966] 10.222.0.91 () {56 vars in 1115 bytes} [Tue Aug 30 04:15:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:39.411331 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c11615-f3cc-445e-96b2-b06a39e1f653 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:39.441878 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c3fe15-05f5-4303-947d-f16f72d7174f None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:39.502199 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:39.608144 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c3fe15-05f5-4303-947d-f16f72d7174f None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:39.615978 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c11615-f3cc-445e-96b2-b06a39e1f653 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:39.667722 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6acce34-d0df-470d-8357-a51029cccc3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:39.669228 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6acce34-d0df-470d-8357-a51029cccc3e None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:39.669752 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6acce34-d0df-470d-8357-a51029cccc3e None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:39.670211 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6acce34-d0df-470d-8357-a51029cccc3e None admin] PATH_INFO: `/v3/services/compute` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:39.671404 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6acce34-d0df-470d-8357-a51029cccc3e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:39.673863 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6acce34-d0df-470d-8357-a51029cccc3e None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:39.681480 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4001fe46-c783-4817-bf8a-efe2a4c43669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:39.682613 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4001fe46-c783-4817-bf8a-efe2a4c43669 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:39.683105 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4001fe46-c783-4817-bf8a-efe2a4c43669 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:39.683621 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4001fe46-c783-4817-bf8a-efe2a4c43669 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:39.691294 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-a6acce34-d0df-470d-8357-a51029cccc3e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 04:15:39.691294 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:39.691294 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:15:39.691294 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:15:39.691294 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:15:39.691294 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:15:39.691294 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:15:39.691294 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:15:39.691294 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 04:15:39.691294 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:39.691294 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:15:39.691294 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:39.691294 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:39.691294 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:39.691294 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:39.691294 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:39.691294 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:39.692429 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:39.692429 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:39.692429 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:39.692429 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:39.692429 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:39.692429 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:39.692429 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:15:39.692429 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:15:39.692429 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:15:39.692429 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:15:39.692429 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:39.692429 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:39.692429 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:39.692429 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:39.692429 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:39.692429 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:39.693284 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:39.693284 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:39.693284 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:39.693284 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:39.693284 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:39.693284 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:39.693284 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:39.693284 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:39.693284 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:39.693284 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:39.693284 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:15:39.693284 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:15:39.693284 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 04:15:39.693284 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:39.697986 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 479/967] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 30 04:15:39 2022] GET /identity/v3/services/compute => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:15:39.700959 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6acce34-d0df-470d-8357-a51029cccc3e None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:39.706406 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4001fe46-c783-4817-bf8a-efe2a4c43669 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:39.709255 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4001fe46-c783-4817-bf8a-efe2a4c43669 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:39.725380 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:39.738871 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-4001fe46-c783-4817-bf8a-efe2a4c43669 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:15:39.738871 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:39.738871 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:39.738871 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:39.738871 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:39.738871 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:39.738871 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:39.738871 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:39.738871 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:39.738871 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:39.738871 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:39.738871 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:39.738871 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:15:39.738871 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:15:39.738871 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:15:39.738871 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:15:39.748358 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:39.748358 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:39.748358 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:39.748358 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:39.748358 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:39.748358 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:39.748358 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:39.748358 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:39.748358 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:39.748358 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:39.748358 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:39.748358 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:39.748358 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:39.748358 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:39.748358 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:39.748358 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:39.748358 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:15:39.750524 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:15:39.750524 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:15:39.750524 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:15:39.750524 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 489/968] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:15:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:15:39.755302 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4001fe46-c783-4817-bf8a-efe2a4c43669 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:39.889539 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6acce34-d0df-470d-8357-a51029cccc3e None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:39.913421 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:39.920181 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4001fe46-c783-4817-bf8a-efe2a4c43669 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:39.934904 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd6844-659e-40a7-a531-d28f86ae4d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:39.935536 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd6844-659e-40a7-a531-d28f86ae4d69 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:39.936170 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd6844-659e-40a7-a531-d28f86ae4d69 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:39.936170 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd6844-659e-40a7-a531-d28f86ae4d69 None admin] PATH_INFO: `/v3/services` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:39.936771 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd6844-659e-40a7-a531-d28f86ae4d69 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:39.937077 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd6844-659e-40a7-a531-d28f86ae4d69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:39.938509 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd6844-659e-40a7-a531-d28f86ae4d69 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:39.945076 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 480/969] 10.222.0.91 () {56 vars in 1112 bytes} [Tue Aug 30 04:15:39 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:15:39.953847 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd6844-659e-40a7-a531-d28f86ae4d69 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:39.975803 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d73f274-9039-4ba7-b42f-1280b3e2666b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:39.977043 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73f274-9039-4ba7-b42f-1280b3e2666b None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:39.977485 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73f274-9039-4ba7-b42f-1280b3e2666b None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:39.977894 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73f274-9039-4ba7-b42f-1280b3e2666b None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:39.978734 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d73f274-9039-4ba7-b42f-1280b3e2666b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:39.979216 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d73f274-9039-4ba7-b42f-1280b3e2666b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:39.981488 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d73f274-9039-4ba7-b42f-1280b3e2666b None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:39.996923 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 490/970] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:15:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:15:40.003148 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d73f274-9039-4ba7-b42f-1280b3e2666b None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:40.073865 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:40.099290 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd6844-659e-40a7-a531-d28f86ae4d69 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:40.143106 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a52a0a-2710-45fa-8cd7-07259eb35bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:40.143875 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a52a0a-2710-45fa-8cd7-07259eb35bdb None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:40.144120 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a52a0a-2710-45fa-8cd7-07259eb35bdb None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:40.144518 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a52a0a-2710-45fa-8cd7-07259eb35bdb None admin] PATH_INFO: `/v3/services` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:40.145159 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a52a0a-2710-45fa-8cd7-07259eb35bdb None admin] RBAC: Adding query filter params (type=compute) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:40.145458 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a52a0a-2710-45fa-8cd7-07259eb35bdb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:40.146954 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a52a0a-2710-45fa-8cd7-07259eb35bdb None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:40.150311 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d73f274-9039-4ba7-b42f-1280b3e2666b None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:40.162226 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 481/971] 10.222.0.91 () {56 vars in 1112 bytes} [Tue Aug 30 04:15:39 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:15:40.203511 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7399199d-74e4-4376-9db4-f1ee90ecdbd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:40.204402 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7399199d-74e4-4376-9db4-f1ee90ecdbd7 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:40.204830 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7399199d-74e4-4376-9db4-f1ee90ecdbd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:40.205265 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7399199d-74e4-4376-9db4-f1ee90ecdbd7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:40.216212 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7399199d-74e4-4376-9db4-f1ee90ecdbd7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:40.218148 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7399199d-74e4-4376-9db4-f1ee90ecdbd7 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:40.234007 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-7399199d-74e4-4376-9db4-f1ee90ecdbd7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 04:15:40.234007 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:40.234007 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:40.234007 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:40.234007 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:40.234007 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:40.234007 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:40.234007 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:40.234007 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:40.234007 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:40.234007 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:40.234007 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:40.234007 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:15:40.234007 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:15:40.234007 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:15:40.234007 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:15:40.235959 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:40.235959 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:40.235959 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:15:40.235959 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:15:40.235959 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:15:40.235959 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:15:40.235959 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:40.235959 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:40.235959 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:40.235959 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:40.235959 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:40.235959 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:40.235959 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:40.235959 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:40.235959 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:40.235959 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:40.235959 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:40.235959 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:40.243709 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:40.243709 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:40.243709 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:15:40.243709 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:15:40.243709 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:15:40.243709 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:15:40.243709 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:15:40.243709 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:15:40.243709 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 04:15:40.243709 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:15:40.243709 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 491/972] 10.222.0.91 () {56 vars in 1117 bytes} [Tue Aug 30 04:15:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:15:40.246295 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a52a0a-2710-45fa-8cd7-07259eb35bdb None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:40.415361 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a52a0a-2710-45fa-8cd7-07259eb35bdb None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:40.475176 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6784a3a2-c5aa-42c0-94f3-0926f61b5bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:40.475895 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784a3a2-c5aa-42c0-94f3-0926f61b5bcb None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:40.476309 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784a3a2-c5aa-42c0-94f3-0926f61b5bcb None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:40.476623 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784a3a2-c5aa-42c0-94f3-0926f61b5bcb None admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:40.477399 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6784a3a2-c5aa-42c0-94f3-0926f61b5bcb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:40.477818 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6784a3a2-c5aa-42c0-94f3-0926f61b5bcb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:40.479414 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6784a3a2-c5aa-42c0-94f3-0926f61b5bcb None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:40.502372 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 482/973] 10.222.0.91 () {56 vars in 1149 bytes} [Tue Aug 30 04:15:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:40.508828 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7399199d-74e4-4376-9db4-f1ee90ecdbd7 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:40.533965 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:40.645841 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7399199d-74e4-4376-9db4-f1ee90ecdbd7 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:40.715076 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25b4510-8668-45c4-909e-1f90f42fedeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:40.716058 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b4510-8668-45c4-909e-1f90f42fedeb None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:40.716508 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b4510-8668-45c4-909e-1f90f42fedeb None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:40.716950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b4510-8668-45c4-909e-1f90f42fedeb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:40.852945 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25b4510-8668-45c4-909e-1f90f42fedeb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:40.856586 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25b4510-8668-45c4-909e-1f90f42fedeb None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:40.891834 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:41.017797 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 492/974] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 30 04:15:40 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 04:15:41.019428 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6784a3a2-c5aa-42c0-94f3-0926f61b5bcb None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:41.025979 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:41.158411 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6784a3a2-c5aa-42c0-94f3-0926f61b5bcb None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:41.203052 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d342afe-a0f7-49a8-bd0a-98f90600d019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:41.203714 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d342afe-a0f7-49a8-bd0a-98f90600d019 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:41.204022 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d342afe-a0f7-49a8-bd0a-98f90600d019 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:41.204288 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d342afe-a0f7-49a8-bd0a-98f90600d019 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:41.218189 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d342afe-a0f7-49a8-bd0a-98f90600d019 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:41.219689 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d342afe-a0f7-49a8-bd0a-98f90600d019 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:41.238715 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-8d342afe-a0f7-49a8-bd0a-98f90600d019 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:15:41.238715 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:41.238715 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:41.238715 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:41.238715 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:41.238715 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:41.238715 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:41.238715 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:41.238715 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:41.238715 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:41.238715 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:41.238715 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:41.238715 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:15:41.238715 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:15:41.238715 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:15:41.238715 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:15:41.240555 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:41.240555 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:41.240555 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:41.240555 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:41.240555 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:41.240555 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:41.240555 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:41.240555 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:41.240555 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:41.240555 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:41.240555 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:41.240555 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:41.240555 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:41.240555 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:41.240555 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:41.240555 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:41.240555 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:15:41.242710 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:15:41.242710 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:15:41.242710 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:41.244710 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 483/975] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:15:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:15:41.246950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25b4510-8668-45c4-909e-1f90f42fedeb None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:41.436590 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25b4510-8668-45c4-909e-1f90f42fedeb None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:41.471611 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:41.498567 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a4f92-6116-4bb1-8d56-7a99c02fb689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:41.500033 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a4f92-6116-4bb1-8d56-7a99c02fb689 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:41.500721 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a4f92-6116-4bb1-8d56-7a99c02fb689 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:41.501501 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a4f92-6116-4bb1-8d56-7a99c02fb689 None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:41.502918 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714a4f92-6116-4bb1-8d56-7a99c02fb689 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:41.503690 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714a4f92-6116-4bb1-8d56-7a99c02fb689 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:41.506832 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714a4f92-6116-4bb1-8d56-7a99c02fb689 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:41.536627 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 493/976] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:15:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:41.541982 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d342afe-a0f7-49a8-bd0a-98f90600d019 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:41.648604 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:41.706806 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d342afe-a0f7-49a8-bd0a-98f90600d019 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:41.750616 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01dbf15-0156-4946-b065-b9fdd8e08ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:41.751276 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01dbf15-0156-4946-b065-b9fdd8e08ade None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:41.751567 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01dbf15-0156-4946-b065-b9fdd8e08ade None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:41.751818 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01dbf15-0156-4946-b065-b9fdd8e08ade None admin] PATH_INFO: `/v3/projects/service` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:41.760632 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01dbf15-0156-4946-b065-b9fdd8e08ade None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:41.763200 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01dbf15-0156-4946-b065-b9fdd8e08ade None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:41.782239 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-e01dbf15-0156-4946-b065-b9fdd8e08ade None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:15:41.782239 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:41.782239 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:41.782239 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:41.782239 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:41.782239 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:41.782239 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:41.782239 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:41.782239 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:41.782239 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:41.782239 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:41.782239 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:41.782239 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:15:41.782239 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:15:41.782239 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:15:41.784322 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:15:41.784322 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:41.784322 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:41.784322 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:41.784322 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:41.784322 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:41.784322 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:41.784322 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:41.784322 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:41.784322 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:41.784322 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:41.784322 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:41.784322 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:41.784322 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:41.784322 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:41.784322 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:41.784322 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:41.786732 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:15:41.786732 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:15:41.786732 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:15:41.786732 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:15:41.786732 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:15:41.786732 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:15:41.786732 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:15:41.786732 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:41.786732 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 484/977] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 30 04:15:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:15:41.793934 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a4f92-6116-4bb1-8d56-7a99c02fb689 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:41.979633 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a4f92-6116-4bb1-8d56-7a99c02fb689 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:42.024212 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6992de82-fb29-42a3-93d9-59c13da698d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:42.024834 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6992de82-fb29-42a3-93d9-59c13da698d2 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:42.025111 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6992de82-fb29-42a3-93d9-59c13da698d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:42.025429 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6992de82-fb29-42a3-93d9-59c13da698d2 None admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:42.026160 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6992de82-fb29-42a3-93d9-59c13da698d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:42.026465 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6992de82-fb29-42a3-93d9-59c13da698d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:42.028048 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6992de82-fb29-42a3-93d9-59c13da698d2 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:42.044592 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 494/978] 10.222.0.91 () {56 vars in 1148 bytes} [Tue Aug 30 04:15:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:42.051145 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01dbf15-0156-4946-b065-b9fdd8e08ade None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:42.202064 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01dbf15-0156-4946-b065-b9fdd8e08ade None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:42.238050 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:42.278833 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d052f337-c9da-4800-b712-7bed9885fa76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:42.280327 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052f337-c9da-4800-b712-7bed9885fa76 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:42.281047 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052f337-c9da-4800-b712-7bed9885fa76 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:42.281742 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052f337-c9da-4800-b712-7bed9885fa76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:42.283376 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d052f337-c9da-4800-b712-7bed9885fa76 None admin] RBAC: Adding query filter params (role.id=d110827932ac4a4db66e89e29c8b6115, scope.project.id=4e05769361674c8fa995050150ad4cfa, user.id=1bc12faf48984335a3515dcde85b5cb1) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:42.284195 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d052f337-c9da-4800-b712-7bed9885fa76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:42.287377 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d052f337-c9da-4800-b712-7bed9885fa76 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:42.288571 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711086d-bef8-45b3-bdc1-0e57387bf733 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:42.289053 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711086d-bef8-45b3-bdc1-0e57387bf733 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:42.289053 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711086d-bef8-45b3-bdc1-0e57387bf733 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:42.290812 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 495/979] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:15:42.297176 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b4a45-bddd-4444-a486-bffbb988dbee None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:42.297463 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b4a45-bddd-4444-a486-bffbb988dbee None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:42.297746 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b4a45-bddd-4444-a486-bffbb988dbee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:42.308538 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 485/980] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 30 04:15:42 2022] GET /identity/v3/role_assignments?user.id=1bc12faf48984335a3515dcde85b5cb1&scope.project.id=4e05769361674c8fa995050150ad4cfa&role.id=d110827932ac4a4db66e89e29c8b6115 => generated 608 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:15:42.323105 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-d24b4a45-bddd-4444-a486-bffbb988dbee None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:42.324513 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-d24b4a45-bddd-4444-a486-bffbb988dbee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:42.365869 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:42.423625 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 496/981] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:15:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:15:42.674014 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb84280-8491-40d6-97b8-ff1cb3cd2b79 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:42.674824 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb84280-8491-40d6-97b8-ff1cb3cd2b79 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:42.674824 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb84280-8491-40d6-97b8-ff1cb3cd2b79 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:42.676278 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 486/982] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:15:42.682235 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4783bff-069b-4e8d-9bc6-dc8756b795a4 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:42.683061 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4783bff-069b-4e8d-9bc6-dc8756b795a4 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:42.683061 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4783bff-069b-4e8d-9bc6-dc8756b795a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:42.694322 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb84280-8491-40d6-97b8-ff1cb3cd2b79 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:42.704783 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-b4783bff-069b-4e8d-9bc6-dc8756b795a4 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:42.706022 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-b4783bff-069b-4e8d-9bc6-dc8756b795a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:42.816002 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 497/983] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:15:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 04:15:42.877184 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb84280-8491-40d6-97b8-ff1cb3cd2b79 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:42.949500 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf569f-044c-4ecf-b8d7-8d19c561fa5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:42.950446 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf569f-044c-4ecf-b8d7-8d19c561fa5b None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:42.950914 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf569f-044c-4ecf-b8d7-8d19c561fa5b None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:42.951662 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf569f-044c-4ecf-b8d7-8d19c561fa5b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:42.952847 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaf569f-044c-4ecf-b8d7-8d19c561fa5b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:42.955753 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaf569f-044c-4ecf-b8d7-8d19c561fa5b None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:42.975017 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-adaf569f-044c-4ecf-b8d7-8d19c561fa5b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 04:15:42.975017 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:42.975017 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:15:42.975017 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:15:42.975017 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:15:42.975017 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:15:42.975017 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:15:42.975017 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:15:42.975017 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 04:15:42.975017 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:42.975017 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:15:42.975017 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:42.975017 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:42.975017 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:42.975017 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:42.975017 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:42.975017 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:42.977317 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:42.977317 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:42.977317 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:42.977317 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:42.977317 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:42.977317 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:42.977317 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:15:42.977317 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:15:42.977317 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:15:42.977317 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:15:42.977317 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:42.977317 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:42.977317 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:42.977317 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:42.977317 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:42.977317 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:42.980067 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:42.980067 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:42.980067 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:42.980067 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:42.980067 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:42.980067 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:42.980067 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:42.980067 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:42.980067 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:42.980067 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:42.980067 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:15:42.980067 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:15:42.980067 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 04:15:42.980067 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:42.983703 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 487/984] 10.222.0.91 () {56 vars in 1126 bytes} [Tue Aug 30 04:15:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:15:42.987253 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4783bff-069b-4e8d-9bc6-dc8756b795a4 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:43.090756 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf569f-044c-4ecf-b8d7-8d19c561fa5b None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:43.149643 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:43.182599 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:43.190535 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4783bff-069b-4e8d-9bc6-dc8756b795a4 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:43.244880 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833fe0a6-1362-421e-b0f6-9d908215e556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:43.246370 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833fe0a6-1362-421e-b0f6-9d908215e556 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:43.247159 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833fe0a6-1362-421e-b0f6-9d908215e556 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:43.247479 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833fe0a6-1362-421e-b0f6-9d908215e556 None admin] PATH_INFO: `/v3/services` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:43.248232 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833fe0a6-1362-421e-b0f6-9d908215e556 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:43.248531 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833fe0a6-1362-421e-b0f6-9d908215e556 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:43.249976 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833fe0a6-1362-421e-b0f6-9d908215e556 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:43.252139 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf569f-044c-4ecf-b8d7-8d19c561fa5b None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:43.256602 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 498/985] 10.222.0.91 () {56 vars in 1122 bytes} [Tue Aug 30 04:15:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:43.263787 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833fe0a6-1362-421e-b0f6-9d908215e556 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:43.306235 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f5ce0-0562-49b2-bc28-2c3099d5f9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:43.307072 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f5ce0-0562-49b2-bc28-2c3099d5f9c4 None admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:43.307428 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f5ce0-0562-49b2-bc28-2c3099d5f9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:43.307701 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f5ce0-0562-49b2-bc28-2c3099d5f9c4 None admin] PATH_INFO: `/v3/services` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:43.308431 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1f5ce0-0562-49b2-bc28-2c3099d5f9c4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:43.309848 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1f5ce0-0562-49b2-bc28-2c3099d5f9c4 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:43.327891 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 488/986] 10.222.0.91 () {60 vars in 1141 bytes} [Tue Aug 30 04:15:43 2022] POST /identity/v3/services => generated 242 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:15:43.461206 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833fe0a6-1362-421e-b0f6-9d908215e556 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:43.543630 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a4937-b2d8-457c-a2fc-187f90745a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:43.544942 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a4937-b2d8-457c-a2fc-187f90745a0e None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:43.545555 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a4937-b2d8-457c-a2fc-187f90745a0e None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:43.546017 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a4937-b2d8-457c-a2fc-187f90745a0e None admin] PATH_INFO: `/v3/services` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:43.546858 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a4937-b2d8-457c-a2fc-187f90745a0e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:43.547293 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a4937-b2d8-457c-a2fc-187f90745a0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:43.549406 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a4937-b2d8-457c-a2fc-187f90745a0e None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:43.557956 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 499/987] 10.222.0.91 () {56 vars in 1122 bytes} [Tue Aug 30 04:15:43 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:15:43.565784 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f5ce0-0562-49b2-bc28-2c3099d5f9c4 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:43.773012 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f5ce0-0562-49b2-bc28-2c3099d5f9c4 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:43.779279 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:43.857864 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3308ac-6d2a-48ec-8216-c6c1f02da867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:43.858763 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3308ac-6d2a-48ec-8216-c6c1f02da867 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:43.859221 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3308ac-6d2a-48ec-8216-c6c1f02da867 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:43.859701 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3308ac-6d2a-48ec-8216-c6c1f02da867 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:43.861087 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3308ac-6d2a-48ec-8216-c6c1f02da867 None admin] RBAC: Adding query filter params (interface=admin, service_id=7101815f58234e3d8ff00444a2072e9b, region_id=RegionOne) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:43.861700 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3308ac-6d2a-48ec-8216-c6c1f02da867 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:43.864320 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3308ac-6d2a-48ec-8216-c6c1f02da867 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:43.880153 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 489/988] 10.222.0.91 () {56 vars in 1249 bytes} [Tue Aug 30 04:15:43 2022] GET /identity/v3/endpoints?service_id=7101815f58234e3d8ff00444a2072e9b&interface=admin®ion_id=RegionOne => generated 193 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:15:43.884029 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a4937-b2d8-457c-a2fc-187f90745a0e None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:43.934683 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:44.078608 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a4937-b2d8-457c-a2fc-187f90745a0e None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:44.119357 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f422a1b-0070-4878-a8c1-a5da39f278c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:44.120368 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f422a1b-0070-4878-a8c1-a5da39f278c5 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:44.120654 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f422a1b-0070-4878-a8c1-a5da39f278c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:44.120930 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f422a1b-0070-4878-a8c1-a5da39f278c5 None admin] PATH_INFO: `/v3/services` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:44.121555 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f422a1b-0070-4878-a8c1-a5da39f278c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:44.123031 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f422a1b-0070-4878-a8c1-a5da39f278c5 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:44.136241 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 500/989] 10.222.0.91 () {56 vars in 1087 bytes} [Tue Aug 30 04:15:43 2022] GET /identity/v3/services => generated 1727 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:15:44.467408 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294329dc-d611-4481-9b49-e1aa3db2d5c4 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:44.467673 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294329dc-d611-4481-9b49-e1aa3db2d5c4 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:44.468134 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294329dc-d611-4481-9b49-e1aa3db2d5c4 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:44.469588 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 490/990] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:15:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:15:44.478691 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828857c4-62e7-4d95-911d-befa99967474 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:44.479174 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828857c4-62e7-4d95-911d-befa99967474 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:44.479837 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828857c4-62e7-4d95-911d-befa99967474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:44.510802 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-828857c4-62e7-4d95-911d-befa99967474 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:44.512922 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-828857c4-62e7-4d95-911d-befa99967474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:44.648070 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 501/991] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:15:44 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:15:45.171079 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294329dc-d611-4481-9b49-e1aa3db2d5c4 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:45.398938 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294329dc-d611-4481-9b49-e1aa3db2d5c4 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:45.468918 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2a49cf-8599-4f3a-986a-37052171eebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:45.470609 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a49cf-8599-4f3a-986a-37052171eebd None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:45.471415 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a49cf-8599-4f3a-986a-37052171eebd None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:45.472218 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a49cf-8599-4f3a-986a-37052171eebd None admin] PATH_INFO: `/v3/services/image` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:45.473725 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2a49cf-8599-4f3a-986a-37052171eebd None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:45.476725 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2a49cf-8599-4f3a-986a-37052171eebd None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:45.495207 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-cb2a49cf-8599-4f3a-986a-37052171eebd None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 04:15:45.495207 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:45.495207 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:15:45.495207 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:15:45.495207 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:15:45.495207 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:15:45.495207 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:15:45.495207 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:15:45.495207 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 04:15:45.495207 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:45.495207 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:15:45.495207 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:45.495207 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:45.495207 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:45.495207 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:45.495207 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:45.495207 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:45.497088 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:45.497088 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:45.497088 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:45.497088 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:45.497088 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:45.497088 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:45.497088 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:15:45.497088 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:15:45.497088 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:15:45.497088 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:15:45.497088 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:45.497088 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:45.497088 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:45.497088 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:45.497088 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:45.497088 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:45.500016 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:45.500016 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:45.500016 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:45.500016 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:45.500016 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:45.500016 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:45.500016 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:45.500016 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:45.500016 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:45.500016 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:45.500016 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:15:45.500016 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:15:45.500016 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 04:15:45.500016 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:45.500016 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 491/992] 10.222.0.91 () {56 vars in 1105 bytes} [Tue Aug 30 04:15:45 2022] GET /identity/v3/services/image => generated 86 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:15:45.509637 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828857c4-62e7-4d95-911d-befa99967474 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:45.546358 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:45.729964 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53996afb-ce95-4ae4-8683-30e05c1c7355 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:45.730228 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53996afb-ce95-4ae4-8683-30e05c1c7355 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:45.730620 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53996afb-ce95-4ae4-8683-30e05c1c7355 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:45.732267 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 492/993] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:15:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:15:45.737890 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5993feb4-1e87-4317-a628-72c9327df335 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:45.738158 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5993feb4-1e87-4317-a628-72c9327df335 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:45.738462 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5993feb4-1e87-4317-a628-72c9327df335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:45.748582 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828857c4-62e7-4d95-911d-befa99967474 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:45.768360 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-5993feb4-1e87-4317-a628-72c9327df335 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:45.770273 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-5993feb4-1e87-4317-a628-72c9327df335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:45.805345 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905cdede-28a3-48ea-b790-bb36bd8f5c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:45.806468 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905cdede-28a3-48ea-b790-bb36bd8f5c7c None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:45.806993 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905cdede-28a3-48ea-b790-bb36bd8f5c7c None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:45.807465 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905cdede-28a3-48ea-b790-bb36bd8f5c7c None admin] PATH_INFO: `/v3/services` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:45.807896 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:45.808632 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905cdede-28a3-48ea-b790-bb36bd8f5c7c None admin] RBAC: Adding query filter params (name=image) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:45.809136 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905cdede-28a3-48ea-b790-bb36bd8f5c7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:45.812430 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905cdede-28a3-48ea-b790-bb36bd8f5c7c None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:45.828459 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 502/994] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:15:45 2022] GET /identity/v3/services?name=image => generated 122 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:45.833620 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905cdede-28a3-48ea-b790-bb36bd8f5c7c None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:45.878086 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 493/995] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:15:45 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 04:15:45.997260 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:46.041387 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905cdede-28a3-48ea-b790-bb36bd8f5c7c None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:46.111213 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdfc5d1-4ee9-4e5e-bef4-953f373d7f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:46.112289 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdfc5d1-4ee9-4e5e-bef4-953f373d7f60 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:46.112767 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdfc5d1-4ee9-4e5e-bef4-953f373d7f60 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:46.113206 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdfc5d1-4ee9-4e5e-bef4-953f373d7f60 None admin] PATH_INFO: `/v3/services` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:46.114264 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdfc5d1-4ee9-4e5e-bef4-953f373d7f60 None admin] RBAC: Adding query filter params (type=image) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:46.114765 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdfc5d1-4ee9-4e5e-bef4-953f373d7f60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:46.117355 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdfc5d1-4ee9-4e5e-bef4-953f373d7f60 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:46.126877 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 503/996] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:15:45 2022] GET /identity/v3/services?type=image => generated 122 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:15:46.164907 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5993feb4-1e87-4317-a628-72c9327df335 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:46.304213 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5993feb4-1e87-4317-a628-72c9327df335 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:46.350482 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478f452d-05ca-4014-b6a5-4ad7ba86c00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:46.351149 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f452d-05ca-4014-b6a5-4ad7ba86c00b None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:46.351418 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f452d-05ca-4014-b6a5-4ad7ba86c00b None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:46.351693 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f452d-05ca-4014-b6a5-4ad7ba86c00b None admin] PATH_INFO: `/v3/services/compute` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:46.352336 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478f452d-05ca-4014-b6a5-4ad7ba86c00b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:46.353869 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478f452d-05ca-4014-b6a5-4ad7ba86c00b None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:46.365121 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-478f452d-05ca-4014-b6a5-4ad7ba86c00b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 04:15:46.365121 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:46.365121 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:15:46.365121 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:15:46.365121 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:15:46.365121 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:15:46.365121 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:15:46.365121 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:15:46.365121 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 04:15:46.365121 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:46.365121 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:15:46.365121 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:46.365121 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:46.365121 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:46.365121 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:46.365121 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:46.365121 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:46.372551 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:46.372551 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:46.372551 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:46.372551 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:46.372551 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:46.372551 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:46.372551 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:15:46.372551 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:15:46.372551 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:15:46.372551 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:15:46.372551 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:46.372551 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:46.372551 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:46.372551 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:46.372551 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:46.372551 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:46.374303 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:46.374303 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:46.374303 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:46.374303 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:46.374303 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:46.374303 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:46.374303 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:46.374303 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:46.374303 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:46.374303 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:46.374303 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:15:46.374303 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:15:46.374303 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 04:15:46.374303 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:46.374303 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 494/997] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 30 04:15:46 2022] GET /identity/v3/services/compute => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:15:46.381493 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdfc5d1-4ee9-4e5e-bef4-953f373d7f60 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:46.543593 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdfc5d1-4ee9-4e5e-bef4-953f373d7f60 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:46.590679 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ac94dc-67ac-4176-9967-2015be667d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:46.591212 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac94dc-67ac-4176-9967-2015be667d69 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:46.591490 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac94dc-67ac-4176-9967-2015be667d69 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:46.591655 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601cac35-b4ae-4649-b0b6-33515c53baf1 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:46.591816 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac94dc-67ac-4176-9967-2015be667d69 None admin] PATH_INFO: `/v3/services` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:46.592111 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601cac35-b4ae-4649-b0b6-33515c53baf1 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:46.592577 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601cac35-b4ae-4649-b0b6-33515c53baf1 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:46.592721 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ac94dc-67ac-4176-9967-2015be667d69 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:46.592942 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ac94dc-67ac-4176-9967-2015be667d69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:46.594374 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ac94dc-67ac-4176-9967-2015be667d69 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:46.595450 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 495/998] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:15:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:15:46.601104 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 504/999] 10.222.0.91 () {56 vars in 1112 bytes} [Tue Aug 30 04:15:46 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:46.604230 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4fdc1c-d6de-4cb2-ba1b-643fccc08148 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:46.604731 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4fdc1c-d6de-4cb2-ba1b-643fccc08148 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:46.605199 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4fdc1c-d6de-4cb2-ba1b-643fccc08148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:46.607877 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ac94dc-67ac-4176-9967-2015be667d69 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:46.623479 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:46.638929 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-2b4fdc1c-d6de-4cb2-ba1b-643fccc08148 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:46.641651 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-2b4fdc1c-d6de-4cb2-ba1b-643fccc08148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:46.687562 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:46.781176 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 496/1000] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:15:46 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:15:46.814860 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ac94dc-67ac-4176-9967-2015be667d69 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:46.885487 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce39d1-a61e-4971-acb4-274c4e409e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:46.886530 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce39d1-a61e-4971-acb4-274c4e409e59 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:46.887007 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce39d1-a61e-4971-acb4-274c4e409e59 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:46.887460 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce39d1-a61e-4971-acb4-274c4e409e59 None admin] PATH_INFO: `/v3/services` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:46.888647 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ce39d1-a61e-4971-acb4-274c4e409e59 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:46.889163 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ce39d1-a61e-4971-acb4-274c4e409e59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:46.891711 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ce39d1-a61e-4971-acb4-274c4e409e59 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:46.901058 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 505/1001] 10.222.0.91 () {56 vars in 1112 bytes} [Tue Aug 30 04:15:46 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:15:46.907661 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4fdc1c-d6de-4cb2-ba1b-643fccc08148 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:47.038152 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4fdc1c-d6de-4cb2-ba1b-643fccc08148 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:47.087418 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce39d1-a61e-4971-acb4-274c4e409e59 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:47.108063 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb95f96-9779-4fcd-83c7-80c50f09da7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:47.109093 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb95f96-9779-4fcd-83c7-80c50f09da7a None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:47.109569 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb95f96-9779-4fcd-83c7-80c50f09da7a None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:47.110032 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb95f96-9779-4fcd-83c7-80c50f09da7a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:47.111330 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb95f96-9779-4fcd-83c7-80c50f09da7a None admin] RBAC: Adding query filter params (interface=public, service_id=df67801b40e048208eeb87bfb1915c84, region_id=RegionOne) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:47.111874 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb95f96-9779-4fcd-83c7-80c50f09da7a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:47.114483 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb95f96-9779-4fcd-83c7-80c50f09da7a None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:47.128056 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 497/1002] 10.222.0.91 () {56 vars in 1251 bytes} [Tue Aug 30 04:15:46 2022] GET /identity/v3/endpoints?service_id=df67801b40e048208eeb87bfb1915c84&interface=public®ion_id=RegionOne => generated 194 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:47.133793 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb95f96-9779-4fcd-83c7-80c50f09da7a None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:47.173426 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:47.205357 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:47.260717 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce39d1-a61e-4971-acb4-274c4e409e59 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:47.308537 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5077b3a4-f29c-42c3-9032-e89c513a7961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:47.309542 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077b3a4-f29c-42c3-9032-e89c513a7961 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:47.310011 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077b3a4-f29c-42c3-9032-e89c513a7961 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:47.310443 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077b3a4-f29c-42c3-9032-e89c513a7961 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:47.311365 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5077b3a4-f29c-42c3-9032-e89c513a7961 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:47.313448 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5077b3a4-f29c-42c3-9032-e89c513a7961 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:47.326261 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-5077b3a4-f29c-42c3-9032-e89c513a7961 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 04:15:47.326261 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:47.326261 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:15:47.326261 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:15:47.326261 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:15:47.326261 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:15:47.326261 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:15:47.326261 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:15:47.326261 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 04:15:47.326261 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:15:47.326261 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:15:47.326261 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:15:47.326261 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:47.326261 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:47.326261 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:47.326261 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:47.326261 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:47.328320 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:47.328320 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:47.328320 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:47.328320 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:47.328320 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:47.328320 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:47.328320 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:15:47.328320 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:15:47.328320 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:15:47.328320 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:15:47.328320 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:47.328320 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:47.328320 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:47.328320 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:47.328320 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:47.328320 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:47.329263 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:47.329263 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:47.329263 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:47.329263 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:47.329263 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:47.329263 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:47.329263 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:47.329263 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:47.329263 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:47.329263 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:47.329263 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:15:47.329263 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:15:47.329263 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 04:15:47.329263 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:15:47.329263 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 506/1003] 10.222.0.91 () {56 vars in 1126 bytes} [Tue Aug 30 04:15:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:15:47.333864 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb95f96-9779-4fcd-83c7-80c50f09da7a None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:47.338448 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5077b3a4-f29c-42c3-9032-e89c513a7961 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:47.381717 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec013a-1306-47bb-a7ab-ce78dd2f25e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:47.382898 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec013a-1306-47bb-a7ab-ce78dd2f25e7 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:47.383380 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec013a-1306-47bb-a7ab-ce78dd2f25e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:47.383838 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec013a-1306-47bb-a7ab-ce78dd2f25e7 None admin] PATH_INFO: `/v3/services` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:47.385148 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ec013a-1306-47bb-a7ab-ce78dd2f25e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:47.387763 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ec013a-1306-47bb-a7ab-ce78dd2f25e7 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:47.400908 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 498/1004] 10.222.0.91 () {56 vars in 1087 bytes} [Tue Aug 30 04:15:47 2022] GET /identity/v3/services => generated 1727 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:15:47.539574 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5077b3a4-f29c-42c3-9032-e89c513a7961 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:47.611152 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c402aa-0cda-44b7-b696-a4b12da1ae61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:47.612197 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c402aa-0cda-44b7-b696-a4b12da1ae61 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:47.612609 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c402aa-0cda-44b7-b696-a4b12da1ae61 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:47.613065 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c402aa-0cda-44b7-b696-a4b12da1ae61 None admin] PATH_INFO: `/v3/services` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:47.618244 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c402aa-0cda-44b7-b696-a4b12da1ae61 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:47.618244 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c402aa-0cda-44b7-b696-a4b12da1ae61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:47.618244 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c402aa-0cda-44b7-b696-a4b12da1ae61 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:47.620799 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:47.628041 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 507/1005] 10.222.0.91 () {56 vars in 1122 bytes} [Tue Aug 30 04:15:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:15:47.632953 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec013a-1306-47bb-a7ab-ce78dd2f25e7 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:47.758102 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:47.796136 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec013a-1306-47bb-a7ab-ce78dd2f25e7 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:47.866337 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab798e-adb1-4958-a0e4-8fbd9aadbf9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:47.867722 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab798e-adb1-4958-a0e4-8fbd9aadbf9f None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:47.868413 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab798e-adb1-4958-a0e4-8fbd9aadbf9f None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:47.869087 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab798e-adb1-4958-a0e4-8fbd9aadbf9f None admin] PATH_INFO: `/v3/services` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:47.870662 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ab798e-adb1-4958-a0e4-8fbd9aadbf9f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:47.871388 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ab798e-adb1-4958-a0e4-8fbd9aadbf9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:47.874326 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ab798e-adb1-4958-a0e4-8fbd9aadbf9f None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:47.885463 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 499/1006] 10.222.0.91 () {56 vars in 1122 bytes} [Tue Aug 30 04:15:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:15:47.894384 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c402aa-0cda-44b7-b696-a4b12da1ae61 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:48.084019 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c402aa-0cda-44b7-b696-a4b12da1ae61 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:48.129628 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4de4fb-05d3-46e9-b97c-184b785436c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:48.130300 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4de4fb-05d3-46e9-b97c-184b785436c4 None admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:48.130595 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4de4fb-05d3-46e9-b97c-184b785436c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:48.130843 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4de4fb-05d3-46e9-b97c-184b785436c4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:48.131557 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4de4fb-05d3-46e9-b97c-184b785436c4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:48.133110 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4de4fb-05d3-46e9-b97c-184b785436c4 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:48.163960 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 508/1007] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:15:47 2022] POST /identity/v3/endpoints => generated 325 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:15:48.550263 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c26fd2-d1ce-401e-9437-e05f6bdbf7db None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:48.551121 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c26fd2-d1ce-401e-9437-e05f6bdbf7db None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:48.551121 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c26fd2-d1ce-401e-9437-e05f6bdbf7db None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:48.552536 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 500/1008] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:15:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:15:48.562241 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9e319-12d9-4ad1-939d-d735b3f07698 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:48.562739 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9e319-12d9-4ad1-939d-d735b3f07698 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:48.563238 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9e319-12d9-4ad1-939d-d735b3f07698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:48.593389 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-1aa9e319-12d9-4ad1-939d-d735b3f07698 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:48.595490 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-1aa9e319-12d9-4ad1-939d-d735b3f07698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:48.714276 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:48.751127 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 509/1009] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:15:48 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:15:49.080139 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c26fd2-d1ce-401e-9437-e05f6bdbf7db None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:49.261387 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c26fd2-d1ce-401e-9437-e05f6bdbf7db None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:49.307258 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f974c3-2189-4c7d-90dc-f03a026186e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:49.308146 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f974c3-2189-4c7d-90dc-f03a026186e7 None admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:49.308556 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f974c3-2189-4c7d-90dc-f03a026186e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:49.308945 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f974c3-2189-4c7d-90dc-f03a026186e7 None admin] PATH_INFO: `/v3/services` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:49.309770 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f974c3-2189-4c7d-90dc-f03a026186e7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:49.311334 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f974c3-2189-4c7d-90dc-f03a026186e7 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:49.336077 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 501/1010] 10.222.0.91 () {60 vars in 1141 bytes} [Tue Aug 30 04:15:49 2022] POST /identity/v3/services => generated 242 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:15:49.498852 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e4bf2-bab5-48b1-83a6-dc57ae186711 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:49.499575 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e4bf2-bab5-48b1-83a6-dc57ae186711 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:49.500201 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e4bf2-bab5-48b1-83a6-dc57ae186711 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:49.502413 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 510/1011] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:15:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:15:49.509089 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce1e31-cc50-4ece-a870-50b34493b6b0 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:49.509556 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce1e31-cc50-4ece-a870-50b34493b6b0 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:49.510052 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce1e31-cc50-4ece-a870-50b34493b6b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:49.537104 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-c0ce1e31-cc50-4ece-a870-50b34493b6b0 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:49.538550 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-c0ce1e31-cc50-4ece-a870-50b34493b6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:49.542395 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:49.648589 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 502/1012] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:15:49 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:15:49.922438 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e4bf2-bab5-48b1-83a6-dc57ae186711 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:50.040065 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e4bf2-bab5-48b1-83a6-dc57ae186711 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:50.082411 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76840f18-211e-4382-bad3-137d04a0496e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:50.083063 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76840f18-211e-4382-bad3-137d04a0496e None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:50.083332 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76840f18-211e-4382-bad3-137d04a0496e None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:50.083597 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76840f18-211e-4382-bad3-137d04a0496e None admin] PATH_INFO: `/v3/services/compute` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:50.084228 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76840f18-211e-4382-bad3-137d04a0496e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:50.085643 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76840f18-211e-4382-bad3-137d04a0496e None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:50.095593 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-76840f18-211e-4382-bad3-137d04a0496e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 04:15:50.095593 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:50.095593 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:15:50.095593 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:15:50.095593 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:15:50.095593 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:15:50.095593 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:15:50.095593 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:15:50.095593 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 04:15:50.095593 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:15:50.095593 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:15:50.095593 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:15:50.095593 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:50.095593 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:50.095593 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:50.095593 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:50.095593 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:50.097368 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:50.097368 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:50.097368 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:50.097368 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:50.097368 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:50.097368 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:50.097368 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:15:50.097368 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:15:50.097368 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:15:50.097368 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:15:50.097368 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:50.097368 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:50.097368 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:50.097368 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:50.097368 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:50.097368 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:50.098280 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:50.098280 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:50.098280 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:50.098280 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:50.098280 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:50.098280 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:50.098280 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:50.098280 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:50.098280 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:50.098280 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:50.098280 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:15:50.098280 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:15:50.098280 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 04:15:50.098280 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:15:50.099993 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 511/1013] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 30 04:15:49 2022] GET /identity/v3/services/compute => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:15:50.103187 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ce1e31-cc50-4ece-a870-50b34493b6b0 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:50.229398 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ce1e31-cc50-4ece-a870-50b34493b6b0 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:50.270454 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4498fe0-aefd-475e-af75-185453d78d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:50.271090 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4498fe0-aefd-475e-af75-185453d78d56 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:50.271359 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4498fe0-aefd-475e-af75-185453d78d56 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:50.271625 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4498fe0-aefd-475e-af75-185453d78d56 None admin] PATH_INFO: `/v3/services` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:50.272314 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4498fe0-aefd-475e-af75-185453d78d56 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:50.272602 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4498fe0-aefd-475e-af75-185453d78d56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:50.274027 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4498fe0-aefd-475e-af75-185453d78d56 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:50.275526 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:50.282941 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 503/1014] 10.222.0.91 () {56 vars in 1112 bytes} [Tue Aug 30 04:15:50 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:50.289616 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76840f18-211e-4382-bad3-137d04a0496e None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:50.336115 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34000f0-6c0a-47c1-adf3-8da43af72d5a None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:50.336470 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34000f0-6c0a-47c1-adf3-8da43af72d5a None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:50.336892 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34000f0-6c0a-47c1-adf3-8da43af72d5a None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:50.338379 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 504/1015] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:15:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:15:50.345524 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83a783e-eb62-4dfb-98c3-5438d786e994 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:50.346173 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83a783e-eb62-4dfb-98c3-5438d786e994 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:50.346654 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83a783e-eb62-4dfb-98c3-5438d786e994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:50.367559 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-e83a783e-eb62-4dfb-98c3-5438d786e994 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:50.368835 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-e83a783e-eb62-4dfb-98c3-5438d786e994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:50.393042 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:50.460197 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76840f18-211e-4382-bad3-137d04a0496e None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:50.480068 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 505/1016] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:15:50 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:15:50.503391 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b65f55f-8656-48dc-9fc0-0160e8bb567e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:50.505006 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65f55f-8656-48dc-9fc0-0160e8bb567e None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:50.505766 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65f55f-8656-48dc-9fc0-0160e8bb567e None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:50.506505 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65f55f-8656-48dc-9fc0-0160e8bb567e None admin] PATH_INFO: `/v3/services` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:50.508026 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b65f55f-8656-48dc-9fc0-0160e8bb567e None admin] RBAC: Adding query filter params (type=compute) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:50.508686 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b65f55f-8656-48dc-9fc0-0160e8bb567e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:50.511352 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b65f55f-8656-48dc-9fc0-0160e8bb567e None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:50.525081 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 512/1017] 10.222.0.91 () {56 vars in 1112 bytes} [Tue Aug 30 04:15:50 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:50.527601 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83a783e-eb62-4dfb-98c3-5438d786e994 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:50.661244 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83a783e-eb62-4dfb-98c3-5438d786e994 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:50.703820 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:50.719776 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988889dc-c6bf-4856-babf-7ffda031fbb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:50.720539 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988889dc-c6bf-4856-babf-7ffda031fbb7 None admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:50.720839 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988889dc-c6bf-4856-babf-7ffda031fbb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:50.721205 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988889dc-c6bf-4856-babf-7ffda031fbb7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:50.722378 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988889dc-c6bf-4856-babf-7ffda031fbb7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:50.724949 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988889dc-c6bf-4856-babf-7ffda031fbb7 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:50.753868 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b65f55f-8656-48dc-9fc0-0160e8bb567e None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:50.766438 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 506/1018] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:15:50 2022] POST /identity/v3/endpoints => generated 334 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:15:50.971154 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b65f55f-8656-48dc-9fc0-0160e8bb567e None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:51.004043 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:51.047291 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8026e2fb-1781-40ff-8edc-8485b9a00123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:51.048529 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8026e2fb-1781-40ff-8edc-8485b9a00123 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:51.049005 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8026e2fb-1781-40ff-8edc-8485b9a00123 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:51.049476 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8026e2fb-1781-40ff-8edc-8485b9a00123 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:51.051676 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8026e2fb-1781-40ff-8edc-8485b9a00123 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:51.054549 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8026e2fb-1781-40ff-8edc-8485b9a00123 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:51.057798 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 513/1019] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:15:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:15:51.066895 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988889dc-c6bf-4856-babf-7ffda031fbb7 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:51.210638 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988889dc-c6bf-4856-babf-7ffda031fbb7 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:51.255940 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78181bc9-d618-4cd9-870b-c46a228b215c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:51.256544 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78181bc9-d618-4cd9-870b-c46a228b215c None admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:51.256716 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78181bc9-d618-4cd9-870b-c46a228b215c None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:51.257038 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78181bc9-d618-4cd9-870b-c46a228b215c None admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:51.257703 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78181bc9-d618-4cd9-870b-c46a228b215c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:51.259234 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78181bc9-d618-4cd9-870b-c46a228b215c None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:51.299951 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 507/1020] 10.222.0.91 () {60 vars in 1141 bytes} [Tue Aug 30 04:15:51 2022] POST /identity/v3/projects => generated 311 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:15:51.393127 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eef08f-c367-463a-98b6-6d6495e52f09 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:51.393392 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eef08f-c367-463a-98b6-6d6495e52f09 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:51.393688 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eef08f-c367-463a-98b6-6d6495e52f09 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:51.395335 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 514/1021] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:15:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:15:51.401499 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba74360a-1cb7-4d4e-b991-92fb70b80a72 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:51.402235 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba74360a-1cb7-4d4e-b991-92fb70b80a72 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:51.402235 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba74360a-1cb7-4d4e-b991-92fb70b80a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:51.424350 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-ba74360a-1cb7-4d4e-b991-92fb70b80a72 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:51.425669 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-ba74360a-1cb7-4d4e-b991-92fb70b80a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:51.468737 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:51.521549 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 508/1022] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:15:51 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:15:51.795104 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eef08f-c367-463a-98b6-6d6495e52f09 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:51.923632 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eef08f-c367-463a-98b6-6d6495e52f09 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:51.965693 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c484b-f1e6-4327-8d05-a9ad448eaeff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:51.966352 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c484b-f1e6-4327-8d05-a9ad448eaeff None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:51.966623 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c484b-f1e6-4327-8d05-a9ad448eaeff None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:51.966888 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c484b-f1e6-4327-8d05-a9ad448eaeff None admin] PATH_INFO: `/v3/services/image` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:51.967505 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06c484b-f1e6-4327-8d05-a9ad448eaeff None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:51.969050 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06c484b-f1e6-4327-8d05-a9ad448eaeff None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:51.980469 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-c06c484b-f1e6-4327-8d05-a9ad448eaeff None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 04:15:51.980469 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:51.980469 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:15:51.980469 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:15:51.980469 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:15:51.980469 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:15:51.980469 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:15:51.980469 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:15:51.980469 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 04:15:51.980469 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:15:51.980469 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:15:51.980469 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:15:51.980469 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:51.980469 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:51.980469 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:51.980469 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:51.980469 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:51.982754 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:51.982754 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:51.982754 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:51.982754 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:51.982754 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:51.982754 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:51.982754 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:15:51.982754 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:15:51.982754 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:15:51.982754 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:15:51.982754 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:51.982754 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:51.982754 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:51.982754 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:51.982754 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:51.982754 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:51.984236 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:51.984236 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:51.984236 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:51.984236 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:51.984236 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:51.984236 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:51.984236 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:51.984236 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:51.984236 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:51.984236 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:51.984236 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:15:51.984236 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:15:51.984236 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 04:15:51.984236 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:15:51.992888 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 515/1023] 10.222.0.91 () {56 vars in 1105 bytes} [Tue Aug 30 04:15:51 2022] GET /identity/v3/services/image => generated 86 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:15:51.993261 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba74360a-1cb7-4d4e-b991-92fb70b80a72 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:52.191101 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba74360a-1cb7-4d4e-b991-92fb70b80a72 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:52.260587 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44281e33-bd0c-4767-8124-9ed2805715da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:52.262035 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44281e33-bd0c-4767-8124-9ed2805715da None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:52.262730 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44281e33-bd0c-4767-8124-9ed2805715da None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:52.263435 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44281e33-bd0c-4767-8124-9ed2805715da None admin] PATH_INFO: `/v3/services` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:52.264866 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44281e33-bd0c-4767-8124-9ed2805715da None admin] RBAC: Adding query filter params (name=image) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:52.265630 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44281e33-bd0c-4767-8124-9ed2805715da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:52.268460 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44281e33-bd0c-4767-8124-9ed2805715da None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:52.279028 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 509/1024] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:15:51 2022] GET /identity/v3/services?name=image => generated 122 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:52.287305 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c484b-f1e6-4327-8d05-a9ad448eaeff None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:52.370998 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:52.444199 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c484b-f1e6-4327-8d05-a9ad448eaeff None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:52.489399 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7780e5-c5f9-4ce2-9091-7af5e5cdc633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:52.490027 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7780e5-c5f9-4ce2-9091-7af5e5cdc633 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:52.490303 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7780e5-c5f9-4ce2-9091-7af5e5cdc633 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:52.490571 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7780e5-c5f9-4ce2-9091-7af5e5cdc633 None admin] PATH_INFO: `/v3/services` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:52.491256 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7780e5-c5f9-4ce2-9091-7af5e5cdc633 None admin] RBAC: Adding query filter params (type=image) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:52.491515 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7780e5-c5f9-4ce2-9091-7af5e5cdc633 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:52.492973 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7780e5-c5f9-4ce2-9091-7af5e5cdc633 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:52.499226 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 516/1025] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:15:52 2022] GET /identity/v3/services?type=image => generated 350 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:52.506308 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44281e33-bd0c-4767-8124-9ed2805715da None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:52.568664 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:52.727782 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44281e33-bd0c-4767-8124-9ed2805715da None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:52.799632 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9ec2a-b9e7-4e7b-8eb1-a5fee1ab6743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:52.800993 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9ec2a-b9e7-4e7b-8eb1-a5fee1ab6743 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:52.801503 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9ec2a-b9e7-4e7b-8eb1-a5fee1ab6743 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:52.801942 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9ec2a-b9e7-4e7b-8eb1-a5fee1ab6743 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:52.803216 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc9ec2a-b9e7-4e7b-8eb1-a5fee1ab6743 None admin] RBAC: Adding query filter params (interface=public, service_id=322ec0a1e8e5427c86ac8beea40f2d8d, region_id=RegionOne) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:52.804041 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc9ec2a-b9e7-4e7b-8eb1-a5fee1ab6743 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:52.806986 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc9ec2a-b9e7-4e7b-8eb1-a5fee1ab6743 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:52.828238 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 510/1026] 10.222.0.91 () {56 vars in 1251 bytes} [Tue Aug 30 04:15:52 2022] GET /identity/v3/endpoints?service_id=322ec0a1e8e5427c86ac8beea40f2d8d&interface=public®ion_id=RegionOne => generated 194 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:52.830012 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7780e5-c5f9-4ce2-9091-7af5e5cdc633 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:53.026927 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7780e5-c5f9-4ce2-9091-7af5e5cdc633 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:53.042637 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:53.099781 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc4285-5a92-4545-911a-ae1ada1c9012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:53.100839 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc4285-5a92-4545-911a-ae1ada1c9012 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:53.101309 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc4285-5a92-4545-911a-ae1ada1c9012 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:53.101766 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc4285-5a92-4545-911a-ae1ada1c9012 None admin] PATH_INFO: `/v3/services` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:53.102884 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbc4285-5a92-4545-911a-ae1ada1c9012 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:53.106438 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbc4285-5a92-4545-911a-ae1ada1c9012 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:53.128294 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 517/1027] 10.222.0.91 () {56 vars in 1087 bytes} [Tue Aug 30 04:15:52 2022] GET /identity/v3/services => generated 1957 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:15:53.436385 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8851210-304f-4f3e-8183-f8802cabaff3 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:53.437233 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8851210-304f-4f3e-8183-f8802cabaff3 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:53.437233 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8851210-304f-4f3e-8183-f8802cabaff3 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:53.438699 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 511/1028] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:15:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:15:53.444353 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a87b4-d479-47b1-9fe3-d41d9b989d8c None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:53.444615 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a87b4-d479-47b1-9fe3-d41d9b989d8c None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:53.444951 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a87b4-d479-47b1-9fe3-d41d9b989d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:53.465104 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-207a87b4-d479-47b1-9fe3-d41d9b989d8c None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:53.466339 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-207a87b4-d479-47b1-9fe3-d41d9b989d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:53.548289 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0815045-21aa-41ab-bdcc-d33f6842d7e0 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:53.548550 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0815045-21aa-41ab-bdcc-d33f6842d7e0 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:53.548688 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0815045-21aa-41ab-bdcc-d33f6842d7e0 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:53.550376 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 512/1029] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:15:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:15:53.557169 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3419e2fb-ab83-4273-8f12-d5a84b577bb5 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:53.557630 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3419e2fb-ab83-4273-8f12-d5a84b577bb5 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:53.558090 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3419e2fb-ab83-4273-8f12-d5a84b577bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:53.583803 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-3419e2fb-ab83-4273-8f12-d5a84b577bb5 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:53.585064 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-3419e2fb-ab83-4273-8f12-d5a84b577bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:53.607848 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 518/1030] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:15:53 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:15:53.684013 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 513/1031] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:15:53 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:15:53.876834 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a87b4-d479-47b1-9fe3-d41d9b989d8c None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:54.069440 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3419e2fb-ab83-4273-8f12-d5a84b577bb5 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:54.086032 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:54.092511 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a87b4-d479-47b1-9fe3-d41d9b989d8c None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:54.101241 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:54.141455 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fb9bbb-362d-4715-93ad-99e76d824ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:54.142008 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb9bbb-362d-4715-93ad-99e76d824ba3 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:54.142422 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb9bbb-362d-4715-93ad-99e76d824ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:54.142616 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb9bbb-362d-4715-93ad-99e76d824ba3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:54.156599 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fb9bbb-362d-4715-93ad-99e76d824ba3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:15:54.161691 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-56fb9bbb-362d-4715-93ad-99e76d824ba3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 04:15:54.161691 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:54.161691 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:54.161691 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:54.161691 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:54.161691 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:54.161691 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:54.161691 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:54.161691 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:54.161691 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:54.161691 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:54.161691 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:54.161691 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:15:54.161691 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:15:54.161691 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:15:54.161691 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:15:54.162892 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:15:54.162892 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:15:54.162892 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:15:54.162892 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:15:54.162892 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:54.162892 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:54.162892 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:54.162892 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:54.162892 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:54.162892 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:54.162892 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:54.162892 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:54.162892 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:54.162892 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:54.162892 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:54.162892 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:54.164575 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:54.164575 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:54.164575 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:54.164575 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:54.164575 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:15:54.164575 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:15:54.164575 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:15:54.164575 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:15:54.164575 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:15:54.164575 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:15:54.164575 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 04:15:54.164575 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:15:54.164575 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 519/1032] 10.222.0.91 () {56 vars in 1120 bytes} [Tue Aug 30 04:15:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:15:54.170717 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fb9bbb-362d-4715-93ad-99e76d824ba3 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:54.239528 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3419e2fb-ab83-4273-8f12-d5a84b577bb5 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:54.301234 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7b690-bf65-4b75-bd96-f6d67c72826c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:54.302232 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7b690-bf65-4b75-bd96-f6d67c72826c None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:54.302651 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7b690-bf65-4b75-bd96-f6d67c72826c None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:54.303082 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7b690-bf65-4b75-bd96-f6d67c72826c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:54.305091 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac7b690-bf65-4b75-bd96-f6d67c72826c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:54.307353 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac7b690-bf65-4b75-bd96-f6d67c72826c None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:54.311592 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 514/1033] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:15:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:15:54.320518 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7b690-bf65-4b75-bd96-f6d67c72826c None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:54.361353 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fb9bbb-362d-4715-93ad-99e76d824ba3 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:54.431399 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d5282a-091a-488f-ba92-cddc18070e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:54.433170 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5282a-091a-488f-ba92-cddc18070e12 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:54.434222 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5282a-091a-488f-ba92-cddc18070e12 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:54.434705 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5282a-091a-488f-ba92-cddc18070e12 None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:54.436237 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d5282a-091a-488f-ba92-cddc18070e12 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:54.436765 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d5282a-091a-488f-ba92-cddc18070e12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:54.439945 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d5282a-091a-488f-ba92-cddc18070e12 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:54.464019 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 520/1034] 10.222.0.91 () {56 vars in 1115 bytes} [Tue Aug 30 04:15:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:54.468471 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d5282a-091a-488f-ba92-cddc18070e12 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:54.472127 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:54.485505 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7b690-bf65-4b75-bd96-f6d67c72826c None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:54.515236 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:54.544938 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25af00-efc9-46fe-86f1-9b1772cea974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:54.545878 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25af00-efc9-46fe-86f1-9b1772cea974 None admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:54.546308 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25af00-efc9-46fe-86f1-9b1772cea974 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:54.546738 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25af00-efc9-46fe-86f1-9b1772cea974 None admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:54.547954 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df25af00-efc9-46fe-86f1-9b1772cea974 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:54.550642 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df25af00-efc9-46fe-86f1-9b1772cea974 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:54.593347 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 515/1035] 10.222.0.91 () {60 vars in 1132 bytes} [Tue Aug 30 04:15:54 2022] POST /identity/v3/users => generated 285 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:15:54.686531 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d5282a-091a-488f-ba92-cddc18070e12 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:54.752243 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c8077-3ae6-4c3b-af6b-4e06c34c8246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:54.752932 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c8077-3ae6-4c3b-af6b-4e06c34c8246 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:54.753215 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c8077-3ae6-4c3b-af6b-4e06c34c8246 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:54.753498 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c8077-3ae6-4c3b-af6b-4e06c34c8246 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:54.770736 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62c8077-3ae6-4c3b-af6b-4e06c34c8246 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:54.772667 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62c8077-3ae6-4c3b-af6b-4e06c34c8246 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:54.799075 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-e62c8077-3ae6-4c3b-af6b-4e06c34c8246 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:15:54.799075 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:54.799075 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:54.799075 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:54.799075 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:54.799075 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:54.799075 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:54.799075 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:54.799075 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:54.799075 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:54.799075 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:54.799075 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:54.799075 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:15:54.799075 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:15:54.799075 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:15:54.799075 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:15:54.800762 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:54.800762 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:54.800762 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:54.800762 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:54.800762 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:54.800762 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:54.800762 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:54.800762 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:54.800762 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:54.800762 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:54.800762 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:54.800762 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:54.800762 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:54.800762 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:54.800762 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:54.800762 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:54.800762 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:15:54.802514 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:15:54.802514 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:15:54.802514 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:15:54.802514 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 521/1036] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:15:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:15:54.809728 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25af00-efc9-46fe-86f1-9b1772cea974 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:54.963520 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25af00-efc9-46fe-86f1-9b1772cea974 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:55.008435 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279c5aeb-7405-48eb-9c8f-67f87234f32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:55.009067 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c5aeb-7405-48eb-9c8f-67f87234f32c None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:55.009344 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c5aeb-7405-48eb-9c8f-67f87234f32c None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:55.009617 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c5aeb-7405-48eb-9c8f-67f87234f32c None admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:55.010739 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279c5aeb-7405-48eb-9c8f-67f87234f32c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:55.011045 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279c5aeb-7405-48eb-9c8f-67f87234f32c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:55.012546 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279c5aeb-7405-48eb-9c8f-67f87234f32c None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:55.027571 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 516/1037] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:15:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:55.034071 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c8077-3ae6-4c3b-af6b-4e06c34c8246 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:55.179254 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:55.213863 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c8077-3ae6-4c3b-af6b-4e06c34c8246 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:55.255355 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd59448-7139-4640-80ee-d05bab114597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:55.256046 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd59448-7139-4640-80ee-d05bab114597 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:55.256324 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd59448-7139-4640-80ee-d05bab114597 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:55.256590 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd59448-7139-4640-80ee-d05bab114597 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:55.268706 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd59448-7139-4640-80ee-d05bab114597 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:55.269149 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd59448-7139-4640-80ee-d05bab114597 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:55.282924 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-2dd59448-7139-4640-80ee-d05bab114597 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 04:15:55.282924 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:55.282924 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:55.282924 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:55.282924 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:55.282924 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:55.282924 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:55.282924 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:55.282924 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:55.282924 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:55.282924 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:55.282924 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:55.282924 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:15:55.282924 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:15:55.282924 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:15:55.282924 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:15:55.285199 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:55.285199 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:55.285199 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:15:55.285199 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:15:55.285199 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:15:55.285199 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:15:55.285199 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:55.285199 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:55.285199 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:55.285199 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:55.285199 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:55.285199 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:55.285199 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:55.285199 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:55.285199 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:55.285199 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:55.285199 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:55.285199 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:55.287093 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:55.287093 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:55.287093 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:15:55.287093 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:15:55.287093 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:15:55.287093 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:15:55.287093 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:15:55.287093 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:15:55.287093 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 04:15:55.287093 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:15:55.287093 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 522/1038] 10.222.0.91 () {56 vars in 1093 bytes} [Tue Aug 30 04:15:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:15:55.299855 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279c5aeb-7405-48eb-9c8f-67f87234f32c None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:55.320501 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:55.507874 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279c5aeb-7405-48eb-9c8f-67f87234f32c None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:55.559185 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713412ac-5720-4228-bb5d-686958a94fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:55.559814 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713412ac-5720-4228-bb5d-686958a94fbc None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:55.560135 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713412ac-5720-4228-bb5d-686958a94fbc None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:55.560494 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713412ac-5720-4228-bb5d-686958a94fbc None admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:55.561172 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713412ac-5720-4228-bb5d-686958a94fbc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:55.561482 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713412ac-5720-4228-bb5d-686958a94fbc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:55.562967 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713412ac-5720-4228-bb5d-686958a94fbc None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:55.566377 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7900b6-e3fb-4ff0-874b-9da9c9340c80 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:55.566823 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7900b6-e3fb-4ff0-874b-9da9c9340c80 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:55.567274 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7900b6-e3fb-4ff0-874b-9da9c9340c80 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:55.569526 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 523/1039] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:15:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:15:55.576198 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b71736-31c1-436c-8e45-99bb294ddb02 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:55.576643 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b71736-31c1-436c-8e45-99bb294ddb02 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:55.577201 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b71736-31c1-436c-8e45-99bb294ddb02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:55.590152 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 517/1040] 10.222.0.91 () {56 vars in 1133 bytes} [Tue Aug 30 04:15:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:55.596476 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713412ac-5720-4228-bb5d-686958a94fbc None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:55.603825 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-c9b71736-31c1-436c-8e45-99bb294ddb02 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:55.605282 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-c9b71736-31c1-436c-8e45-99bb294ddb02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:55.694164 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 524/1041] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:15:55 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 04:15:55.719048 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:55.795218 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713412ac-5720-4228-bb5d-686958a94fbc None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:55.866335 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da4848-7828-47cc-b404-7f6cc8d64ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:55.867308 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da4848-7828-47cc-b404-7f6cc8d64ba4 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:55.867731 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da4848-7828-47cc-b404-7f6cc8d64ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:55.868201 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da4848-7828-47cc-b404-7f6cc8d64ba4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:55.975213 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b71736-31c1-436c-8e45-99bb294ddb02 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:56.007829 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54da4848-7828-47cc-b404-7f6cc8d64ba4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:56.011137 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54da4848-7828-47cc-b404-7f6cc8d64ba4 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:56.053938 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:56.099242 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b71736-31c1-436c-8e45-99bb294ddb02 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:56.134234 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:56.143039 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e54f6-93ce-407e-951b-385fe5e49038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:56.143764 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e54f6-93ce-407e-951b-385fe5e49038 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:56.144070 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e54f6-93ce-407e-951b-385fe5e49038 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:56.144342 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e54f6-93ce-407e-951b-385fe5e49038 None admin] PATH_INFO: `/v3/services/image` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:56.144939 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966e54f6-93ce-407e-951b-385fe5e49038 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:56.146387 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966e54f6-93ce-407e-951b-385fe5e49038 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:56.157537 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-966e54f6-93ce-407e-951b-385fe5e49038 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 04:15:56.157537 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:56.157537 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:15:56.157537 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:15:56.157537 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:15:56.157537 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:15:56.157537 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:15:56.157537 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:15:56.157537 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 04:15:56.157537 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:15:56.157537 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:15:56.157537 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:15:56.157537 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:56.157537 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:56.157537 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:56.157537 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:56.157537 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:56.159382 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:56.159382 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:56.159382 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:56.159382 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:56.159382 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:56.159382 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:56.159382 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:15:56.159382 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:15:56.159382 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:15:56.159382 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:15:56.159382 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:56.159382 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:56.159382 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:56.159382 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:56.159382 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:56.159382 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:56.160907 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:56.160907 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:56.160907 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:56.160907 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:56.160907 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:56.160907 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:56.160907 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:56.160907 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:56.160907 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:56.160907 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:56.160907 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:15:56.160907 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:15:56.160907 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 04:15:56.160907 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:15:56.160907 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 525/1042] 10.222.0.91 () {56 vars in 1105 bytes} [Tue Aug 30 04:15:55 2022] GET /identity/v3/services/image => generated 86 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:15:56.165032 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e54f6-93ce-407e-951b-385fe5e49038 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:56.201223 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 518/1043] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 30 04:15:55 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 04:15:56.202941 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da4848-7828-47cc-b404-7f6cc8d64ba4 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:56.330419 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e54f6-93ce-407e-951b-385fe5e49038 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:56.348179 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da4848-7828-47cc-b404-7f6cc8d64ba4 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:56.381881 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:56.392357 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50157ec2-a94d-4ce8-9b9e-ad403402cdd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:56.393327 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50157ec2-a94d-4ce8-9b9e-ad403402cdd3 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:56.393731 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50157ec2-a94d-4ce8-9b9e-ad403402cdd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:56.394181 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50157ec2-a94d-4ce8-9b9e-ad403402cdd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:56.398095 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07654bd-621b-4f21-80b1-5a5f35dab19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:56.399537 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07654bd-621b-4f21-80b1-5a5f35dab19a None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:56.400032 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07654bd-621b-4f21-80b1-5a5f35dab19a None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:56.400546 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07654bd-621b-4f21-80b1-5a5f35dab19a None admin] PATH_INFO: `/v3/services` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:56.401628 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07654bd-621b-4f21-80b1-5a5f35dab19a None admin] RBAC: Adding query filter params (name=image) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:56.402110 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07654bd-621b-4f21-80b1-5a5f35dab19a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:56.404538 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07654bd-621b-4f21-80b1-5a5f35dab19a None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:56.412711 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50157ec2-a94d-4ce8-9b9e-ad403402cdd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:56.415060 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 526/1044] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:15:56 2022] GET /identity/v3/services?name=image => generated 122 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:15:56.415287 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50157ec2-a94d-4ce8-9b9e-ad403402cdd3 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:56.424510 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07654bd-621b-4f21-80b1-5a5f35dab19a None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:56.446778 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-50157ec2-a94d-4ce8-9b9e-ad403402cdd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:15:56.446778 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:56.446778 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:56.446778 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:56.446778 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:56.446778 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:56.446778 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:56.446778 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:56.446778 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:56.446778 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:56.446778 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:56.446778 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:56.446778 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:15:56.446778 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:15:56.446778 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:15:56.446778 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:15:56.458109 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:56.458109 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:56.458109 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:56.458109 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:56.458109 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:56.458109 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:56.458109 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:56.458109 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:56.458109 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:56.458109 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:56.458109 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:56.458109 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:56.458109 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:56.458109 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:56.458109 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:56.458109 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:56.458109 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:15:56.460854 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:15:56.460854 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:15:56.460854 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:56.460854 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 519/1045] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:15:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:15:56.460854 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50157ec2-a94d-4ce8-9b9e-ad403402cdd3 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:56.497552 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:56.607722 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07654bd-621b-4f21-80b1-5a5f35dab19a None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:56.667463 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50157ec2-a94d-4ce8-9b9e-ad403402cdd3 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:56.675255 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994aefda-00e7-4bee-b2d1-0397aa3eaf1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:56.676258 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994aefda-00e7-4bee-b2d1-0397aa3eaf1c None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:56.676683 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994aefda-00e7-4bee-b2d1-0397aa3eaf1c None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:56.677149 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994aefda-00e7-4bee-b2d1-0397aa3eaf1c None admin] PATH_INFO: `/v3/services` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:56.678204 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994aefda-00e7-4bee-b2d1-0397aa3eaf1c None admin] RBAC: Adding query filter params (type=image) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:56.678693 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994aefda-00e7-4bee-b2d1-0397aa3eaf1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:56.681135 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994aefda-00e7-4bee-b2d1-0397aa3eaf1c None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:56.690225 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 527/1046] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:15:56 2022] GET /identity/v3/services?type=image => generated 350 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:15:56.697195 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994aefda-00e7-4bee-b2d1-0397aa3eaf1c None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:56.723706 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52088779-e8f0-4db1-883b-c47e013d1af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:56.724385 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52088779-e8f0-4db1-883b-c47e013d1af0 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:56.724724 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52088779-e8f0-4db1-883b-c47e013d1af0 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:56.725000 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52088779-e8f0-4db1-883b-c47e013d1af0 None admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:56.725669 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52088779-e8f0-4db1-883b-c47e013d1af0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:56.725976 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52088779-e8f0-4db1-883b-c47e013d1af0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:56.727411 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52088779-e8f0-4db1-883b-c47e013d1af0 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:56.747872 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 520/1047] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:15:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:15:56.753916 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52088779-e8f0-4db1-883b-c47e013d1af0 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:56.803471 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:56.862990 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994aefda-00e7-4bee-b2d1-0397aa3eaf1c None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:56.877921 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:56.906731 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52088779-e8f0-4db1-883b-c47e013d1af0 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:56.914904 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4d54d-c5ea-4a9c-bf00-b540f5ca07a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:56.915541 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4d54d-c5ea-4a9c-bf00-b540f5ca07a4 None admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:56.915819 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4d54d-c5ea-4a9c-bf00-b540f5ca07a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:56.916286 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4d54d-c5ea-4a9c-bf00-b540f5ca07a4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:56.917109 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa4d54d-c5ea-4a9c-bf00-b540f5ca07a4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:56.918917 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa4d54d-c5ea-4a9c-bf00-b540f5ca07a4 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:56.957774 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 528/1048] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:15:56 2022] POST /identity/v3/endpoints => generated 327 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:15:56.957774 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032149a7-e48b-4ae6-b610-a971921dab20 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:56.957774 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032149a7-e48b-4ae6-b610-a971921dab20 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:56.957774 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032149a7-e48b-4ae6-b610-a971921dab20 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:56.957774 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 529/1049] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:15:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:15:56.959707 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8aeeb-b0ee-48a5-809b-50de1fd92259 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:56.960654 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8aeeb-b0ee-48a5-809b-50de1fd92259 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:56.960654 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8aeeb-b0ee-48a5-809b-50de1fd92259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:56.968101 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955509a0-729c-42bc-a562-ff660da088a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:56.969033 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955509a0-729c-42bc-a562-ff660da088a6 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:56.969456 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955509a0-729c-42bc-a562-ff660da088a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:56.969901 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955509a0-729c-42bc-a562-ff660da088a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:56.979413 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955509a0-729c-42bc-a562-ff660da088a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:56.981253 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955509a0-729c-42bc-a562-ff660da088a6 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:56.982291 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-a4e8aeeb-b0ee-48a5-809b-50de1fd92259 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:56.983612 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-a4e8aeeb-b0ee-48a5-809b-50de1fd92259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:56.996318 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-955509a0-729c-42bc-a562-ff660da088a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:15:56.996318 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:56.996318 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:56.996318 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:56.996318 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:56.996318 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:56.996318 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:56.996318 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:56.996318 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:56.996318 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:56.996318 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:56.996318 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:56.996318 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:15:56.996318 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:15:56.996318 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:15:56.998215 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:15:56.998215 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:56.998215 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:56.998215 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:56.998215 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:56.998215 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:56.998215 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:56.998215 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:56.998215 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:56.998215 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:56.998215 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:56.998215 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:56.998215 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:56.998215 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:56.998215 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:56.998215 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:56.998215 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:57.001623 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:15:57.001623 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:15:57.001623 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:15:57.001623 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:15:57.001623 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:15:57.001623 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:15:57.001623 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:15:57.001623 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:57.001623 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 521/1050] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 30 04:15:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:15:57.008167 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955509a0-729c-42bc-a562-ff660da088a6 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:57.089434 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 530/1051] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:15:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 04:15:57.148798 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955509a0-729c-42bc-a562-ff660da088a6 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:57.204981 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cefcbba-252d-4e1f-9a8a-5d32034e0535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:57.206056 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cefcbba-252d-4e1f-9a8a-5d32034e0535 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:57.206563 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cefcbba-252d-4e1f-9a8a-5d32034e0535 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:57.207051 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cefcbba-252d-4e1f-9a8a-5d32034e0535 None admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:57.208452 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cefcbba-252d-4e1f-9a8a-5d32034e0535 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:57.209001 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cefcbba-252d-4e1f-9a8a-5d32034e0535 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:57.211733 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cefcbba-252d-4e1f-9a8a-5d32034e0535 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:57.215615 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:57.233285 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 522/1052] 10.222.0.91 () {56 vars in 1148 bytes} [Tue Aug 30 04:15:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:15:57.242535 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e8aeeb-b0ee-48a5-809b-50de1fd92259 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:57.309797 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:57.362879 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cefcbba-252d-4e1f-9a8a-5d32034e0535 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:57.398234 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e8aeeb-b0ee-48a5-809b-50de1fd92259 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:57.454601 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d714e1-011b-4f97-b7d8-ce31964c7e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:57.455387 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d714e1-011b-4f97-b7d8-ce31964c7e14 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:57.455749 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d714e1-011b-4f97-b7d8-ce31964c7e14 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:57.456142 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d714e1-011b-4f97-b7d8-ce31964c7e14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:57.457047 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d714e1-011b-4f97-b7d8-ce31964c7e14 None admin] RBAC: Adding query filter params (role.id=d110827932ac4a4db66e89e29c8b6115, scope.project.id=4e05769361674c8fa995050150ad4cfa, user.id=d806295278ae4997b5c6968aa553290c) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:57.457463 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d714e1-011b-4f97-b7d8-ce31964c7e14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:57.459348 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d714e1-011b-4f97-b7d8-ce31964c7e14 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:57.467325 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 531/1053] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 30 04:15:57 2022] GET /identity/v3/role_assignments?user.id=d806295278ae4997b5c6968aa553290c&scope.project.id=4e05769361674c8fa995050150ad4cfa&role.id=d110827932ac4a4db66e89e29c8b6115 => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:57.529268 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cefcbba-252d-4e1f-9a8a-5d32034e0535 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:57.576417 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c133b78-dc60-4b5b-86c2-3c764a096e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:57.577199 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c133b78-dc60-4b5b-86c2-3c764a096e6c None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:57.577532 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c133b78-dc60-4b5b-86c2-3c764a096e6c None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:57.577867 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c133b78-dc60-4b5b-86c2-3c764a096e6c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:57.592059 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c133b78-dc60-4b5b-86c2-3c764a096e6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:15:57.597540 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-8c133b78-dc60-4b5b-86c2-3c764a096e6c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:15:57.597540 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:15:57.597540 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:15:57.597540 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:15:57.597540 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:15:57.597540 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:15:57.597540 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:15:57.597540 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:15:57.597540 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:15:57.597540 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:15:57.597540 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:15:57.597540 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:15:57.597540 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:15:57.597540 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:15:57.597540 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:15:57.597540 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:15:57.599676 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:15:57.599676 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:15:57.599676 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:15:57.599676 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:15:57.599676 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:15:57.599676 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:15:57.599676 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:15:57.599676 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:15:57.599676 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:15:57.599676 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:15:57.599676 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:15:57.599676 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:15:57.599676 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:15:57.599676 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:15:57.599676 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:15:57.599676 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:15:57.600958 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:15:57.600958 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:15:57.600958 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:15:57.600958 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:15:57.600958 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:15:57.600958 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:15:57.600958 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:15:57.600958 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:15:57.600958 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:15:57.600958 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:15:57.600958 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:15:57.600958 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:15:57.604518 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 523/1054] 10.222.0.91 () {56 vars in 1096 bytes} [Tue Aug 30 04:15:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:15:57.606913 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d714e1-011b-4f97-b7d8-ce31964c7e14 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:57.750526 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d714e1-011b-4f97-b7d8-ce31964c7e14 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:57.758402 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:57.793841 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb117b84-102d-4b01-b40d-9ef9a261ea1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:57.794775 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb117b84-102d-4b01-b40d-9ef9a261ea1e None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:57.795266 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb117b84-102d-4b01-b40d-9ef9a261ea1e None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:57.795648 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb117b84-102d-4b01-b40d-9ef9a261ea1e None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:57.796457 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb117b84-102d-4b01-b40d-9ef9a261ea1e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:57.796850 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb117b84-102d-4b01-b40d-9ef9a261ea1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:57.798724 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb117b84-102d-4b01-b40d-9ef9a261ea1e None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:57.809971 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 532/1055] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 30 04:15:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:15:57.815929 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c133b78-dc60-4b5b-86c2-3c764a096e6c None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:57.875205 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:57.928013 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c133b78-dc60-4b5b-86c2-3c764a096e6c None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:57.971824 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46051206-05a3-4676-a163-e8c075fdbe88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:57.973117 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46051206-05a3-4676-a163-e8c075fdbe88 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:57.973583 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46051206-05a3-4676-a163-e8c075fdbe88 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:57.974136 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46051206-05a3-4676-a163-e8c075fdbe88 None admin] PATH_INFO: `/v3/users/4489784858c54a47911b30162067c419` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:58.000023 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46051206-05a3-4676-a163-e8c075fdbe88 None admin] RBAC: Authorizing `identity:get_user(user_id=4489784858c54a47911b30162067c419)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:58.002064 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46051206-05a3-4676-a163-e8c075fdbe88 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:58.009707 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 524/1056] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 30 04:15:57 2022] GET /identity/v3/users/4489784858c54a47911b30162067c419 => generated 285 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:58.011784 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb117b84-102d-4b01-b40d-9ef9a261ea1e None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:58.135753 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb117b84-102d-4b01-b40d-9ef9a261ea1e None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:58.192138 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c0b79-28d1-4a2d-a5d2-0e0173ef9876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:58.193194 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c0b79-28d1-4a2d-a5d2-0e0173ef9876 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:58.193478 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c0b79-28d1-4a2d-a5d2-0e0173ef9876 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:58.193752 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c0b79-28d1-4a2d-a5d2-0e0173ef9876 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:58.251617 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:58.317695 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815c0b79-28d1-4a2d-a5d2-0e0173ef9876 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:58.320340 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815c0b79-28d1-4a2d-a5d2-0e0173ef9876 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:58.454376 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 533/1057] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 30 04:15:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 04:15:58.460336 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46051206-05a3-4676-a163-e8c075fdbe88 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:58.572210 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46051206-05a3-4676-a163-e8c075fdbe88 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:58.586440 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:58.622399 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d623aa6-6719-4e18-8f1b-30704ee7944e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:58.623499 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d623aa6-6719-4e18-8f1b-30704ee7944e None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:58.624044 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d623aa6-6719-4e18-8f1b-30704ee7944e None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:58.624504 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d623aa6-6719-4e18-8f1b-30704ee7944e None admin] PATH_INFO: `/v3/projects/b355b6c6abec46159b248a518ed8e440` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:58.626570 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d623aa6-6719-4e18-8f1b-30704ee7944e None admin] RBAC: Authorizing `identity:get_project(project_id=b355b6c6abec46159b248a518ed8e440)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:58.629303 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d623aa6-6719-4e18-8f1b-30704ee7944e None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:58.636187 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 525/1058] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 30 04:15:58 2022] GET /identity/v3/projects/b355b6c6abec46159b248a518ed8e440 => generated 311 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:58.644066 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c0b79-28d1-4a2d-a5d2-0e0173ef9876 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:58.740970 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:58.786987 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c0b79-28d1-4a2d-a5d2-0e0173ef9876 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:58.862275 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5f9024-a282-488a-a679-f09e2c45e05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:58.863315 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f9024-a282-488a-a679-f09e2c45e05c None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:58.863849 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f9024-a282-488a-a679-f09e2c45e05c None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:58.864375 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f9024-a282-488a-a679-f09e2c45e05c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:58.865680 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5f9024-a282-488a-a679-f09e2c45e05c None admin] RBAC: Adding query filter params (role.id=d8f440a82947486ebb20a633ebee736b, scope.project.id=b355b6c6abec46159b248a518ed8e440, user.id=4489784858c54a47911b30162067c419) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:58.866244 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5f9024-a282-488a-a679-f09e2c45e05c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:58.869145 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5f9024-a282-488a-a679-f09e2c45e05c None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:58.884504 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 534/1059] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 30 04:15:58 2022] GET /identity/v3/role_assignments?user.id=4489784858c54a47911b30162067c419&scope.project.id=b355b6c6abec46159b248a518ed8e440&role.id=d8f440a82947486ebb20a633ebee736b => generated 259 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:59.319354 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b3934-c813-4223-8f1b-67834f978f4d None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:59.319952 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b3934-c813-4223-8f1b-67834f978f4d None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:59.320251 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b3934-c813-4223-8f1b-67834f978f4d None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:59.323870 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 526/1060] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:15:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:15:59.329564 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dffd23-e965-4e65-9fe8-d9d1994c80df None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:59.329976 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dffd23-e965-4e65-9fe8-d9d1994c80df None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:59.330132 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dffd23-e965-4e65-9fe8-d9d1994c80df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:59.349939 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-33dffd23-e965-4e65-9fe8-d9d1994c80df None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:59.351289 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-33dffd23-e965-4e65-9fe8-d9d1994c80df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:59.469102 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 535/1061] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:15:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 04:15:59.685300 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c8f7b-3471-4434-a93c-eb52c7f3bea6 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:59.685729 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c8f7b-3471-4434-a93c-eb52c7f3bea6 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:59.685875 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c8f7b-3471-4434-a93c-eb52c7f3bea6 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:59.687891 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 527/1062] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:15:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:15:59.693521 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef36949-5956-445e-bb0e-1ba70dc85384 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:59.693871 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef36949-5956-445e-bb0e-1ba70dc85384 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:59.694077 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef36949-5956-445e-bb0e-1ba70dc85384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:59.715676 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-4ef36949-5956-445e-bb0e-1ba70dc85384 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:59.717028 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-4ef36949-5956-445e-bb0e-1ba70dc85384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:59.785752 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:59.807796 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 536/1063] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:15:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:15:59.957990 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c8f7b-3471-4434-a93c-eb52c7f3bea6 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:00.092823 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c8f7b-3471-4434-a93c-eb52c7f3bea6 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:00.147040 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef36949-5956-445e-bb0e-1ba70dc85384 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:00.155556 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad84dd-c0d3-47d3-a9f9-492a21e711a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:00.157482 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad84dd-c0d3-47d3-a9f9-492a21e711a6 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:00.157966 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad84dd-c0d3-47d3-a9f9-492a21e711a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:00.158438 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad84dd-c0d3-47d3-a9f9-492a21e711a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:00.226858 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:00.256395 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ad84dd-c0d3-47d3-a9f9-492a21e711a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:00.258292 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ad84dd-c0d3-47d3-a9f9-492a21e711a6 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:00.276302 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef36949-5956-445e-bb0e-1ba70dc85384 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:00.345619 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1102f0-d63a-467d-90d0-3d680ef366f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:00.346845 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1102f0-d63a-467d-90d0-3d680ef366f9 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:00.347351 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1102f0-d63a-467d-90d0-3d680ef366f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:00.347830 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1102f0-d63a-467d-90d0-3d680ef366f9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:00.368080 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1102f0-d63a-467d-90d0-3d680ef366f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:16:00.378091 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-ae1102f0-d63a-467d-90d0-3d680ef366f9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 04:16:00.378091 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:16:00.378091 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:16:00.378091 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:16:00.378091 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:16:00.378091 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:16:00.378091 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:16:00.378091 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:16:00.378091 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:16:00.378091 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:16:00.378091 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:16:00.378091 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:16:00.378091 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:16:00.378091 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:16:00.378091 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:16:00.378091 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:16:00.379147 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:16:00.379147 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:16:00.379147 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:16:00.379147 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:16:00.379147 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:16:00.379147 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:16:00.379147 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:16:00.379147 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:16:00.379147 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:16:00.379147 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:16:00.379147 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:16:00.379147 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:16:00.379147 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:16:00.379147 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:16:00.379147 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:16:00.379147 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:16:00.380055 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:16:00.380055 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:16:00.380055 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:16:00.380055 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:16:00.380055 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:16:00.380055 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:16:00.380055 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:16:00.380055 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:16:00.380055 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:16:00.380055 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:16:00.380055 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 04:16:00.380055 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:16:00.380743 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 537/1064] 10.222.0.91 () {56 vars in 1120 bytes} [Tue Aug 30 04:16:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:16:00.390984 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1102f0-d63a-467d-90d0-3d680ef366f9 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:00.406596 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 528/1065] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 30 04:15:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 04:16:00.412503 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad84dd-c0d3-47d3-a9f9-492a21e711a6 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:00.497937 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:00.536037 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:00.565629 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad84dd-c0d3-47d3-a9f9-492a21e711a6 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:00.592903 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1102f0-d63a-467d-90d0-3d680ef366f9 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:00.635436 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56198fd3-70b3-49be-9bd6-f5848f7b224e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:00.636639 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56198fd3-70b3-49be-9bd6-f5848f7b224e None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:00.637524 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56198fd3-70b3-49be-9bd6-f5848f7b224e None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:00.638087 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56198fd3-70b3-49be-9bd6-f5848f7b224e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:00.645986 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eacf3c-557f-4ba8-8a47-b10ec8fcbc82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:00.646615 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eacf3c-557f-4ba8-8a47-b10ec8fcbc82 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:00.646885 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eacf3c-557f-4ba8-8a47-b10ec8fcbc82 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:00.647149 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eacf3c-557f-4ba8-8a47-b10ec8fcbc82 None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:00.647834 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eacf3c-557f-4ba8-8a47-b10ec8fcbc82 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:16:00.648355 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eacf3c-557f-4ba8-8a47-b10ec8fcbc82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:00.649555 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eacf3c-557f-4ba8-8a47-b10ec8fcbc82 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:00.660980 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56198fd3-70b3-49be-9bd6-f5848f7b224e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:00.661223 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 538/1066] 10.222.0.91 () {56 vars in 1115 bytes} [Tue Aug 30 04:16:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:16:00.670158 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56198fd3-70b3-49be-9bd6-f5848f7b224e None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:00.671696 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eacf3c-557f-4ba8-8a47-b10ec8fcbc82 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:00.688261 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-56198fd3-70b3-49be-9bd6-f5848f7b224e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:16:00.688261 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:16:00.688261 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:16:00.688261 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:16:00.688261 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:16:00.688261 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:16:00.688261 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:16:00.688261 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:16:00.688261 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:16:00.688261 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:16:00.688261 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:16:00.688261 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:16:00.688261 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:16:00.688261 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:16:00.688261 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:16:00.688261 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:16:00.690196 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:16:00.690196 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:16:00.690196 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:16:00.690196 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:16:00.690196 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:16:00.690196 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:16:00.690196 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:16:00.690196 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:16:00.690196 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:16:00.690196 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:16:00.690196 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:16:00.690196 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:16:00.690196 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:16:00.690196 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:16:00.690196 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:16:00.690196 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:16:00.690196 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:16:00.692139 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:16:00.692139 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:16:00.692139 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:16:00.694861 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 529/1067] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:16:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:16:00.695378 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56198fd3-70b3-49be-9bd6-f5848f7b224e None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:00.824199 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eacf3c-557f-4ba8-8a47-b10ec8fcbc82 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:00.844842 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:00.882628 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad3624-a044-4205-a373-923b52081be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:00.883008 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56198fd3-70b3-49be-9bd6-f5848f7b224e None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:00.883639 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad3624-a044-4205-a373-923b52081be4 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:00.884098 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad3624-a044-4205-a373-923b52081be4 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:00.884482 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad3624-a044-4205-a373-923b52081be4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:00.901356 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ad3624-a044-4205-a373-923b52081be4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:00.903132 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ad3624-a044-4205-a373-923b52081be4 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:00.920433 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-84ad3624-a044-4205-a373-923b52081be4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:16:00.920433 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:16:00.920433 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:16:00.920433 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:16:00.920433 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:16:00.920433 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:16:00.920433 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:16:00.920433 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:16:00.920433 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:16:00.920433 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:16:00.920433 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:16:00.920433 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:16:00.920433 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:16:00.920433 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:16:00.920433 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:16:00.920433 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:16:00.922350 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:16:00.922350 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:16:00.922350 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:16:00.922350 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:16:00.922350 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:16:00.922350 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:16:00.922350 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:16:00.922350 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:16:00.922350 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:16:00.922350 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:16:00.922350 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:16:00.922350 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:16:00.922350 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:16:00.922350 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:16:00.922350 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:16:00.922350 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:16:00.922350 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:16:00.923828 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:16:00.923828 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:16:00.923828 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:16:00.926567 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 539/1068] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:16:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:16:00.928167 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad3624-a044-4205-a373-923b52081be4 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:00.939186 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:00.945140 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d858d-a91e-4b58-aff5-34a0e6d8b60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:00.945748 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d858d-a91e-4b58-aff5-34a0e6d8b60f None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:00.946035 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d858d-a91e-4b58-aff5-34a0e6d8b60f None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:00.946402 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d858d-a91e-4b58-aff5-34a0e6d8b60f None admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:00.947058 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046d858d-a91e-4b58-aff5-34a0e6d8b60f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:16:00.947859 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046d858d-a91e-4b58-aff5-34a0e6d8b60f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:00.949578 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046d858d-a91e-4b58-aff5-34a0e6d8b60f None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:00.967306 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 530/1069] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:16:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:16:00.969331 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2c210-1843-43c6-9539-b0f137f39ec9 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:00.969809 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2c210-1843-43c6-9539-b0f137f39ec9 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:00.970285 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2c210-1843-43c6-9539-b0f137f39ec9 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:00.972637 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 531/1070] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:16:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:16:00.979043 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e14140-88b5-40c4-8818-9128dc7b8733 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:00.979488 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e14140-88b5-40c4-8818-9128dc7b8733 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:00.979878 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e14140-88b5-40c4-8818-9128dc7b8733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:01.001967 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-83e14140-88b5-40c4-8818-9128dc7b8733 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:01.003485 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-83e14140-88b5-40c4-8818-9128dc7b8733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:01.096760 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad3624-a044-4205-a373-923b52081be4 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:01.116400 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 532/1071] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:16:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 04:16:01.149868 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e96b3e-7de7-4c0a-9a38-4e7aac2d03ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:01.151375 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e96b3e-7de7-4c0a-9a38-4e7aac2d03ef None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:01.151375 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e96b3e-7de7-4c0a-9a38-4e7aac2d03ef None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:01.151375 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e96b3e-7de7-4c0a-9a38-4e7aac2d03ef None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:01.151978 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e96b3e-7de7-4c0a-9a38-4e7aac2d03ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:16:01.152238 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e96b3e-7de7-4c0a-9a38-4e7aac2d03ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:01.153669 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e96b3e-7de7-4c0a-9a38-4e7aac2d03ef None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:01.176982 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 540/1072] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:16:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:16:01.186040 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e14140-88b5-40c4-8818-9128dc7b8733 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:01.395090 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e14140-88b5-40c4-8818-9128dc7b8733 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:01.441398 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:01.442217 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e96b3e-7de7-4c0a-9a38-4e7aac2d03ef None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:01.463305 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a902698-3f74-4495-a098-e9b50b512968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:01.464429 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a902698-3f74-4495-a098-e9b50b512968 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:01.464908 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a902698-3f74-4495-a098-e9b50b512968 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:01.465354 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a902698-3f74-4495-a098-e9b50b512968 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:01.473607 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:01.479598 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a902698-3f74-4495-a098-e9b50b512968 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:01.482485 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a902698-3f74-4495-a098-e9b50b512968 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:01.507342 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-2a902698-3f74-4495-a098-e9b50b512968 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 04:16:01.507342 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:16:01.507342 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:16:01.507342 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:16:01.507342 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:16:01.507342 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:16:01.507342 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:16:01.507342 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:16:01.507342 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:16:01.507342 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:16:01.507342 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:16:01.507342 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:16:01.507342 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:16:01.507342 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:16:01.507342 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:16:01.507342 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:16:01.508628 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:16:01.508628 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:16:01.508628 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:16:01.508628 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:16:01.508628 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:16:01.508628 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:16:01.508628 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:16:01.508628 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:16:01.508628 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:16:01.508628 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:16:01.508628 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:16:01.508628 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:16:01.508628 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:16:01.508628 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:16:01.508628 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:16:01.508628 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:16:01.508628 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:16:01.508628 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:16:01.509591 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:16:01.509591 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:16:01.509591 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:16:01.509591 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:16:01.509591 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:16:01.509591 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:16:01.509591 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:16:01.509591 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:16:01.509591 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 04:16:01.509591 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:16:01.509591 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 533/1073] 10.222.0.91 () {56 vars in 1093 bytes} [Tue Aug 30 04:16:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:16:01.519700 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a902698-3f74-4495-a098-e9b50b512968 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:01.560252 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e96b3e-7de7-4c0a-9a38-4e7aac2d03ef None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:01.601069 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6816ba9c-70f3-4d3e-90d2-af2e6a3ab85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:01.601730 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816ba9c-70f3-4d3e-90d2-af2e6a3ab85a None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:01.602040 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816ba9c-70f3-4d3e-90d2-af2e6a3ab85a None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:01.602273 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816ba9c-70f3-4d3e-90d2-af2e6a3ab85a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:01.615752 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6816ba9c-70f3-4d3e-90d2-af2e6a3ab85a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:16:01.620873 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-6816ba9c-70f3-4d3e-90d2-af2e6a3ab85a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:16:01.620873 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:16:01.620873 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:16:01.620873 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:16:01.620873 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:16:01.620873 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:16:01.620873 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:16:01.620873 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:16:01.620873 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:16:01.620873 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:16:01.620873 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:16:01.620873 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:16:01.620873 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:16:01.620873 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:16:01.620873 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:16:01.620873 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:16:01.621906 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:16:01.621906 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:16:01.621906 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:16:01.621906 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:16:01.621906 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:16:01.621906 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:16:01.621906 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:16:01.621906 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:16:01.621906 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:16:01.621906 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:16:01.621906 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:16:01.621906 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:16:01.621906 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:16:01.621906 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:16:01.621906 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:16:01.621906 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:16:01.623441 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:16:01.623441 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:16:01.623441 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:16:01.623441 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:16:01.623441 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:16:01.623441 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:16:01.623441 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:16:01.623441 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:16:01.623441 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:16:01.623441 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:16:01.623441 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:16:01.623441 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:16:01.623441 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 541/1074] 10.222.0.91 () {56 vars in 1096 bytes} [Tue Aug 30 04:16:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:16:01.630521 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6816ba9c-70f3-4d3e-90d2-af2e6a3ab85a None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:01.688386 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a902698-3f74-4495-a098-e9b50b512968 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:01.751237 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:01.753318 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358758bb-9e17-44cc-a0c1-cfdf80021e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:01.754426 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358758bb-9e17-44cc-a0c1-cfdf80021e68 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:01.754923 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358758bb-9e17-44cc-a0c1-cfdf80021e68 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:01.755390 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358758bb-9e17-44cc-a0c1-cfdf80021e68 None admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:01.756802 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358758bb-9e17-44cc-a0c1-cfdf80021e68 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:16:01.757315 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358758bb-9e17-44cc-a0c1-cfdf80021e68 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:01.760093 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358758bb-9e17-44cc-a0c1-cfdf80021e68 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:01.770373 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6816ba9c-70f3-4d3e-90d2-af2e6a3ab85a None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:01.796302 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 534/1075] 10.222.0.91 () {56 vars in 1133 bytes} [Tue Aug 30 04:16:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:16:01.802736 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358758bb-9e17-44cc-a0c1-cfdf80021e68 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:01.818079 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e078a6-35e9-44d1-b2ae-0357cc81812a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:01.818725 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e078a6-35e9-44d1-b2ae-0357cc81812a None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:01.819004 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e078a6-35e9-44d1-b2ae-0357cc81812a None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:01.819284 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e078a6-35e9-44d1-b2ae-0357cc81812a None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:01.820026 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e078a6-35e9-44d1-b2ae-0357cc81812a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:16:01.820387 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e078a6-35e9-44d1-b2ae-0357cc81812a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:01.821903 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e078a6-35e9-44d1-b2ae-0357cc81812a None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:01.836981 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 542/1076] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 30 04:16:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:16:01.838421 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e078a6-35e9-44d1-b2ae-0357cc81812a None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:01.882966 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:01.959239 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358758bb-9e17-44cc-a0c1-cfdf80021e68 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:01.976555 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e078a6-35e9-44d1-b2ae-0357cc81812a None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:02.003671 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b3dd51-9455-4dc5-846d-af53d271eabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:02.004791 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3dd51-9455-4dc5-846d-af53d271eabb None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:02.005264 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3dd51-9455-4dc5-846d-af53d271eabb None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:02.005701 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3dd51-9455-4dc5-846d-af53d271eabb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:02.019191 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b3dd51-9455-4dc5-846d-af53d271eabb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:02.020772 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b3dd51-9455-4dc5-846d-af53d271eabb None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:02.026069 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3c87f8-0676-4b8a-80dd-1330a30ec8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:02.027124 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c87f8-0676-4b8a-80dd-1330a30ec8e8 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:02.027565 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c87f8-0676-4b8a-80dd-1330a30ec8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:02.028122 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c87f8-0676-4b8a-80dd-1330a30ec8e8 None admin] PATH_INFO: `/v3/users/4489784858c54a47911b30162067c419` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:02.030140 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3c87f8-0676-4b8a-80dd-1330a30ec8e8 None admin] RBAC: Authorizing `identity:get_user(user_id=4489784858c54a47911b30162067c419)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:02.032766 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3c87f8-0676-4b8a-80dd-1330a30ec8e8 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:02.039469 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 543/1077] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 30 04:16:01 2022] GET /identity/v3/users/4489784858c54a47911b30162067c419 => generated 285 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:16:02.039702 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-70b3dd51-9455-4dc5-846d-af53d271eabb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:16:02.039702 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:16:02.039702 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:16:02.039702 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:16:02.039702 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:16:02.039702 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:16:02.039702 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:16:02.039702 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:16:02.039702 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:16:02.039702 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:16:02.039702 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:16:02.039702 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:16:02.039702 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:16:02.039702 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:16:02.039702 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:16:02.039702 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:16:02.040880 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:16:02.040880 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:16:02.040880 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:16:02.040880 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:16:02.040880 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:16:02.040880 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:16:02.040880 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:16:02.040880 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:16:02.040880 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:16:02.040880 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:16:02.040880 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:16:02.040880 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:16:02.040880 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:16:02.040880 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:16:02.040880 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:16:02.040880 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:16:02.040880 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:16:02.042859 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:16:02.042859 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:16:02.042859 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:16:02.042859 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 535/1078] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:16:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:16:02.043673 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3c87f8-0676-4b8a-80dd-1330a30ec8e8 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:02.046010 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b3dd51-9455-4dc5-846d-af53d271eabb None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:02.064461 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:02.173232 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3c87f8-0676-4b8a-80dd-1330a30ec8e8 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:02.183056 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:02.193511 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b3dd51-9455-4dc5-846d-af53d271eabb None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:02.232904 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa5fb3-27af-4697-ac3c-7f69b34dd51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:02.233433 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa5fb3-27af-4697-ac3c-7f69b34dd51b None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:02.233707 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa5fb3-27af-4697-ac3c-7f69b34dd51b None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:02.233975 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa5fb3-27af-4697-ac3c-7f69b34dd51b None admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:02.234624 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caa5fb3-27af-4697-ac3c-7f69b34dd51b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:16:02.234921 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caa5fb3-27af-4697-ac3c-7f69b34dd51b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:02.235339 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb50c01-ddfc-4665-b389-be3bb740b85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:02.236448 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb50c01-ddfc-4665-b389-be3bb740b85d None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:02.236623 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caa5fb3-27af-4697-ac3c-7f69b34dd51b None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:02.236941 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb50c01-ddfc-4665-b389-be3bb740b85d None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:02.237421 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb50c01-ddfc-4665-b389-be3bb740b85d None admin] PATH_INFO: `/v3/projects/b355b6c6abec46159b248a518ed8e440` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:02.239813 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb50c01-ddfc-4665-b389-be3bb740b85d None admin] RBAC: Authorizing `identity:get_project(project_id=b355b6c6abec46159b248a518ed8e440)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:02.242562 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb50c01-ddfc-4665-b389-be3bb740b85d None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:02.246025 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 544/1079] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 30 04:16:02 2022] GET /identity/v3/projects/b355b6c6abec46159b248a518ed8e440 => generated 311 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:16:02.250691 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 536/1080] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:16:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:16:02.252708 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb50c01-ddfc-4665-b389-be3bb740b85d None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:02.260217 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa5fb3-27af-4697-ac3c-7f69b34dd51b None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:02.373488 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:02.395778 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb50c01-ddfc-4665-b389-be3bb740b85d None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:02.404588 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa5fb3-27af-4697-ac3c-7f69b34dd51b None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:02.447359 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7b740-97e9-4681-ba83-a5cc5efb4e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:02.448090 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7b740-97e9-4681-ba83-a5cc5efb4e11 None admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:02.448371 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7b740-97e9-4681-ba83-a5cc5efb4e11 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:02.448747 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7b740-97e9-4681-ba83-a5cc5efb4e11 None admin] PATH_INFO: `/v3/projects/b355b6c6abec46159b248a518ed8e440/users/4489784858c54a47911b30162067c419/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:02.450802 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c7b740-97e9-4681-ba83-a5cc5efb4e11 None admin] RBAC: Authorizing `identity:create_grant(project_id=b355b6c6abec46159b248a518ed8e440, user_id=4489784858c54a47911b30162067c419, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:02.452330 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c7b740-97e9-4681-ba83-a5cc5efb4e11 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:02.452849 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc3c30-844a-4045-99e6-97ab743bf729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:02.453901 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc3c30-844a-4045-99e6-97ab743bf729 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:02.454359 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc3c30-844a-4045-99e6-97ab743bf729 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:02.454823 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc3c30-844a-4045-99e6-97ab743bf729 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:02.468285 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bc3c30-844a-4045-99e6-97ab743bf729 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:02.468538 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 545/1081] 10.222.0.91 () {58 vars in 1439 bytes} [Tue Aug 30 04:16:02 2022] PUT /identity/v3/projects/b355b6c6abec46159b248a518ed8e440/users/4489784858c54a47911b30162067c419/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:02.471150 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bc3c30-844a-4045-99e6-97ab743bf729 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:02.495587 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-d8bc3c30-844a-4045-99e6-97ab743bf729 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:16:02.495587 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:16:02.495587 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:16:02.495587 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:16:02.495587 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:16:02.495587 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:16:02.495587 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:16:02.495587 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:16:02.495587 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:16:02.495587 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:16:02.495587 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:16:02.495587 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:16:02.495587 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:16:02.495587 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:16:02.495587 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:16:02.497259 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:16:02.497259 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:16:02.497259 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:16:02.497259 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:16:02.497259 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:16:02.497259 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:16:02.497259 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:16:02.497259 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:16:02.497259 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:16:02.497259 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:16:02.497259 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:16:02.497259 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:16:02.497259 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:16:02.497259 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:16:02.497259 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:16:02.497259 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:16:02.497259 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:16:02.499503 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:16:02.499503 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:16:02.499503 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:16:02.499503 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:16:02.499503 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:16:02.499503 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:16:02.499503 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:16:02.499503 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:16:02.504264 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 537/1082] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 30 04:16:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:16:02.508124 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7b740-97e9-4681-ba83-a5cc5efb4e11 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:02.668824 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7b740-97e9-4681-ba83-a5cc5efb4e11 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:02.711164 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f9d8a2-2a5d-4e6e-950d-12b2732ad4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:02.711790 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9d8a2-2a5d-4e6e-950d-12b2732ad4ef None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:02.712104 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9d8a2-2a5d-4e6e-950d-12b2732ad4ef None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:02.712378 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9d8a2-2a5d-4e6e-950d-12b2732ad4ef None admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:02.713182 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f9d8a2-2a5d-4e6e-950d-12b2732ad4ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:16:02.714181 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f9d8a2-2a5d-4e6e-950d-12b2732ad4ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:02.715685 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f9d8a2-2a5d-4e6e-950d-12b2732ad4ef None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:02.738286 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 546/1083] 10.222.0.91 () {56 vars in 1148 bytes} [Tue Aug 30 04:16:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:16:02.739760 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc3c30-844a-4045-99e6-97ab743bf729 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:02.760396 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:02.913513 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc3c30-844a-4045-99e6-97ab743bf729 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:02.957149 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f1864-1551-416e-8817-05db7d5949cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:02.957803 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f1864-1551-416e-8817-05db7d5949cd None admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:02.958077 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f1864-1551-416e-8817-05db7d5949cd None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:02.958348 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f1864-1551-416e-8817-05db7d5949cd None admin] PATH_INFO: `/v3/projects/4e05769361674c8fa995050150ad4cfa/users/d806295278ae4997b5c6968aa553290c/roles/d110827932ac4a4db66e89e29c8b6115` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:02.960744 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8f1864-1551-416e-8817-05db7d5949cd None admin] RBAC: Authorizing `identity:create_grant(project_id=4e05769361674c8fa995050150ad4cfa, user_id=d806295278ae4997b5c6968aa553290c, role_id=d110827932ac4a4db66e89e29c8b6115)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:02.962241 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8f1864-1551-416e-8817-05db7d5949cd None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:02.984894 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 538/1084] 10.222.0.91 () {58 vars in 1439 bytes} [Tue Aug 30 04:16:02 2022] PUT /identity/v3/projects/4e05769361674c8fa995050150ad4cfa/users/d806295278ae4997b5c6968aa553290c/roles/d110827932ac4a4db66e89e29c8b6115 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:04.564988 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec3619-26e2-408a-8946-69d395610489 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:04.565547 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec3619-26e2-408a-8946-69d395610489 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:04.565547 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec3619-26e2-408a-8946-69d395610489 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:04.566898 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 547/1085] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:16:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:16:04.576632 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d36d55b-d9a2-4f97-8719-0d0b51edd9eb None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:04.577300 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d36d55b-d9a2-4f97-8719-0d0b51edd9eb None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:04.577300 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d36d55b-d9a2-4f97-8719-0d0b51edd9eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:04.597774 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-8d36d55b-d9a2-4f97-8719-0d0b51edd9eb None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:04.599054 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-8d36d55b-d9a2-4f97-8719-0d0b51edd9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:04.685495 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 539/1086] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:16:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:16:04.952823 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec3619-26e2-408a-8946-69d395610489 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:04.959389 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:05.020871 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76495d97-adf1-4ba1-83b4-bd7a94ee86cb None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:05.021205 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76495d97-adf1-4ba1-83b4-bd7a94ee86cb None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:05.021568 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76495d97-adf1-4ba1-83b4-bd7a94ee86cb None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:05.023868 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 540/1087] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:16:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:16:05.033079 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a4afe-691a-40b5-9e03-37a1492bfdac None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:05.033576 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a4afe-691a-40b5-9e03-37a1492bfdac None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:05.034081 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a4afe-691a-40b5-9e03-37a1492bfdac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:05.043342 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:05.062790 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-8c6a4afe-691a-40b5-9e03-37a1492bfdac None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:05.064298 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-8c6a4afe-691a-40b5-9e03-37a1492bfdac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:05.119218 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec3619-26e2-408a-8946-69d395610489 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:05.159624 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 541/1088] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:16:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 04:16:05.172303 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461dec0e-79be-4f4b-b0d9-17db8fa1fb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:05.173374 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461dec0e-79be-4f4b-b0d9-17db8fa1fb76 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:05.173837 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461dec0e-79be-4f4b-b0d9-17db8fa1fb76 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:05.174306 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461dec0e-79be-4f4b-b0d9-17db8fa1fb76 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:05.194359 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461dec0e-79be-4f4b-b0d9-17db8fa1fb76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:16:05.204388 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-461dec0e-79be-4f4b-b0d9-17db8fa1fb76 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:16:05.204388 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:16:05.204388 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:16:05.204388 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:16:05.204388 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:16:05.204388 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:16:05.204388 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:16:05.204388 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:16:05.204388 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:16:05.204388 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:16:05.204388 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:16:05.204388 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:16:05.204388 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:16:05.204388 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:16:05.204388 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:16:05.204388 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:16:05.205711 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:16:05.205711 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:16:05.205711 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:16:05.205711 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:16:05.205711 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:16:05.205711 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:16:05.205711 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:16:05.205711 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:16:05.205711 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:16:05.205711 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:16:05.205711 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:16:05.205711 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:16:05.205711 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:16:05.205711 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:16:05.205711 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:16:05.205711 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:16:05.206791 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:16:05.206791 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:16:05.206791 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:16:05.206791 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:16:05.206791 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:16:05.206791 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:16:05.206791 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:16:05.206791 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:16:05.206791 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:16:05.206791 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:16:05.206791 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:16:05.206791 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:16:05.206791 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 548/1089] 10.222.0.91 () {56 vars in 1096 bytes} [Tue Aug 30 04:16:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:16:05.215500 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a4afe-691a-40b5-9e03-37a1492bfdac None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:05.365666 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a4afe-691a-40b5-9e03-37a1492bfdac None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:05.404197 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:05.411234 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f385c-9664-4bf8-a193-084e532305a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:05.411890 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f385c-9664-4bf8-a193-084e532305a0 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:05.412241 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f385c-9664-4bf8-a193-084e532305a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:05.412542 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f385c-9664-4bf8-a193-084e532305a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:05.413282 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664f385c-9664-4bf8-a193-084e532305a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:16:05.413620 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664f385c-9664-4bf8-a193-084e532305a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:05.415115 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664f385c-9664-4bf8-a193-084e532305a0 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:05.426563 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 542/1090] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 30 04:16:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:16:05.433605 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461dec0e-79be-4f4b-b0d9-17db8fa1fb76 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:05.462539 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f385c-9664-4bf8-a193-084e532305a0 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:05.515334 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:05.564810 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461dec0e-79be-4f4b-b0d9-17db8fa1fb76 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:05.601093 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f385c-9664-4bf8-a193-084e532305a0 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:05.605815 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338502bd-ace9-423c-94d6-38a5d6797381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:05.606452 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338502bd-ace9-423c-94d6-38a5d6797381 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:05.606750 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338502bd-ace9-423c-94d6-38a5d6797381 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:05.607032 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338502bd-ace9-423c-94d6-38a5d6797381 None admin] PATH_INFO: `/v3/users/4489784858c54a47911b30162067c419` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:05.608483 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338502bd-ace9-423c-94d6-38a5d6797381 None admin] RBAC: Authorizing `identity:get_user(user_id=4489784858c54a47911b30162067c419)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:05.610142 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338502bd-ace9-423c-94d6-38a5d6797381 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:05.612201 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 549/1091] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 30 04:16:05 2022] GET /identity/v3/users/4489784858c54a47911b30162067c419 => generated 285 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:16:05.621189 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338502bd-ace9-423c-94d6-38a5d6797381 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:05.657772 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f5c17-ee47-428e-87d4-1b1f874b9b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:05.658424 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f5c17-ee47-428e-87d4-1b1f874b9b36 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:05.658688 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f5c17-ee47-428e-87d4-1b1f874b9b36 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:05.658957 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f5c17-ee47-428e-87d4-1b1f874b9b36 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:05.672718 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8f5c17-ee47-428e-87d4-1b1f874b9b36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:16:05.677717 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-ba8f5c17-ee47-428e-87d4-1b1f874b9b36 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 04:16:05.677717 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:16:05.677717 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:16:05.677717 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:16:05.677717 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:16:05.677717 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:16:05.677717 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:16:05.677717 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:16:05.677717 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:16:05.677717 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:16:05.677717 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:16:05.677717 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:16:05.677717 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:16:05.677717 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:16:05.677717 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:16:05.677717 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:16:05.679658 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:16:05.679658 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:16:05.679658 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:16:05.679658 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:16:05.679658 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:16:05.679658 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:16:05.679658 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:16:05.679658 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:16:05.679658 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:16:05.679658 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:16:05.679658 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:16:05.679658 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:16:05.679658 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:16:05.679658 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:16:05.679658 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:16:05.679658 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:16:05.681218 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:16:05.681218 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:16:05.681218 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:16:05.681218 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:16:05.681218 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:16:05.681218 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:16:05.681218 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:16:05.681218 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:16:05.681218 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:16:05.681218 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:16:05.681218 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 04:16:05.681218 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:16:05.681218 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 543/1092] 10.222.0.91 () {56 vars in 1120 bytes} [Tue Aug 30 04:16:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:16:05.689255 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f5c17-ee47-428e-87d4-1b1f874b9b36 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:05.756490 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:05.762059 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338502bd-ace9-423c-94d6-38a5d6797381 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:05.800771 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:05.807514 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b8fbd-8095-487b-9905-9b2cca91bf6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:05.808189 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b8fbd-8095-487b-9905-9b2cca91bf6a None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:05.808602 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b8fbd-8095-487b-9905-9b2cca91bf6a None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:05.808815 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b8fbd-8095-487b-9905-9b2cca91bf6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:05.827747 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f5c17-ee47-428e-87d4-1b1f874b9b36 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:05.895539 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7c822-9711-4523-a5c5-1fe90bf86c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:05.896353 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7c822-9711-4523-a5c5-1fe90bf86c8b None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:05.896722 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7c822-9711-4523-a5c5-1fe90bf86c8b None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:05.897225 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7c822-9711-4523-a5c5-1fe90bf86c8b None admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:05.898076 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db7c822-9711-4523-a5c5-1fe90bf86c8b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:16:05.898497 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db7c822-9711-4523-a5c5-1fe90bf86c8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:05.900279 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db7c822-9711-4523-a5c5-1fe90bf86c8b None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:05.901657 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b8fbd-8095-487b-9905-9b2cca91bf6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:05.903451 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b8fbd-8095-487b-9905-9b2cca91bf6a None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:05.914473 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 544/1093] 10.222.0.91 () {56 vars in 1115 bytes} [Tue Aug 30 04:16:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:16:05.924379 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7c822-9711-4523-a5c5-1fe90bf86c8b None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:06.049883 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7c822-9711-4523-a5c5-1fe90bf86c8b None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:06.075763 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 550/1094] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 30 04:16:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 04:16:06.076096 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:06.077792 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b8fbd-8095-487b-9905-9b2cca91bf6a None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:06.093877 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d2d22-0c0f-4298-a4ec-11927e1d2505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:06.094532 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d2d22-0c0f-4298-a4ec-11927e1d2505 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:06.094812 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d2d22-0c0f-4298-a4ec-11927e1d2505 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:06.095069 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d2d22-0c0f-4298-a4ec-11927e1d2505 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:06.108028 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085d2d22-0c0f-4298-a4ec-11927e1d2505 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:06.109525 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085d2d22-0c0f-4298-a4ec-11927e1d2505 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:06.126039 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-085d2d22-0c0f-4298-a4ec-11927e1d2505 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:16:06.126039 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:16:06.126039 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:16:06.126039 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:16:06.126039 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:16:06.126039 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:16:06.126039 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:16:06.126039 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:16:06.126039 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:16:06.126039 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:16:06.126039 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:16:06.126039 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:16:06.126039 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:16:06.126039 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:16:06.126039 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:16:06.126039 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:16:06.127355 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:16:06.127355 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:16:06.127355 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:16:06.127355 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:16:06.127355 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:16:06.127355 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:16:06.127355 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:16:06.127355 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:16:06.127355 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:16:06.127355 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:16:06.127355 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:16:06.127355 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:16:06.127355 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:16:06.127355 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:16:06.127355 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:16:06.127355 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:16:06.127355 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:16:06.129609 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:16:06.129609 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:16:06.129609 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:16:06.129609 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 545/1095] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:16:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:16:06.133653 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d2d22-0c0f-4298-a4ec-11927e1d2505 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:06.136215 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:06.230531 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b8fbd-8095-487b-9905-9b2cca91bf6a None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:06.264501 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d2d22-0c0f-4298-a4ec-11927e1d2505 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:06.275790 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d05996-bb78-473d-a8e1-40906153c93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:06.277212 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d05996-bb78-473d-a8e1-40906153c93f None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:06.277692 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d05996-bb78-473d-a8e1-40906153c93f None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:06.278168 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d05996-bb78-473d-a8e1-40906153c93f None admin] PATH_INFO: `/v3/projects/b355b6c6abec46159b248a518ed8e440` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:06.280376 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d05996-bb78-473d-a8e1-40906153c93f None admin] RBAC: Authorizing `identity:get_project(project_id=b355b6c6abec46159b248a518ed8e440)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:06.283078 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d05996-bb78-473d-a8e1-40906153c93f None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:06.286450 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 551/1096] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 30 04:16:06 2022] GET /identity/v3/projects/b355b6c6abec46159b248a518ed8e440 => generated 311 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:16:06.297155 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d05996-bb78-473d-a8e1-40906153c93f None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:06.315888 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b09a6d-be80-471e-8806-dff19714044f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:06.316462 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b09a6d-be80-471e-8806-dff19714044f None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:06.316740 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b09a6d-be80-471e-8806-dff19714044f None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:06.317011 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b09a6d-be80-471e-8806-dff19714044f None admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:06.317672 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b09a6d-be80-471e-8806-dff19714044f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:16:06.317970 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b09a6d-be80-471e-8806-dff19714044f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:06.319401 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b09a6d-be80-471e-8806-dff19714044f None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:06.334695 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 546/1097] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:16:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:16:06.341921 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b09a6d-be80-471e-8806-dff19714044f None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:06.376859 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:06.441542 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:06.446755 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d05996-bb78-473d-a8e1-40906153c93f None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:06.496533 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab82320-a0b9-44bd-921e-b494cd0935b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:06.497268 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab82320-a0b9-44bd-921e-b494cd0935b2 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:06.497469 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab82320-a0b9-44bd-921e-b494cd0935b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:06.497737 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab82320-a0b9-44bd-921e-b494cd0935b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:06.498503 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab82320-a0b9-44bd-921e-b494cd0935b2 None admin] RBAC: Adding query filter params (role.id=d8f440a82947486ebb20a633ebee736b, scope.project.id=b355b6c6abec46159b248a518ed8e440, user.id=4489784858c54a47911b30162067c419) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:16:06.498806 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab82320-a0b9-44bd-921e-b494cd0935b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:06.500356 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab82320-a0b9-44bd-921e-b494cd0935b2 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:06.517914 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 552/1098] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 30 04:16:06 2022] GET /identity/v3/role_assignments?user.id=4489784858c54a47911b30162067c419&scope.project.id=b355b6c6abec46159b248a518ed8e440&role.id=d8f440a82947486ebb20a633ebee736b => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:16:06.518193 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b09a6d-be80-471e-8806-dff19714044f None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:06.555379 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab86c45-5c6f-4480-a662-d460fd785d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:06.556082 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab86c45-5c6f-4480-a662-d460fd785d26 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:06.556360 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab86c45-5c6f-4480-a662-d460fd785d26 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:06.556629 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab86c45-5c6f-4480-a662-d460fd785d26 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:06.569678 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab86c45-5c6f-4480-a662-d460fd785d26 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:06.572514 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab86c45-5c6f-4480-a662-d460fd785d26 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:06.609302 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-4ab86c45-5c6f-4480-a662-d460fd785d26 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 04:16:06.609302 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:16:06.609302 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:16:06.609302 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:16:06.609302 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:16:06.609302 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:16:06.609302 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:16:06.609302 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:16:06.609302 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:16:06.609302 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:16:06.609302 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:16:06.609302 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:16:06.609302 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:16:06.609302 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:16:06.609302 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:16:06.609302 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:16:06.610949 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:16:06.610949 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:16:06.610949 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:16:06.610949 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:16:06.610949 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:16:06.610949 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:16:06.610949 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:16:06.610949 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:16:06.610949 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:16:06.610949 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:16:06.610949 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:16:06.610949 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:16:06.610949 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:16:06.610949 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:16:06.610949 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:16:06.610949 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:16:06.610949 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:16:06.610949 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:16:06.612563 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:16:06.612563 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:16:06.612563 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:16:06.612563 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:16:06.612563 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:16:06.612563 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:16:06.612563 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:16:06.612563 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:16:06.612563 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 04:16:06.612563 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:16:06.612563 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 547/1099] 10.222.0.91 () {56 vars in 1093 bytes} [Tue Aug 30 04:16:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:16:06.619675 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab82320-a0b9-44bd-921e-b494cd0935b2 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:06.764583 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab82320-a0b9-44bd-921e-b494cd0935b2 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:06.814359 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71f7992-e271-46d0-abf9-1476d4798b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:06.814995 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f7992-e271-46d0-abf9-1476d4798b15 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:06.815268 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f7992-e271-46d0-abf9-1476d4798b15 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:06.815535 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f7992-e271-46d0-abf9-1476d4798b15 None admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:06.816333 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71f7992-e271-46d0-abf9-1476d4798b15 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:16:06.816637 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71f7992-e271-46d0-abf9-1476d4798b15 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:06.818246 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71f7992-e271-46d0-abf9-1476d4798b15 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:06.840740 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 553/1100] 10.222.0.91 () {56 vars in 1133 bytes} [Tue Aug 30 04:16:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:16:06.847097 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab86c45-5c6f-4480-a662-d460fd785d26 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:06.960219 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:06.975305 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab86c45-5c6f-4480-a662-d460fd785d26 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:07.015743 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c85b53-d1c2-4ead-84e4-e414927d0565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:07.016405 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c85b53-d1c2-4ead-84e4-e414927d0565 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:07.016682 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c85b53-d1c2-4ead-84e4-e414927d0565 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:07.016948 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c85b53-d1c2-4ead-84e4-e414927d0565 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:07.129700 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c85b53-d1c2-4ead-84e4-e414927d0565 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:07.132519 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c85b53-d1c2-4ead-84e4-e414927d0565 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:07.238722 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:07.258221 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 548/1101] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 30 04:16:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 04:16:07.259540 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71f7992-e271-46d0-abf9-1476d4798b15 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:07.290062 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:07.380955 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71f7992-e271-46d0-abf9-1476d4798b15 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:07.422886 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696bed5a-9f4e-45d5-9adc-8ed5450434d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:07.423545 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696bed5a-9f4e-45d5-9adc-8ed5450434d0 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:07.423805 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696bed5a-9f4e-45d5-9adc-8ed5450434d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:07.424247 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696bed5a-9f4e-45d5-9adc-8ed5450434d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:07.436555 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696bed5a-9f4e-45d5-9adc-8ed5450434d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:07.438034 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696bed5a-9f4e-45d5-9adc-8ed5450434d0 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:07.455093 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-696bed5a-9f4e-45d5-9adc-8ed5450434d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:16:07.455093 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:16:07.455093 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:16:07.455093 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:16:07.455093 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:16:07.455093 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:16:07.455093 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:16:07.455093 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:16:07.455093 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:16:07.455093 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:16:07.455093 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:16:07.455093 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:16:07.455093 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:16:07.455093 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:16:07.455093 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:16:07.455093 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:16:07.456431 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:16:07.456431 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:16:07.456431 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:16:07.456431 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:16:07.456431 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:16:07.456431 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:16:07.456431 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:16:07.456431 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:16:07.456431 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:16:07.456431 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:16:07.456431 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:16:07.456431 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:16:07.456431 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:16:07.456431 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:16:07.456431 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:16:07.456431 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:16:07.456431 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:16:07.457379 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:16:07.457379 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:16:07.457379 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:16:07.457379 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 554/1102] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:16:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:16:07.462493 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c85b53-d1c2-4ead-84e4-e414927d0565 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:07.584741 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c85b53-d1c2-4ead-84e4-e414927d0565 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:07.625604 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d0559-5361-4ca6-8cf8-4fd0771e431e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:07.626582 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d0559-5361-4ca6-8cf8-4fd0771e431e None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:07.626582 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d0559-5361-4ca6-8cf8-4fd0771e431e None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:07.626870 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d0559-5361-4ca6-8cf8-4fd0771e431e None admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:07.627535 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321d0559-5361-4ca6-8cf8-4fd0771e431e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:16:07.627837 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321d0559-5361-4ca6-8cf8-4fd0771e431e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:07.629402 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321d0559-5361-4ca6-8cf8-4fd0771e431e None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:07.644411 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 549/1103] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:16:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:16:07.650257 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696bed5a-9f4e-45d5-9adc-8ed5450434d0 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:07.746010 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:07.775556 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696bed5a-9f4e-45d5-9adc-8ed5450434d0 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:07.835978 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616cd7dd-ff53-46fe-b8cb-4081f092c2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:07.837022 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616cd7dd-ff53-46fe-b8cb-4081f092c2b1 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:07.837499 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616cd7dd-ff53-46fe-b8cb-4081f092c2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:07.838184 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616cd7dd-ff53-46fe-b8cb-4081f092c2b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:07.851449 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616cd7dd-ff53-46fe-b8cb-4081f092c2b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:07.854369 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616cd7dd-ff53-46fe-b8cb-4081f092c2b1 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:07.878177 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-616cd7dd-ff53-46fe-b8cb-4081f092c2b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:16:07.878177 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:16:07.878177 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:16:07.878177 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:16:07.878177 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:16:07.878177 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:16:07.878177 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:16:07.878177 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:16:07.878177 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:16:07.878177 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:16:07.878177 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:16:07.878177 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:16:07.878177 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:16:07.878177 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:16:07.878177 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:16:07.879238 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:16:07.879238 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:16:07.879238 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:16:07.879238 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:16:07.879238 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:16:07.879238 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:16:07.879238 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:16:07.879238 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:16:07.879238 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:16:07.879238 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:16:07.879238 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:16:07.879238 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:16:07.879238 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:16:07.879238 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:16:07.879238 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:16:07.879238 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:16:07.879238 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:16:07.880268 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:16:07.880268 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:16:07.880268 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:16:07.880268 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:16:07.880268 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:16:07.880268 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:16:07.880268 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:16:07.880268 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:16:07.880729 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 555/1104] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 30 04:16:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:16:07.890438 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d0559-5361-4ca6-8cf8-4fd0771e431e None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:07.985080 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:08.082434 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d0559-5361-4ca6-8cf8-4fd0771e431e None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:08.149628 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceacfe0-8d9b-4e99-8e12-7b65789b3fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:08.150913 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceacfe0-8d9b-4e99-8e12-7b65789b3fc6 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:08.151410 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceacfe0-8d9b-4e99-8e12-7b65789b3fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:08.151932 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceacfe0-8d9b-4e99-8e12-7b65789b3fc6 None admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:08.153261 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceacfe0-8d9b-4e99-8e12-7b65789b3fc6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:16:08.153802 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceacfe0-8d9b-4e99-8e12-7b65789b3fc6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:08.156529 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceacfe0-8d9b-4e99-8e12-7b65789b3fc6 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:08.181511 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 550/1105] 10.222.0.91 () {56 vars in 1148 bytes} [Tue Aug 30 04:16:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:16:08.191460 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616cd7dd-ff53-46fe-b8cb-4081f092c2b1 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:08.381175 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616cd7dd-ff53-46fe-b8cb-4081f092c2b1 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:08.437862 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c9b10-7c69-4d9b-a330-f4035f7fb2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:08.438482 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c9b10-7c69-4d9b-a330-f4035f7fb2ec None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:08.438756 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c9b10-7c69-4d9b-a330-f4035f7fb2ec None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:08.439023 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c9b10-7c69-4d9b-a330-f4035f7fb2ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:08.439780 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341c9b10-7c69-4d9b-a330-f4035f7fb2ec None admin] RBAC: Adding query filter params (role.id=d110827932ac4a4db66e89e29c8b6115, scope.project.id=4e05769361674c8fa995050150ad4cfa, user.id=d806295278ae4997b5c6968aa553290c) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:16:08.440126 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341c9b10-7c69-4d9b-a330-f4035f7fb2ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:08.441603 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341c9b10-7c69-4d9b-a330-f4035f7fb2ec None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:08.443731 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:08.449668 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 556/1106] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 30 04:16:08 2022] GET /identity/v3/role_assignments?user.id=d806295278ae4997b5c6968aa553290c&scope.project.id=4e05769361674c8fa995050150ad4cfa&role.id=d110827932ac4a4db66e89e29c8b6115 => generated 608 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:16:08.603706 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f2c38-6639-4dc9-82fd-84f23e955b35 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:08.605553 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f2c38-6639-4dc9-82fd-84f23e955b35 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:08.605844 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f2c38-6639-4dc9-82fd-84f23e955b35 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:08.607832 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 551/1107] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:16:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:16:08.614040 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16fb49e-e242-4879-8f33-1c27ab4be240 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:08.614338 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16fb49e-e242-4879-8f33-1c27ab4be240 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:08.614625 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16fb49e-e242-4879-8f33-1c27ab4be240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:08.636556 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-e16fb49e-e242-4879-8f33-1c27ab4be240 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:08.637696 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-e16fb49e-e242-4879-8f33-1c27ab4be240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:08.723575 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 557/1108] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:16:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:16:09.105851 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f2c38-6639-4dc9-82fd-84f23e955b35 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:09.243251 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f2c38-6639-4dc9-82fd-84f23e955b35 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:09.262008 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:09.296652 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e211f5f-59cf-4e7f-b8be-83ddc8e939bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:09.297627 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e211f5f-59cf-4e7f-b8be-83ddc8e939bc None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:09.298078 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e211f5f-59cf-4e7f-b8be-83ddc8e939bc None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:09.298508 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e211f5f-59cf-4e7f-b8be-83ddc8e939bc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:09.300061 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e211f5f-59cf-4e7f-b8be-83ddc8e939bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:09.302080 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e211f5f-59cf-4e7f-b8be-83ddc8e939bc None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:09.304048 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 552/1109] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:16:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:16:09.311342 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16fb49e-e242-4879-8f33-1c27ab4be240 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:09.437623 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16fb49e-e242-4879-8f33-1c27ab4be240 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:09.472497 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:09.481982 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2619ba92-fd8c-405f-8552-2fa28540d689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:09.482617 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619ba92-fd8c-405f-8552-2fa28540d689 None admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:09.482890 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619ba92-fd8c-405f-8552-2fa28540d689 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:09.483154 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619ba92-fd8c-405f-8552-2fa28540d689 None admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:09.483830 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2619ba92-fd8c-405f-8552-2fa28540d689 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:09.485328 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2619ba92-fd8c-405f-8552-2fa28540d689 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:09.514783 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 558/1110] 10.222.0.91 () {60 vars in 1132 bytes} [Tue Aug 30 04:16:09 2022] POST /identity/v3/users => generated 286 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:11.534273 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8560b-d8a3-4ec1-a8cd-0aae6f6eebfe None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:11.534861 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8560b-d8a3-4ec1-a8cd-0aae6f6eebfe None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:11.534861 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8560b-d8a3-4ec1-a8cd-0aae6f6eebfe None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:11.536191 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 553/1111] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:16:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:16:11.542933 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a951f6-d012-4f02-bdfe-d1c5b134e657 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:11.543888 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a951f6-d012-4f02-bdfe-d1c5b134e657 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:11.544003 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a951f6-d012-4f02-bdfe-d1c5b134e657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:11.564848 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-23a951f6-d012-4f02-bdfe-d1c5b134e657 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:11.566089 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-23a951f6-d012-4f02-bdfe-d1c5b134e657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:11.642235 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 559/1112] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:16:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:16:11.911780 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a8560b-d8a3-4ec1-a8cd-0aae6f6eebfe None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:12.039237 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a8560b-d8a3-4ec1-a8cd-0aae6f6eebfe None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:12.078522 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f621a-c35d-487c-acbc-06bd5f44efc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:12.079171 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f621a-c35d-487c-acbc-06bd5f44efc1 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:12.079449 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f621a-c35d-487c-acbc-06bd5f44efc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:12.079723 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f621a-c35d-487c-acbc-06bd5f44efc1 None admin] PATH_INFO: `/v3/roles/147a152caf8346259b191a633bb4aee0` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:12.081210 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2f621a-c35d-487c-acbc-06bd5f44efc1 None admin] RBAC: Authorizing `identity:get_role(role_id=147a152caf8346259b191a633bb4aee0)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:12.082610 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2f621a-c35d-487c-acbc-06bd5f44efc1 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:12.084040 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 554/1113] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 30 04:16:11 2022] GET /identity/v3/roles/147a152caf8346259b191a633bb4aee0 => generated 223 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:16:12.091525 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a951f6-d012-4f02-bdfe-d1c5b134e657 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:12.205670 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a951f6-d012-4f02-bdfe-d1c5b134e657 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:12.221493 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:12.245188 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce6ed0-8425-4619-b933-087f8aa4f84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:12.246142 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce6ed0-8425-4619-b933-087f8aa4f84c None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:12.246142 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce6ed0-8425-4619-b933-087f8aa4f84c None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:12.246417 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce6ed0-8425-4619-b933-087f8aa4f84c None admin] PATH_INFO: `/v3/users/a2e51ebd25ea4c5fb26c35ef11fe7634` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:12.261708 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ce6ed0-8425-4619-b933-087f8aa4f84c None admin] RBAC: Authorizing `identity:get_user(user_id=a2e51ebd25ea4c5fb26c35ef11fe7634)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:12.263168 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ce6ed0-8425-4619-b933-087f8aa4f84c None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:12.265033 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 560/1114] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 30 04:16:12 2022] GET /identity/v3/users/a2e51ebd25ea4c5fb26c35ef11fe7634 => generated 286 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:16:12.271266 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f621a-c35d-487c-acbc-06bd5f44efc1 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:12.336429 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:12.396751 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f621a-c35d-487c-acbc-06bd5f44efc1 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:12.439505 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41fca15-8310-414a-b4aa-3d7cb449d83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:12.440143 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41fca15-8310-414a-b4aa-3d7cb449d83f None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:12.440423 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41fca15-8310-414a-b4aa-3d7cb449d83f None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:12.440678 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41fca15-8310-414a-b4aa-3d7cb449d83f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:12.516148 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41fca15-8310-414a-b4aa-3d7cb449d83f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:12.517536 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41fca15-8310-414a-b4aa-3d7cb449d83f None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:12.569175 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:12.630328 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 555/1115] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 30 04:16:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 04:16:12.637121 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce6ed0-8425-4619-b933-087f8aa4f84c None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:12.750913 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce6ed0-8425-4619-b933-087f8aa4f84c None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:12.787815 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b793b-644d-4b92-913e-a1f4b91930dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:12.788404 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b793b-644d-4b92-913e-a1f4b91930dd None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:12.788682 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b793b-644d-4b92-913e-a1f4b91930dd None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:12.788959 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b793b-644d-4b92-913e-a1f4b91930dd None admin] PATH_INFO: `/v3/projects/b355b6c6abec46159b248a518ed8e440` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:12.790201 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b793b-644d-4b92-913e-a1f4b91930dd None admin] RBAC: Authorizing `identity:get_project(project_id=b355b6c6abec46159b248a518ed8e440)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:12.791754 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b793b-644d-4b92-913e-a1f4b91930dd None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:12.793847 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 561/1116] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 30 04:16:12 2022] GET /identity/v3/projects/b355b6c6abec46159b248a518ed8e440 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:16:12.801476 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41fca15-8310-414a-b4aa-3d7cb449d83f None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:12.913038 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41fca15-8310-414a-b4aa-3d7cb449d83f None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:12.951832 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0960fc-ae8f-4e7c-a899-de986d951ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:12.952491 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0960fc-ae8f-4e7c-a899-de986d951ad3 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:12.952766 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0960fc-ae8f-4e7c-a899-de986d951ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:12.953020 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0960fc-ae8f-4e7c-a899-de986d951ad3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:12.953754 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0960fc-ae8f-4e7c-a899-de986d951ad3 None admin] RBAC: Adding query filter params (role.id=147a152caf8346259b191a633bb4aee0, scope.project.id=b355b6c6abec46159b248a518ed8e440, user.id=a2e51ebd25ea4c5fb26c35ef11fe7634) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:16:12.954060 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0960fc-ae8f-4e7c-a899-de986d951ad3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:12.955521 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0960fc-ae8f-4e7c-a899-de986d951ad3 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:12.961776 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 556/1117] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 30 04:16:12 2022] GET /identity/v3/role_assignments?user.id=a2e51ebd25ea4c5fb26c35ef11fe7634&scope.project.id=b355b6c6abec46159b248a518ed8e440&role.id=147a152caf8346259b191a633bb4aee0 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:16:14.917804 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e2bb6-8c48-431f-8c60-1917bbdb7fd5 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:14.918741 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e2bb6-8c48-431f-8c60-1917bbdb7fd5 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:14.918741 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e2bb6-8c48-431f-8c60-1917bbdb7fd5 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:14.920204 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 562/1118] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:16:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:16:14.927157 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c584844-2d37-484f-a6ae-1c9c4e8e6d62 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:14.927750 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c584844-2d37-484f-a6ae-1c9c4e8e6d62 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:14.927750 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c584844-2d37-484f-a6ae-1c9c4e8e6d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:14.949766 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-8c584844-2d37-484f-a6ae-1c9c4e8e6d62 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:14.951003 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-8c584844-2d37-484f-a6ae-1c9c4e8e6d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:14.953373 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:15.058778 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 557/1119] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:16:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:16:15.337808 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1e2bb6-8c48-431f-8c60-1917bbdb7fd5 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:15.386143 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:15.452939 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1e2bb6-8c48-431f-8c60-1917bbdb7fd5 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:15.490911 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7222b196-20cd-45ac-abda-1bd344a6cd1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:15.491547 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222b196-20cd-45ac-abda-1bd344a6cd1c None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:15.491818 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222b196-20cd-45ac-abda-1bd344a6cd1c None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:15.492102 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222b196-20cd-45ac-abda-1bd344a6cd1c None admin] PATH_INFO: `/v3/roles/147a152caf8346259b191a633bb4aee0` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:15.493682 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7222b196-20cd-45ac-abda-1bd344a6cd1c None admin] RBAC: Authorizing `identity:get_role(role_id=147a152caf8346259b191a633bb4aee0)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:15.495400 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7222b196-20cd-45ac-abda-1bd344a6cd1c None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:15.496964 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 563/1120] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 30 04:16:15 2022] GET /identity/v3/roles/147a152caf8346259b191a633bb4aee0 => generated 223 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:16:15.503788 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c584844-2d37-484f-a6ae-1c9c4e8e6d62 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:15.636525 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c584844-2d37-484f-a6ae-1c9c4e8e6d62 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:15.676454 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8775bc-e59d-4138-95e9-d3c65c491cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:15.677258 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8775bc-e59d-4138-95e9-d3c65c491cd9 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:15.677621 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8775bc-e59d-4138-95e9-d3c65c491cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:15.677980 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8775bc-e59d-4138-95e9-d3c65c491cd9 None admin] PATH_INFO: `/v3/users/a2e51ebd25ea4c5fb26c35ef11fe7634` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:15.679325 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8775bc-e59d-4138-95e9-d3c65c491cd9 None admin] RBAC: Authorizing `identity:get_user(user_id=a2e51ebd25ea4c5fb26c35ef11fe7634)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:15.681049 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8775bc-e59d-4138-95e9-d3c65c491cd9 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:15.682976 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 558/1121] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 30 04:16:15 2022] GET /identity/v3/users/a2e51ebd25ea4c5fb26c35ef11fe7634 => generated 286 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:16:15.689305 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7222b196-20cd-45ac-abda-1bd344a6cd1c None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:15.814770 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7222b196-20cd-45ac-abda-1bd344a6cd1c None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:15.829540 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:15.863209 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f0b29-6812-4911-af08-bf111485abde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:15.863862 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f0b29-6812-4911-af08-bf111485abde None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:15.864173 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f0b29-6812-4911-af08-bf111485abde None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:15.864443 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f0b29-6812-4911-af08-bf111485abde None admin] PATH_INFO: `/v3/projects/b355b6c6abec46159b248a518ed8e440` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:15.865700 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3f0b29-6812-4911-af08-bf111485abde None admin] RBAC: Authorizing `identity:get_project(project_id=b355b6c6abec46159b248a518ed8e440)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:15.867169 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3f0b29-6812-4911-af08-bf111485abde None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:15.868952 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 564/1122] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 30 04:16:15 2022] GET /identity/v3/projects/b355b6c6abec46159b248a518ed8e440 => generated 311 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:16:15.875622 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8775bc-e59d-4138-95e9-d3c65c491cd9 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:15.885237 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:15.993501 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8775bc-e59d-4138-95e9-d3c65c491cd9 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:16.032368 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62de97-1a1c-4ede-bb7f-db6f71c7fb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:16.033033 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62de97-1a1c-4ede-bb7f-db6f71c7fb56 None admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:16.033311 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62de97-1a1c-4ede-bb7f-db6f71c7fb56 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:16.033583 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62de97-1a1c-4ede-bb7f-db6f71c7fb56 None admin] PATH_INFO: `/v3/projects/b355b6c6abec46159b248a518ed8e440/users/a2e51ebd25ea4c5fb26c35ef11fe7634/roles/147a152caf8346259b191a633bb4aee0` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:16.035851 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db62de97-1a1c-4ede-bb7f-db6f71c7fb56 None admin] RBAC: Authorizing `identity:create_grant(project_id=b355b6c6abec46159b248a518ed8e440, user_id=a2e51ebd25ea4c5fb26c35ef11fe7634, role_id=147a152caf8346259b191a633bb4aee0)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:16.037358 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db62de97-1a1c-4ede-bb7f-db6f71c7fb56 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:16.052525 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 559/1123] 10.222.0.91 () {58 vars in 1439 bytes} [Tue Aug 30 04:16:15 2022] PUT /identity/v3/projects/b355b6c6abec46159b248a518ed8e440/users/a2e51ebd25ea4c5fb26c35ef11fe7634/roles/147a152caf8346259b191a633bb4aee0 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:18.266289 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08f718-cbd6-4d59-b337-57d3ade49d88 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:18.266904 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08f718-cbd6-4d59-b337-57d3ade49d88 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:18.266904 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08f718-cbd6-4d59-b337-57d3ade49d88 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:18.268285 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 565/1124] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:16:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:16:18.277510 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44cb300-47c2-42fb-8118-cc1ee038edd7 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:18.278493 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44cb300-47c2-42fb-8118-cc1ee038edd7 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:18.278493 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44cb300-47c2-42fb-8118-cc1ee038edd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:18.298869 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-a44cb300-47c2-42fb-8118-cc1ee038edd7 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:18.300415 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-a44cb300-47c2-42fb-8118-cc1ee038edd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:18.371885 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:18.381192 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 560/1125] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:16:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:16:18.671725 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e08f718-cbd6-4d59-b337-57d3ade49d88 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:18.797719 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e08f718-cbd6-4d59-b337-57d3ade49d88 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:18.838012 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76688db5-347f-4d9e-83ce-8d4c298cdecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:18.838658 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76688db5-347f-4d9e-83ce-8d4c298cdecc None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:18.838931 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76688db5-347f-4d9e-83ce-8d4c298cdecc None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:18.839203 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76688db5-347f-4d9e-83ce-8d4c298cdecc None admin] PATH_INFO: `/v3/roles/147a152caf8346259b191a633bb4aee0` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:18.840722 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76688db5-347f-4d9e-83ce-8d4c298cdecc None admin] RBAC: Authorizing `identity:get_role(role_id=147a152caf8346259b191a633bb4aee0)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:18.842141 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76688db5-347f-4d9e-83ce-8d4c298cdecc None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:18.843580 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 566/1126] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 30 04:16:18 2022] GET /identity/v3/roles/147a152caf8346259b191a633bb4aee0 => generated 223 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:16:18.852437 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44cb300-47c2-42fb-8118-cc1ee038edd7 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:18.967410 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44cb300-47c2-42fb-8118-cc1ee038edd7 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:19.005857 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f869f10a-946c-4586-9c76-065920a045db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:19.006516 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869f10a-946c-4586-9c76-065920a045db None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:19.006790 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869f10a-946c-4586-9c76-065920a045db None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:19.007056 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869f10a-946c-4586-9c76-065920a045db None admin] PATH_INFO: `/v3/users/a2e51ebd25ea4c5fb26c35ef11fe7634` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:19.008457 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f869f10a-946c-4586-9c76-065920a045db None admin] RBAC: Authorizing `identity:get_user(user_id=a2e51ebd25ea4c5fb26c35ef11fe7634)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:19.009946 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f869f10a-946c-4586-9c76-065920a045db None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:19.011617 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 561/1127] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 30 04:16:18 2022] GET /identity/v3/users/a2e51ebd25ea4c5fb26c35ef11fe7634 => generated 286 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:16:19.018329 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76688db5-347f-4d9e-83ce-8d4c298cdecc None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:19.080595 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:19.148417 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76688db5-347f-4d9e-83ce-8d4c298cdecc None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:19.194994 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851794ff-0a52-42d0-b41d-b3e1c63ee908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:19.195711 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851794ff-0a52-42d0-b41d-b3e1c63ee908 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:19.196063 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851794ff-0a52-42d0-b41d-b3e1c63ee908 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:19.196513 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851794ff-0a52-42d0-b41d-b3e1c63ee908 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:19.276280 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851794ff-0a52-42d0-b41d-b3e1c63ee908 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:19.277670 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851794ff-0a52-42d0-b41d-b3e1c63ee908 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:19.332587 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:19.397979 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 567/1128] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 30 04:16:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 04:16:19.405065 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f869f10a-946c-4586-9c76-065920a045db None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:19.483050 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:19.528614 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f869f10a-946c-4586-9c76-065920a045db None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:19.567079 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c0a26-0ab4-40bd-a665-f604c5cea7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:19.567757 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c0a26-0ab4-40bd-a665-f604c5cea7e5 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:19.568057 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c0a26-0ab4-40bd-a665-f604c5cea7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:19.568326 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c0a26-0ab4-40bd-a665-f604c5cea7e5 None admin] PATH_INFO: `/v3/projects/b355b6c6abec46159b248a518ed8e440` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:19.569524 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198c0a26-0ab4-40bd-a665-f604c5cea7e5 None admin] RBAC: Authorizing `identity:get_project(project_id=b355b6c6abec46159b248a518ed8e440)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:19.570991 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198c0a26-0ab4-40bd-a665-f604c5cea7e5 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:19.572766 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 562/1129] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 30 04:16:19 2022] GET /identity/v3/projects/b355b6c6abec46159b248a518ed8e440 => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:16:19.580284 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851794ff-0a52-42d0-b41d-b3e1c63ee908 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:19.709748 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851794ff-0a52-42d0-b41d-b3e1c63ee908 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:19.748684 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624aa03e-cc18-4676-8146-cd4fd805abbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:19.749303 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624aa03e-cc18-4676-8146-cd4fd805abbd None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:19.749577 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624aa03e-cc18-4676-8146-cd4fd805abbd None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:19.749848 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624aa03e-cc18-4676-8146-cd4fd805abbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:19.750601 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624aa03e-cc18-4676-8146-cd4fd805abbd None admin] RBAC: Adding query filter params (role.id=147a152caf8346259b191a633bb4aee0, scope.project.id=b355b6c6abec46159b248a518ed8e440, user.id=a2e51ebd25ea4c5fb26c35ef11fe7634) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:16:19.750906 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624aa03e-cc18-4676-8146-cd4fd805abbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:19.752468 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624aa03e-cc18-4676-8146-cd4fd805abbd None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:19.759437 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 568/1130] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 30 04:16:19 2022] GET /identity/v3/role_assignments?user.id=a2e51ebd25ea4c5fb26c35ef11fe7634&scope.project.id=b355b6c6abec46159b248a518ed8e440&role.id=147a152caf8346259b191a633bb4aee0 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:16:21.885338 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a635c70-e7c7-4ca1-a0c1-131469920a2f None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:21.886189 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a635c70-e7c7-4ca1-a0c1-131469920a2f None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:21.886189 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a635c70-e7c7-4ca1-a0c1-131469920a2f None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:21.887606 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 563/1131] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:16:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:16:21.894060 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d993eec-b838-4e4a-95fc-ad5313cb597d None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:21.894620 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d993eec-b838-4e4a-95fc-ad5313cb597d None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:21.894620 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d993eec-b838-4e4a-95fc-ad5313cb597d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:21.915158 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-6d993eec-b838-4e4a-95fc-ad5313cb597d None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:21.916534 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-6d993eec-b838-4e4a-95fc-ad5313cb597d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:21.920004 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:22.009628 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 569/1132] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:16:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 04:16:22.278563 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a635c70-e7c7-4ca1-a0c1-131469920a2f None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:22.402434 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a635c70-e7c7-4ca1-a0c1-131469920a2f None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:22.440571 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:22.446745 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40556b55-3e3d-4847-ae11-2069efcdb1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:22.447499 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40556b55-3e3d-4847-ae11-2069efcdb1fa None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:22.447811 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40556b55-3e3d-4847-ae11-2069efcdb1fa None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:22.448116 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40556b55-3e3d-4847-ae11-2069efcdb1fa None admin] PATH_INFO: `/v3/domains/default` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:22.449305 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40556b55-3e3d-4847-ae11-2069efcdb1fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:22.450764 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40556b55-3e3d-4847-ae11-2069efcdb1fa None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:22.452443 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 564/1133] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:16:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:16:22.458643 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d993eec-b838-4e4a-95fc-ad5313cb597d None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:22.582358 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d993eec-b838-4e4a-95fc-ad5313cb597d None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:22.627178 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7d0d01-83b2-4f58-a38b-5aa54012855a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:22.627823 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d0d01-83b2-4f58-a38b-5aa54012855a None admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:22.628148 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d0d01-83b2-4f58-a38b-5aa54012855a None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:22.628399 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d0d01-83b2-4f58-a38b-5aa54012855a None admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:22.629098 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7d0d01-83b2-4f58-a38b-5aa54012855a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:22.630600 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7d0d01-83b2-4f58-a38b-5aa54012855a None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:22.642718 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:22.664481 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 570/1134] 10.222.0.91 () {60 vars in 1141 bytes} [Tue Aug 30 04:16:22 2022] POST /identity/v3/projects => generated 311 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:24.702311 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d5ee8-f14d-4cac-8d1c-903806518a70 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:24.702900 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d5ee8-f14d-4cac-8d1c-903806518a70 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:24.702900 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d5ee8-f14d-4cac-8d1c-903806518a70 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:24.704281 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 565/1135] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:16:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:16:24.712791 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1ac4c-5473-4997-a386-0bc7b22cbf42 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:24.713625 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1ac4c-5473-4997-a386-0bc7b22cbf42 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:24.713780 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1ac4c-5473-4997-a386-0bc7b22cbf42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:24.736646 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-92c1ac4c-5473-4997-a386-0bc7b22cbf42 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:24.737956 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-92c1ac4c-5473-4997-a386-0bc7b22cbf42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:24.815990 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 571/1136] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:16:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:16:25.089282 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7d5ee8-f14d-4cac-8d1c-903806518a70 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:25.211480 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7d5ee8-f14d-4cac-8d1c-903806518a70 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:25.250770 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a351fa-8a06-45e6-8446-9902c0be1bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:25.251405 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a351fa-8a06-45e6-8446-9902c0be1bcb None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:25.251678 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a351fa-8a06-45e6-8446-9902c0be1bcb None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:25.251969 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a351fa-8a06-45e6-8446-9902c0be1bcb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:25.253130 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a351fa-8a06-45e6-8446-9902c0be1bcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:25.254619 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a351fa-8a06-45e6-8446-9902c0be1bcb None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:25.256342 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 566/1137] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:16:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:16:25.262911 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1ac4c-5473-4997-a386-0bc7b22cbf42 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:25.378084 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1ac4c-5473-4997-a386-0bc7b22cbf42 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:25.408440 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:25.434632 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa4b86-d0d2-4dfd-a24c-04a337405bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:25.435262 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa4b86-d0d2-4dfd-a24c-04a337405bdf None admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:25.435537 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa4b86-d0d2-4dfd-a24c-04a337405bdf None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:25.435805 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa4b86-d0d2-4dfd-a24c-04a337405bdf None admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:25.436518 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfa4b86-d0d2-4dfd-a24c-04a337405bdf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:25.438006 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfa4b86-d0d2-4dfd-a24c-04a337405bdf None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:25.465244 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 572/1138] 10.222.0.91 () {60 vars in 1132 bytes} [Tue Aug 30 04:16:25 2022] POST /identity/v3/users => generated 286 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:27.759419 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53acf761-993f-4df2-a6e1-58c5a7da7fe2 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:27.760095 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53acf761-993f-4df2-a6e1-58c5a7da7fe2 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:27.760295 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53acf761-993f-4df2-a6e1-58c5a7da7fe2 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:27.762492 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 567/1139] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:16:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:16:27.772558 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6a2e0-1bcf-49fa-ba70-6dedded51335 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:27.773230 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6a2e0-1bcf-49fa-ba70-6dedded51335 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:27.778979 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6a2e0-1bcf-49fa-ba70-6dedded51335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:27.807644 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-60c6a2e0-1bcf-49fa-ba70-6dedded51335 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:27.809790 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-60c6a2e0-1bcf-49fa-ba70-6dedded51335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:27.901600 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 573/1140] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:16:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:16:28.187469 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53acf761-993f-4df2-a6e1-58c5a7da7fe2 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:28.269166 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:28.312798 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53acf761-993f-4df2-a6e1-58c5a7da7fe2 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:28.352773 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b98ef9f-6af5-4cb5-a302-0284a1d62b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:28.353426 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98ef9f-6af5-4cb5-a302-0284a1d62b54 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:28.353821 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98ef9f-6af5-4cb5-a302-0284a1d62b54 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:28.354100 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98ef9f-6af5-4cb5-a302-0284a1d62b54 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:28.367692 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b98ef9f-6af5-4cb5-a302-0284a1d62b54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:16:28.374096 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-0b98ef9f-6af5-4cb5-a302-0284a1d62b54 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:16:28.374096 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:16:28.374096 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:16:28.374096 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:16:28.374096 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:16:28.374096 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:16:28.374096 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:16:28.374096 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:16:28.374096 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:16:28.374096 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:16:28.374096 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:16:28.374096 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:16:28.374096 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:16:28.374096 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:16:28.374096 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:16:28.374096 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:16:28.375862 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:16:28.375862 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:16:28.375862 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:16:28.375862 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:16:28.375862 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:16:28.375862 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:16:28.375862 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:16:28.375862 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:16:28.375862 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:16:28.375862 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:16:28.375862 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:16:28.375862 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:16:28.375862 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:16:28.375862 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:16:28.375862 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:16:28.375862 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:16:28.377671 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:16:28.377671 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:16:28.377671 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:16:28.377671 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:16:28.377671 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:16:28.377671 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:16:28.377671 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:16:28.377671 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:16:28.377671 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:16:28.377671 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:16:28.377671 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:16:28.377671 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:16:28.377671 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 568/1141] 10.222.0.91 () {56 vars in 1096 bytes} [Tue Aug 30 04:16:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:16:28.385762 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6a2e0-1bcf-49fa-ba70-6dedded51335 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:28.512384 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6a2e0-1bcf-49fa-ba70-6dedded51335 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:28.521724 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:28.558884 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae68bb-cc9d-43a9-ae16-96d6d066a1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:28.559484 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae68bb-cc9d-43a9-ae16-96d6d066a1a6 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:28.559783 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae68bb-cc9d-43a9-ae16-96d6d066a1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:28.560080 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae68bb-cc9d-43a9-ae16-96d6d066a1a6 None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:28.560812 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ae68bb-cc9d-43a9-ae16-96d6d066a1a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:16:28.561113 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ae68bb-cc9d-43a9-ae16-96d6d066a1a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:28.562525 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ae68bb-cc9d-43a9-ae16-96d6d066a1a6 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:28.572919 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 574/1142] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 30 04:16:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:16:28.582197 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b98ef9f-6af5-4cb5-a302-0284a1d62b54 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:28.750753 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b98ef9f-6af5-4cb5-a302-0284a1d62b54 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:28.783591 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:28.792777 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c23ebc8-e142-443d-bdd9-b116c46ed143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:28.793826 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23ebc8-e142-443d-bdd9-b116c46ed143 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:28.794139 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23ebc8-e142-443d-bdd9-b116c46ed143 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:28.794450 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23ebc8-e142-443d-bdd9-b116c46ed143 None admin] PATH_INFO: `/v3/users/b77a57d3a6ef40d2b1bb84ee2a79b464` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:28.810702 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c23ebc8-e142-443d-bdd9-b116c46ed143 None admin] RBAC: Authorizing `identity:get_user(user_id=b77a57d3a6ef40d2b1bb84ee2a79b464)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:28.812242 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c23ebc8-e142-443d-bdd9-b116c46ed143 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:28.814003 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 569/1143] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 30 04:16:28 2022] GET /identity/v3/users/b77a57d3a6ef40d2b1bb84ee2a79b464 => generated 286 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:16:28.820640 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae68bb-cc9d-43a9-ae16-96d6d066a1a6 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:28.941487 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae68bb-cc9d-43a9-ae16-96d6d066a1a6 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:28.983319 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5185a10-81ca-43ac-a075-7bd7ad4ef64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:28.983996 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5185a10-81ca-43ac-a075-7bd7ad4ef64d None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:28.984269 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5185a10-81ca-43ac-a075-7bd7ad4ef64d None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:28.984543 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5185a10-81ca-43ac-a075-7bd7ad4ef64d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:29.029223 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:29.070941 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5185a10-81ca-43ac-a075-7bd7ad4ef64d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:29.072373 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5185a10-81ca-43ac-a075-7bd7ad4ef64d None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:29.200604 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 575/1144] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 30 04:16:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 04:16:29.207490 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c23ebc8-e142-443d-bdd9-b116c46ed143 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:29.331554 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c23ebc8-e142-443d-bdd9-b116c46ed143 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:29.371687 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8782ec2f-4293-4a98-869c-e74739382d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:29.372375 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782ec2f-4293-4a98-869c-e74739382d34 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:29.372644 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782ec2f-4293-4a98-869c-e74739382d34 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:29.372911 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782ec2f-4293-4a98-869c-e74739382d34 None admin] PATH_INFO: `/v3/projects/b879ced1645f4380b519612c9992b9b0` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:29.374190 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8782ec2f-4293-4a98-869c-e74739382d34 None admin] RBAC: Authorizing `identity:get_project(project_id=b879ced1645f4380b519612c9992b9b0)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:29.375681 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8782ec2f-4293-4a98-869c-e74739382d34 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:29.377502 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 570/1145] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 30 04:16:29 2022] GET /identity/v3/projects/b879ced1645f4380b519612c9992b9b0 => generated 311 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:16:29.384359 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5185a10-81ca-43ac-a075-7bd7ad4ef64d None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:29.463814 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:29.504249 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5185a10-81ca-43ac-a075-7bd7ad4ef64d None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:29.546471 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb5478-9036-40b0-be69-607b240c2386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:29.547099 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb5478-9036-40b0-be69-607b240c2386 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:29.547378 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb5478-9036-40b0-be69-607b240c2386 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:29.547649 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb5478-9036-40b0-be69-607b240c2386 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:29.548432 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fb5478-9036-40b0-be69-607b240c2386 None admin] RBAC: Adding query filter params (role.id=d8f440a82947486ebb20a633ebee736b, scope.project.id=b879ced1645f4380b519612c9992b9b0, user.id=b77a57d3a6ef40d2b1bb84ee2a79b464) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:16:29.548740 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fb5478-9036-40b0-be69-607b240c2386 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:29.550211 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fb5478-9036-40b0-be69-607b240c2386 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:29.556693 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 576/1146] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 30 04:16:29 2022] GET /identity/v3/role_assignments?user.id=b77a57d3a6ef40d2b1bb84ee2a79b464&scope.project.id=b879ced1645f4380b519612c9992b9b0&role.id=d8f440a82947486ebb20a633ebee736b => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:16:31.768571 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d706bccc-6157-4ea0-be1b-d39962c181ae None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:31.769453 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d706bccc-6157-4ea0-be1b-d39962c181ae None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:31.769453 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d706bccc-6157-4ea0-be1b-d39962c181ae None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:31.771015 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 571/1147] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:16:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:16:31.778071 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb044c-501d-48dd-aa8b-615cc19a375f None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:31.778860 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb044c-501d-48dd-aa8b-615cc19a375f None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:31.778860 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb044c-501d-48dd-aa8b-615cc19a375f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:31.799962 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-31fb044c-501d-48dd-aa8b-615cc19a375f None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:31.801249 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-31fb044c-501d-48dd-aa8b-615cc19a375f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:31.888587 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 577/1148] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:16:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:16:32.175121 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d706bccc-6157-4ea0-be1b-d39962c181ae None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:32.243126 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:32.298080 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d706bccc-6157-4ea0-be1b-d39962c181ae None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:32.338310 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170551e4-94b7-4ae6-bc4e-59d7d5d54014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:32.339628 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170551e4-94b7-4ae6-bc4e-59d7d5d54014 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:32.340102 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170551e4-94b7-4ae6-bc4e-59d7d5d54014 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:32.340350 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170551e4-94b7-4ae6-bc4e-59d7d5d54014 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:32.352798 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170551e4-94b7-4ae6-bc4e-59d7d5d54014 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:16:32.358328 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-170551e4-94b7-4ae6-bc4e-59d7d5d54014 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:16:32.358328 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:16:32.358328 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:16:32.358328 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:16:32.358328 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:16:32.358328 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:16:32.358328 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:16:32.358328 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:16:32.358328 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:16:32.358328 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:16:32.358328 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:16:32.358328 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:16:32.358328 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:16:32.358328 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:16:32.358328 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:16:32.358328 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:16:32.360163 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:16:32.360163 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:16:32.360163 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:16:32.360163 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:16:32.360163 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:16:32.360163 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:16:32.360163 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:16:32.360163 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:16:32.360163 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:16:32.360163 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:16:32.360163 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:16:32.360163 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:16:32.360163 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:16:32.360163 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:16:32.360163 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:16:32.360163 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:16:32.361076 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:16:32.361076 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:16:32.361076 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:16:32.361076 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:16:32.361076 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:16:32.361076 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:16:32.361076 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:16:32.361076 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:16:32.361076 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:16:32.361076 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:16:32.361076 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:16:32.361076 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:16:32.361076 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 572/1149] 10.222.0.91 () {56 vars in 1096 bytes} [Tue Aug 30 04:16:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:16:32.370139 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fb044c-501d-48dd-aa8b-615cc19a375f None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:32.474276 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:32.522678 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fb044c-501d-48dd-aa8b-615cc19a375f None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:32.565575 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da29690d-1889-4a3b-8fa0-0e91059ccc21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:32.566202 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29690d-1889-4a3b-8fa0-0e91059ccc21 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:32.566474 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29690d-1889-4a3b-8fa0-0e91059ccc21 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:32.566740 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29690d-1889-4a3b-8fa0-0e91059ccc21 None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:32.567419 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da29690d-1889-4a3b-8fa0-0e91059ccc21 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:16:32.567717 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da29690d-1889-4a3b-8fa0-0e91059ccc21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:32.569171 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da29690d-1889-4a3b-8fa0-0e91059ccc21 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:32.579561 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 578/1150] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 30 04:16:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:16:32.585952 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170551e4-94b7-4ae6-bc4e-59d7d5d54014 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:32.707640 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170551e4-94b7-4ae6-bc4e-59d7d5d54014 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:32.725920 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:32.751956 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee3a5e-304a-49a0-b720-00debf4e6ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:32.752663 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee3a5e-304a-49a0-b720-00debf4e6ae1 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:32.752973 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee3a5e-304a-49a0-b720-00debf4e6ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:32.753296 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee3a5e-304a-49a0-b720-00debf4e6ae1 None admin] PATH_INFO: `/v3/users/b77a57d3a6ef40d2b1bb84ee2a79b464` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:32.754778 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ee3a5e-304a-49a0-b720-00debf4e6ae1 None admin] RBAC: Authorizing `identity:get_user(user_id=b77a57d3a6ef40d2b1bb84ee2a79b464)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:32.756385 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ee3a5e-304a-49a0-b720-00debf4e6ae1 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:32.758152 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 573/1151] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 30 04:16:32 2022] GET /identity/v3/users/b77a57d3a6ef40d2b1bb84ee2a79b464 => generated 286 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:16:32.765256 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da29690d-1889-4a3b-8fa0-0e91059ccc21 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:32.904623 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da29690d-1889-4a3b-8fa0-0e91059ccc21 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:32.944699 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:32.961644 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bcced3-fc35-49d7-8282-8a302409f371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:32.962312 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bcced3-fc35-49d7-8282-8a302409f371 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:32.962589 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bcced3-fc35-49d7-8282-8a302409f371 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:32.962864 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bcced3-fc35-49d7-8282-8a302409f371 None admin] PATH_INFO: `/v3/projects/b879ced1645f4380b519612c9992b9b0` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:32.964842 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bcced3-fc35-49d7-8282-8a302409f371 None admin] RBAC: Authorizing `identity:get_project(project_id=b879ced1645f4380b519612c9992b9b0)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:32.966606 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bcced3-fc35-49d7-8282-8a302409f371 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:32.968803 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 579/1152] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 30 04:16:32 2022] GET /identity/v3/projects/b879ced1645f4380b519612c9992b9b0 => generated 311 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:16:32.975786 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee3a5e-304a-49a0-b720-00debf4e6ae1 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:33.104304 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee3a5e-304a-49a0-b720-00debf4e6ae1 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:33.144882 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360d40ed-fcc4-401d-ac70-5452d7f65183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:33.145663 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d40ed-fcc4-401d-ac70-5452d7f65183 None admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:33.145973 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d40ed-fcc4-401d-ac70-5452d7f65183 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:33.146315 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d40ed-fcc4-401d-ac70-5452d7f65183 None admin] PATH_INFO: `/v3/projects/b879ced1645f4380b519612c9992b9b0/users/b77a57d3a6ef40d2b1bb84ee2a79b464/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:33.148820 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360d40ed-fcc4-401d-ac70-5452d7f65183 None admin] RBAC: Authorizing `identity:create_grant(project_id=b879ced1645f4380b519612c9992b9b0, user_id=b77a57d3a6ef40d2b1bb84ee2a79b464, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:33.150493 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360d40ed-fcc4-401d-ac70-5452d7f65183 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:33.168582 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 574/1153] 10.222.0.91 () {58 vars in 1439 bytes} [Tue Aug 30 04:16:32 2022] PUT /identity/v3/projects/b879ced1645f4380b519612c9992b9b0/users/b77a57d3a6ef40d2b1bb84ee2a79b464/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:35.351023 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932853c6-76b8-435d-9e07-c21e37a46c85 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:35.351678 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932853c6-76b8-435d-9e07-c21e37a46c85 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:35.351678 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932853c6-76b8-435d-9e07-c21e37a46c85 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:35.353252 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 580/1154] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:16:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:16:35.360646 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32122b7-18c8-4047-b52c-e2e7e8f90e7d None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:35.361247 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32122b7-18c8-4047-b52c-e2e7e8f90e7d None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:35.361565 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32122b7-18c8-4047-b52c-e2e7e8f90e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:35.393390 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-d32122b7-18c8-4047-b52c-e2e7e8f90e7d None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:35.395400 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-d32122b7-18c8-4047-b52c-e2e7e8f90e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:35.461953 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:35.515026 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 575/1155] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:16:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:16:36.019326 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932853c6-76b8-435d-9e07-c21e37a46c85 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:36.152665 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932853c6-76b8-435d-9e07-c21e37a46c85 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:36.191467 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c7ed7-93ed-48b3-bec7-52828c74dc2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:36.192144 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c7ed7-93ed-48b3-bec7-52828c74dc2e None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:36.192413 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c7ed7-93ed-48b3-bec7-52828c74dc2e None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:36.192674 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c7ed7-93ed-48b3-bec7-52828c74dc2e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:36.206293 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21c7ed7-93ed-48b3-bec7-52828c74dc2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:16:36.211224 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-e21c7ed7-93ed-48b3-bec7-52828c74dc2e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:16:36.211224 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:16:36.211224 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:16:36.211224 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:16:36.211224 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:16:36.211224 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:16:36.211224 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:16:36.211224 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:16:36.211224 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:16:36.211224 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:16:36.211224 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:16:36.211224 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:16:36.211224 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:16:36.211224 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:16:36.211224 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:16:36.211224 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:16:36.213053 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:16:36.213053 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:16:36.213053 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:16:36.213053 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:16:36.213053 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:16:36.213053 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:16:36.213053 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:16:36.213053 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:16:36.213053 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:16:36.213053 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:16:36.213053 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:16:36.213053 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:16:36.213053 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:16:36.213053 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:16:36.213053 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:16:36.213053 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:16:36.214790 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:16:36.214790 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:16:36.214790 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:16:36.214790 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:16:36.214790 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:16:36.214790 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:16:36.214790 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:16:36.214790 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:16:36.214790 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:16:36.214790 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:16:36.214790 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:16:36.214790 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:16:36.214790 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 581/1156] 10.222.0.91 () {56 vars in 1096 bytes} [Tue Aug 30 04:16:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:16:36.222537 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32122b7-18c8-4047-b52c-e2e7e8f90e7d None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:36.346638 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32122b7-18c8-4047-b52c-e2e7e8f90e7d None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:36.390101 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddca87bc-4446-46a8-a9a0-2fd927cbbbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:36.390870 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca87bc-4446-46a8-a9a0-2fd927cbbbd3 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:36.391028 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca87bc-4446-46a8-a9a0-2fd927cbbbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:36.391288 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca87bc-4446-46a8-a9a0-2fd927cbbbd3 None admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:36.392010 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddca87bc-4446-46a8-a9a0-2fd927cbbbd3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:16:36.392317 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddca87bc-4446-46a8-a9a0-2fd927cbbbd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:36.393747 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddca87bc-4446-46a8-a9a0-2fd927cbbbd3 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:36.404900 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 576/1157] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 30 04:16:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:16:36.411603 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c7ed7-93ed-48b3-bec7-52828c74dc2e None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:36.475735 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:36.535856 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c7ed7-93ed-48b3-bec7-52828c74dc2e None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:36.578037 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7e231f-d727-4c87-a619-d235a17ff1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:36.582194 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e231f-d727-4c87-a619-d235a17ff1ac None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:36.582194 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e231f-d727-4c87-a619-d235a17ff1ac None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:36.582194 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e231f-d727-4c87-a619-d235a17ff1ac None admin] PATH_INFO: `/v3/users/b77a57d3a6ef40d2b1bb84ee2a79b464` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:36.582194 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7e231f-d727-4c87-a619-d235a17ff1ac None admin] RBAC: Authorizing `identity:get_user(user_id=b77a57d3a6ef40d2b1bb84ee2a79b464)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:36.582194 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7e231f-d727-4c87-a619-d235a17ff1ac None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:36.583967 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 582/1158] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 30 04:16:36 2022] GET /identity/v3/users/b77a57d3a6ef40d2b1bb84ee2a79b464 => generated 286 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:16:36.590683 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddca87bc-4446-46a8-a9a0-2fd927cbbbd3 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:36.633300 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:36.714047 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddca87bc-4446-46a8-a9a0-2fd927cbbbd3 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:36.755477 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8960b2-694e-436d-a4f6-80539a731e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:36.756127 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8960b2-694e-436d-a4f6-80539a731e54 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:36.756402 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8960b2-694e-436d-a4f6-80539a731e54 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:36.756667 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8960b2-694e-436d-a4f6-80539a731e54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:36.841798 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8960b2-694e-436d-a4f6-80539a731e54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:36.843325 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8960b2-694e-436d-a4f6-80539a731e54 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:36.881680 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:36.984373 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 577/1159] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 30 04:16:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 04:16:36.991067 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7e231f-d727-4c87-a619-d235a17ff1ac None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:37.116366 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7e231f-d727-4c87-a619-d235a17ff1ac None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:37.142962 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:37.162595 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafdc578-9165-4f81-9823-ee7069f040c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:37.163251 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafdc578-9165-4f81-9823-ee7069f040c9 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:37.163528 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafdc578-9165-4f81-9823-ee7069f040c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:37.163787 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafdc578-9165-4f81-9823-ee7069f040c9 None admin] PATH_INFO: `/v3/projects/b879ced1645f4380b519612c9992b9b0` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:37.165140 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafdc578-9165-4f81-9823-ee7069f040c9 None admin] RBAC: Authorizing `identity:get_project(project_id=b879ced1645f4380b519612c9992b9b0)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:37.166869 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafdc578-9165-4f81-9823-ee7069f040c9 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:37.169059 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 583/1160] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 30 04:16:36 2022] GET /identity/v3/projects/b879ced1645f4380b519612c9992b9b0 => generated 311 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:16:37.175839 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8960b2-694e-436d-a4f6-80539a731e54 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:37.302024 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8960b2-694e-436d-a4f6-80539a731e54 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:37.345284 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffca546-9d6a-4726-a3eb-c5a17820902b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:37.345958 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffca546-9d6a-4726-a3eb-c5a17820902b None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:37.346274 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffca546-9d6a-4726-a3eb-c5a17820902b None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:37.346594 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffca546-9d6a-4726-a3eb-c5a17820902b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:37.347385 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffca546-9d6a-4726-a3eb-c5a17820902b None admin] RBAC: Adding query filter params (role.id=d8f440a82947486ebb20a633ebee736b, scope.project.id=b879ced1645f4380b519612c9992b9b0, user.id=b77a57d3a6ef40d2b1bb84ee2a79b464) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:16:37.347727 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffca546-9d6a-4726-a3eb-c5a17820902b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:37.349304 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffca546-9d6a-4726-a3eb-c5a17820902b None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:37.351947 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:37.359115 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 578/1161] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 30 04:16:37 2022] GET /identity/v3/role_assignments?user.id=b77a57d3a6ef40d2b1bb84ee2a79b464&scope.project.id=b879ced1645f4380b519612c9992b9b0&role.id=d8f440a82947486ebb20a633ebee736b => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:16:39.509413 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c803e2d-25fd-4256-a20b-2b8dc0343e94 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:39.510015 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c803e2d-25fd-4256-a20b-2b8dc0343e94 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:39.510015 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c803e2d-25fd-4256-a20b-2b8dc0343e94 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:39.511350 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 584/1162] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:16:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:16:39.518329 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02be1be-fe2e-4406-bd44-e7a5802afedd None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:39.518935 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02be1be-fe2e-4406-bd44-e7a5802afedd None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:39.518935 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02be1be-fe2e-4406-bd44-e7a5802afedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:39.548125 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-b02be1be-fe2e-4406-bd44-e7a5802afedd None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:39.550183 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-b02be1be-fe2e-4406-bd44-e7a5802afedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:39.658227 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 579/1163] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:16:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:16:39.938498 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c803e2d-25fd-4256-a20b-2b8dc0343e94 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:40.068849 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c803e2d-25fd-4256-a20b-2b8dc0343e94 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:40.109926 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b71715-0626-41aa-a7a0-2967d613292f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:40.110563 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b71715-0626-41aa-a7a0-2967d613292f None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:40.110842 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b71715-0626-41aa-a7a0-2967d613292f None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:40.111113 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b71715-0626-41aa-a7a0-2967d613292f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:40.182620 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:40.197582 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b71715-0626-41aa-a7a0-2967d613292f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:40.199696 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b71715-0626-41aa-a7a0-2967d613292f None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:40.319424 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 585/1164] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 30 04:16:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 04:16:40.326662 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02be1be-fe2e-4406-bd44-e7a5802afedd None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:40.464060 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02be1be-fe2e-4406-bd44-e7a5802afedd None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:40.497452 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:40.508145 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23911302-c9ca-49d6-9ea3-89338d795223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:40.508802 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23911302-c9ca-49d6-9ea3-89338d795223 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:40.509071 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23911302-c9ca-49d6-9ea3-89338d795223 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:40.509349 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23911302-c9ca-49d6-9ea3-89338d795223 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:40.518598 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23911302-c9ca-49d6-9ea3-89338d795223 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:40.520134 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23911302-c9ca-49d6-9ea3-89338d795223 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:40.533379 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-23911302-c9ca-49d6-9ea3-89338d795223 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 30 04:16:40.533379 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:16:40.533379 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 30 04:16:40.533379 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 30 04:16:40.533379 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:16:40.533379 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:16:40.533379 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:16:40.533379 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:16:40.533379 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 30 04:16:40.533379 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:16:40.533379 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:16:40.533379 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:16:40.533379 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:16:40.533379 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:16:40.533379 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:16:40.533379 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:16:40.533379 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:16:40.535238 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:16:40.535238 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:16:40.535238 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:16:40.535238 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:16:40.535238 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:16:40.535238 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:16:40.535238 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:16:40.535238 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:16:40.535238 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:16:40.535238 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:16:40.535238 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:16:40.535238 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:16:40.535238 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:16:40.535238 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:16:40.535238 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:16:40.535238 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:16:40.536674 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:16:40.536674 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:16:40.536674 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:16:40.536674 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:16:40.536674 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:16:40.536674 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:16:40.536674 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:16:40.536674 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:16:40.536674 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:16:40.536674 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:16:40.536674 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 30 04:16:40.536674 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:16:40.536674 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 30 04:16:40.536674 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:16:40.536674 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 580/1165] 10.222.0.91 () {56 vars in 1117 bytes} [Tue Aug 30 04:16:40 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:16:40.545517 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b71715-0626-41aa-a7a0-2967d613292f None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:40.713289 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:40.737313 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b71715-0626-41aa-a7a0-2967d613292f None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:40.807096 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a131e6e-bf44-4b0b-8dd7-6554576b327c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:40.808347 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a131e6e-bf44-4b0b-8dd7-6554576b327c None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:40.808825 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a131e6e-bf44-4b0b-8dd7-6554576b327c None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:40.809306 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a131e6e-bf44-4b0b-8dd7-6554576b327c None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:40.810528 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a131e6e-bf44-4b0b-8dd7-6554576b327c None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:16:40.811076 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a131e6e-bf44-4b0b-8dd7-6554576b327c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:40.813829 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a131e6e-bf44-4b0b-8dd7-6554576b327c None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:40.828786 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 586/1166] 10.222.0.91 () {56 vars in 1115 bytes} [Tue Aug 30 04:16:40 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:16:42.910728 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ccaa98-6813-4c85-96cd-0651b6aec13a None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:42.911315 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ccaa98-6813-4c85-96cd-0651b6aec13a None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:42.911315 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ccaa98-6813-4c85-96cd-0651b6aec13a None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:42.912612 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 581/1167] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:16:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:16:42.919862 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db567611-8b15-40ae-8b33-8a8d3f255b13 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:42.920507 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db567611-8b15-40ae-8b33-8a8d3f255b13 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:42.920507 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db567611-8b15-40ae-8b33-8a8d3f255b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:42.942097 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-db567611-8b15-40ae-8b33-8a8d3f255b13 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:42.943489 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-db567611-8b15-40ae-8b33-8a8d3f255b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:43.025022 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 587/1168] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:16:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:16:43.311646 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ccaa98-6813-4c85-96cd-0651b6aec13a None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:43.444548 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ccaa98-6813-4c85-96cd-0651b6aec13a None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:43.485728 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8df13f-4b14-4eee-adc8-af9d82a1e0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:43.486364 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8df13f-4b14-4eee-adc8-af9d82a1e0cf None admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:43.486639 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8df13f-4b14-4eee-adc8-af9d82a1e0cf None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:43.486906 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8df13f-4b14-4eee-adc8-af9d82a1e0cf None admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:43.487589 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8df13f-4b14-4eee-adc8-af9d82a1e0cf None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:43.489031 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8df13f-4b14-4eee-adc8-af9d82a1e0cf None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:43.509365 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 582/1169] 10.222.0.91 () {60 vars in 1138 bytes} [Tue Aug 30 04:16:43 2022] POST /identity/v3/domains => generated 267 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:45.683199 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb2c25-f608-4d8c-9945-0f9366809822 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:45.683821 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb2c25-f608-4d8c-9945-0f9366809822 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:45.683821 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb2c25-f608-4d8c-9945-0f9366809822 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:45.685557 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 588/1170] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:16:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:16:45.691965 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d1fc1-cbc0-4f88-8b7c-e5a4293c8cf4 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:45.692874 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d1fc1-cbc0-4f88-8b7c-e5a4293c8cf4 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:45.692874 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d1fc1-cbc0-4f88-8b7c-e5a4293c8cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:45.712935 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-1e1d1fc1-cbc0-4f88-8b7c-e5a4293c8cf4 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:45.714379 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-1e1d1fc1-cbc0-4f88-8b7c-e5a4293c8cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:45.772752 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:45.802181 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 583/1171] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:16:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 04:16:46.102310 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb2c25-f608-4d8c-9945-0f9366809822 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:46.209028 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:46.232137 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb2c25-f608-4d8c-9945-0f9366809822 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:46.274732 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d0b5f-bd5b-410e-94ea-847046fe2daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:46.275410 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d0b5f-bd5b-410e-94ea-847046fe2daf None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:46.275686 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d0b5f-bd5b-410e-94ea-847046fe2daf None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:46.276639 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d0b5f-bd5b-410e-94ea-847046fe2daf None admin] PATH_INFO: `/v3/domains/4642d2716433487b87803c1d48ca1aa5` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:46.289370 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3d0b5f-bd5b-410e-94ea-847046fe2daf None admin] RBAC: Authorizing `identity:get_domain(domain_id=4642d2716433487b87803c1d48ca1aa5)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:46.290923 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3d0b5f-bd5b-410e-94ea-847046fe2daf None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:46.293699 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 589/1172] 10.222.0.91 () {56 vars in 1183 bytes} [Tue Aug 30 04:16:46 2022] GET /identity/v3/domains/4642d2716433487b87803c1d48ca1aa5 => generated 267 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:16:46.300541 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d1fc1-cbc0-4f88-8b7c-e5a4293c8cf4 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:46.435005 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d1fc1-cbc0-4f88-8b7c-e5a4293c8cf4 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:46.481596 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bcee4e-499d-4335-bb73-aead03b55846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:46.482251 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bcee4e-499d-4335-bb73-aead03b55846 None admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:46.482505 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bcee4e-499d-4335-bb73-aead03b55846 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:46.482797 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bcee4e-499d-4335-bb73-aead03b55846 None admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:46.483479 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bcee4e-499d-4335-bb73-aead03b55846 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:46.484989 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bcee4e-499d-4335-bb73-aead03b55846 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:46.518021 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 584/1173] 10.222.0.91 () {60 vars in 1141 bytes} [Tue Aug 30 04:16:46 2022] POST /identity/v3/projects => generated 361 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:16:48.554434 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac7740-4f96-4e2b-948c-d3da52c8362e None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:48.555073 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac7740-4f96-4e2b-948c-d3da52c8362e None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:48.555073 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac7740-4f96-4e2b-948c-d3da52c8362e None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:48.557178 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 590/1174] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:16:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:16:48.563329 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df537b73-00b5-4679-b01e-907a0db1b7c5 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:48.564029 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df537b73-00b5-4679-b01e-907a0db1b7c5 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:48.564029 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df537b73-00b5-4679-b01e-907a0db1b7c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:48.584168 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-df537b73-00b5-4679-b01e-907a0db1b7c5 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:48.585442 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-df537b73-00b5-4679-b01e-907a0db1b7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:48.613849 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:48.675796 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 585/1175] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:16:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:16:48.946096 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac7740-4f96-4e2b-948c-d3da52c8362e None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:49.069714 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac7740-4f96-4e2b-948c-d3da52c8362e None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:49.110304 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbb4fa7-e0cd-49c0-8449-20f98f9c7a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:49.111072 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb4fa7-e0cd-49c0-8449-20f98f9c7a9f None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:49.111394 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb4fa7-e0cd-49c0-8449-20f98f9c7a9f None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:49.111711 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb4fa7-e0cd-49c0-8449-20f98f9c7a9f None admin] PATH_INFO: `/v3/domains/4642d2716433487b87803c1d48ca1aa5` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:49.113068 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbb4fa7-e0cd-49c0-8449-20f98f9c7a9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=4642d2716433487b87803c1d48ca1aa5)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:49.114601 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbb4fa7-e0cd-49c0-8449-20f98f9c7a9f None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:49.116342 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 591/1176] 10.222.0.91 () {56 vars in 1183 bytes} [Tue Aug 30 04:16:48 2022] GET /identity/v3/domains/4642d2716433487b87803c1d48ca1aa5 => generated 267 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:16:49.122972 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df537b73-00b5-4679-b01e-907a0db1b7c5 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:49.260336 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df537b73-00b5-4679-b01e-907a0db1b7c5 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:49.306476 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0077e9c2-edc1-4e72-b6ba-b022dc144c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:49.307586 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077e9c2-edc1-4e72-b6ba-b022dc144c42 None admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:49.307861 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077e9c2-edc1-4e72-b6ba-b022dc144c42 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:49.308152 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077e9c2-edc1-4e72-b6ba-b022dc144c42 None admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:49.308909 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0077e9c2-edc1-4e72-b6ba-b022dc144c42 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:49.310394 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0077e9c2-edc1-4e72-b6ba-b022dc144c42 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:49.336212 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 586/1177] 10.222.0.91 () {60 vars in 1132 bytes} [Tue Aug 30 04:16:49 2022] POST /identity/v3/users => generated 311 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:16:51.570709 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68683474-f187-47f7-8886-6b61331126b1 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:51.571418 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68683474-f187-47f7-8886-6b61331126b1 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:51.571418 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68683474-f187-47f7-8886-6b61331126b1 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:51.572736 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 592/1178] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:16:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:16:51.579015 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb568a-60ca-4e8d-806f-6556d0c8e8e8 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:51.579616 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb568a-60ca-4e8d-806f-6556d0c8e8e8 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:51.579616 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb568a-60ca-4e8d-806f-6556d0c8e8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:51.599855 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-a2cb568a-60ca-4e8d-806f-6556d0c8e8e8 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:51.601219 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-a2cb568a-60ca-4e8d-806f-6556d0c8e8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:51.617010 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:51.706840 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 587/1179] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:16:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:16:51.978550 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68683474-f187-47f7-8886-6b61331126b1 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:52.003206 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:52.129269 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68683474-f187-47f7-8886-6b61331126b1 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:52.171626 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1b342e-b58b-4e2b-bb77-116173fbfdaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:52.172322 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b342e-b58b-4e2b-bb77-116173fbfdaa None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:52.172592 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b342e-b58b-4e2b-bb77-116173fbfdaa None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:52.172865 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b342e-b58b-4e2b-bb77-116173fbfdaa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:52.186985 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1b342e-b58b-4e2b-bb77-116173fbfdaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:16:52.192001 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-1c1b342e-b58b-4e2b-bb77-116173fbfdaa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:16:52.192001 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:16:52.192001 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:16:52.192001 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:16:52.192001 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:16:52.192001 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:16:52.192001 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:16:52.192001 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:16:52.192001 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:16:52.192001 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:16:52.192001 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:16:52.192001 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:16:52.192001 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:16:52.192001 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:16:52.192001 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:16:52.192001 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:16:52.193391 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:16:52.193391 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:16:52.193391 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:16:52.193391 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:16:52.193391 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:16:52.193391 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:16:52.193391 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:16:52.193391 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:16:52.193391 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:16:52.193391 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:16:52.193391 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:16:52.193391 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:16:52.193391 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:16:52.193391 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:16:52.193391 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:16:52.193391 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:16:52.194853 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:16:52.194853 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:16:52.194853 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:16:52.194853 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:16:52.194853 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:16:52.194853 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:16:52.194853 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:16:52.194853 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:16:52.194853 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:16:52.194853 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:16:52.194853 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:16:52.194853 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:16:52.194853 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 593/1180] 10.222.0.91 () {56 vars in 1096 bytes} [Tue Aug 30 04:16:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:16:52.199981 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb568a-60ca-4e8d-806f-6556d0c8e8e8 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:52.309088 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb568a-60ca-4e8d-806f-6556d0c8e8e8 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:52.347779 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b465a85-4917-4ffd-8608-59115a13825f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:52.348447 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b465a85-4917-4ffd-8608-59115a13825f None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:52.348719 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b465a85-4917-4ffd-8608-59115a13825f None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:52.348985 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b465a85-4917-4ffd-8608-59115a13825f None admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:52.349661 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b465a85-4917-4ffd-8608-59115a13825f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:16:52.349953 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b465a85-4917-4ffd-8608-59115a13825f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:52.351372 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b465a85-4917-4ffd-8608-59115a13825f None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:52.362056 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 588/1181] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 30 04:16:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:16:52.368363 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1b342e-b58b-4e2b-bb77-116173fbfdaa None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:52.449755 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:52.488148 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1b342e-b58b-4e2b-bb77-116173fbfdaa None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:52.542885 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27199878-9954-4446-97ff-d7d1a7c507b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:52.544352 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27199878-9954-4446-97ff-d7d1a7c507b5 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:52.544837 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27199878-9954-4446-97ff-d7d1a7c507b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:52.545586 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27199878-9954-4446-97ff-d7d1a7c507b5 None admin] PATH_INFO: `/v3/users/374e3ae0e52b4d2cb065c4aa8545b2c7` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:52.568345 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27199878-9954-4446-97ff-d7d1a7c507b5 None admin] RBAC: Authorizing `identity:get_user(user_id=374e3ae0e52b4d2cb065c4aa8545b2c7)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:52.569819 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27199878-9954-4446-97ff-d7d1a7c507b5 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:52.571599 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 594/1182] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 30 04:16:52 2022] GET /identity/v3/users/374e3ae0e52b4d2cb065c4aa8545b2c7 => generated 311 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:16:52.578540 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b465a85-4917-4ffd-8608-59115a13825f None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:52.592200 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:52.739150 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b465a85-4917-4ffd-8608-59115a13825f None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:52.778383 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab3ec6-437f-4037-adc0-88b3ac65b3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:52.779021 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab3ec6-437f-4037-adc0-88b3ac65b3ce None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:52.779286 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab3ec6-437f-4037-adc0-88b3ac65b3ce None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:52.779555 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab3ec6-437f-4037-adc0-88b3ac65b3ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:52.859833 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ab3ec6-437f-4037-adc0-88b3ac65b3ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:52.861404 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ab3ec6-437f-4037-adc0-88b3ac65b3ce None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:52.874934 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:52.982819 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 589/1183] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 30 04:16:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 04:16:52.989623 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27199878-9954-4446-97ff-d7d1a7c507b5 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:53.109231 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27199878-9954-4446-97ff-d7d1a7c507b5 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:53.140970 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:53.151898 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73339368-e4c7-4f93-98a8-b17fd51dc9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:53.152579 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73339368-e4c7-4f93-98a8-b17fd51dc9fc None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:53.152875 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73339368-e4c7-4f93-98a8-b17fd51dc9fc None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:53.153146 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73339368-e4c7-4f93-98a8-b17fd51dc9fc None admin] PATH_INFO: `/v3/projects/496db594664f4ed6bccac97451031dfb` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:53.154383 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73339368-e4c7-4f93-98a8-b17fd51dc9fc None admin] RBAC: Authorizing `identity:get_project(project_id=496db594664f4ed6bccac97451031dfb)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:53.155888 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73339368-e4c7-4f93-98a8-b17fd51dc9fc None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:53.157727 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 595/1184] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 30 04:16:52 2022] GET /identity/v3/projects/496db594664f4ed6bccac97451031dfb => generated 361 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:16:53.164906 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab3ec6-437f-4037-adc0-88b3ac65b3ce None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:53.286097 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab3ec6-437f-4037-adc0-88b3ac65b3ce None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:53.298853 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:53.330000 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a32f16-ec27-4198-88de-85438dbc7271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:53.330611 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a32f16-ec27-4198-88de-85438dbc7271 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:53.330882 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a32f16-ec27-4198-88de-85438dbc7271 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:53.331147 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a32f16-ec27-4198-88de-85438dbc7271 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:53.331882 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a32f16-ec27-4198-88de-85438dbc7271 None admin] RBAC: Adding query filter params (role.id=d8f440a82947486ebb20a633ebee736b, scope.project.id=496db594664f4ed6bccac97451031dfb, user.id=374e3ae0e52b4d2cb065c4aa8545b2c7) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:16:53.332213 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a32f16-ec27-4198-88de-85438dbc7271 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:53.333672 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a32f16-ec27-4198-88de-85438dbc7271 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:53.339971 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 590/1185] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 30 04:16:53 2022] GET /identity/v3/role_assignments?user.id=374e3ae0e52b4d2cb065c4aa8545b2c7&scope.project.id=496db594664f4ed6bccac97451031dfb&role.id=d8f440a82947486ebb20a633ebee736b => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:16:55.420415 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5414c5-214c-4d80-82f8-af03fa12ae42 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:55.421074 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5414c5-214c-4d80-82f8-af03fa12ae42 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:55.421074 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5414c5-214c-4d80-82f8-af03fa12ae42 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:55.423248 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 596/1186] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:16:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:16:55.430629 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e92536-6a20-4d67-bcad-c27a4021da12 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:55.431223 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e92536-6a20-4d67-bcad-c27a4021da12 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:55.431223 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e92536-6a20-4d67-bcad-c27a4021da12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:55.453082 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-c5e92536-6a20-4d67-bcad-c27a4021da12 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:55.454337 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-c5e92536-6a20-4d67-bcad-c27a4021da12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:55.536423 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 591/1187] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:16:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:16:55.812961 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5414c5-214c-4d80-82f8-af03fa12ae42 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:55.935845 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5414c5-214c-4d80-82f8-af03fa12ae42 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:55.976453 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914237c-320c-4b37-b673-577e75637eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:55.977100 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914237c-320c-4b37-b673-577e75637eec None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:55.977399 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914237c-320c-4b37-b673-577e75637eec None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:55.977658 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914237c-320c-4b37-b673-577e75637eec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:55.990713 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9914237c-320c-4b37-b673-577e75637eec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:16:55.995799 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-9914237c-320c-4b37-b673-577e75637eec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:16:55.995799 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:16:55.995799 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:16:55.995799 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:16:55.995799 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:16:55.995799 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:16:55.995799 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:16:55.995799 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:16:55.995799 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:16:55.995799 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:16:55.995799 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:16:55.995799 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:16:55.995799 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:16:55.995799 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:16:55.995799 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:16:55.995799 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:16:55.997432 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:16:55.997432 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:16:55.997432 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:16:55.997432 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:16:55.997432 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:16:55.997432 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:16:55.997432 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:16:55.997432 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:16:55.997432 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:16:55.997432 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:16:55.997432 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:16:55.997432 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:16:55.997432 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:16:55.997432 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:16:55.997432 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:16:55.997432 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:16:55.998327 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:16:55.998327 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:16:55.998327 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:16:55.998327 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:16:55.998327 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:16:55.998327 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:16:55.998327 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:16:55.998327 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:16:55.998327 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:16:55.998327 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:16:55.998327 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:16:55.998327 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:16:55.998327 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 597/1188] 10.222.0.91 () {56 vars in 1096 bytes} [Tue Aug 30 04:16:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:16:56.007945 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e92536-6a20-4d67-bcad-c27a4021da12 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:56.165810 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e92536-6a20-4d67-bcad-c27a4021da12 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:56.168272 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:56.210291 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3402426c-9342-40e8-8c57-581dbecc92fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:56.210916 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402426c-9342-40e8-8c57-581dbecc92fa None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:56.211190 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402426c-9342-40e8-8c57-581dbecc92fa None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:56.211451 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402426c-9342-40e8-8c57-581dbecc92fa None admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:56.212163 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3402426c-9342-40e8-8c57-581dbecc92fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:16:56.212457 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3402426c-9342-40e8-8c57-581dbecc92fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:56.213857 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3402426c-9342-40e8-8c57-581dbecc92fa None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:56.223804 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 592/1189] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 30 04:16:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:16:56.231009 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914237c-320c-4b37-b673-577e75637eec None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:56.301700 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:56.357436 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914237c-320c-4b37-b673-577e75637eec None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:56.399549 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c982b26d-1bea-4a77-b178-7477c662e6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:56.400229 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982b26d-1bea-4a77-b178-7477c662e6d7 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:56.400509 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982b26d-1bea-4a77-b178-7477c662e6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:56.400818 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982b26d-1bea-4a77-b178-7477c662e6d7 None admin] PATH_INFO: `/v3/users/374e3ae0e52b4d2cb065c4aa8545b2c7` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:56.402854 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c982b26d-1bea-4a77-b178-7477c662e6d7 None admin] RBAC: Authorizing `identity:get_user(user_id=374e3ae0e52b4d2cb065c4aa8545b2c7)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:56.404438 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c982b26d-1bea-4a77-b178-7477c662e6d7 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:56.406201 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 598/1190] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 30 04:16:56 2022] GET /identity/v3/users/374e3ae0e52b4d2cb065c4aa8545b2c7 => generated 311 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:16:56.415619 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3402426c-9342-40e8-8c57-581dbecc92fa None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:56.540080 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3402426c-9342-40e8-8c57-581dbecc92fa None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:56.581045 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aca03e-8d21-4905-a9cb-e8295e6f46ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:56.581704 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aca03e-8d21-4905-a9cb-e8295e6f46ee None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:56.581988 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aca03e-8d21-4905-a9cb-e8295e6f46ee None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:56.582256 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aca03e-8d21-4905-a9cb-e8295e6f46ee None admin] PATH_INFO: `/v3/projects/496db594664f4ed6bccac97451031dfb` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:56.583498 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aca03e-8d21-4905-a9cb-e8295e6f46ee None admin] RBAC: Authorizing `identity:get_project(project_id=496db594664f4ed6bccac97451031dfb)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:56.585008 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aca03e-8d21-4905-a9cb-e8295e6f46ee None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:56.586735 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 593/1191] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 30 04:16:56 2022] GET /identity/v3/projects/496db594664f4ed6bccac97451031dfb => generated 361 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:16:56.594614 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c982b26d-1bea-4a77-b178-7477c662e6d7 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:56.721055 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c982b26d-1bea-4a77-b178-7477c662e6d7 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:56.750659 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:56.764948 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeecbc3-3a7b-4e2a-bff2-a5770b7d4011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:56.765647 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeecbc3-3a7b-4e2a-bff2-a5770b7d4011 None admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:56.765923 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeecbc3-3a7b-4e2a-bff2-a5770b7d4011 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:56.766198 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeecbc3-3a7b-4e2a-bff2-a5770b7d4011 None admin] PATH_INFO: `/v3/projects/496db594664f4ed6bccac97451031dfb/users/374e3ae0e52b4d2cb065c4aa8545b2c7/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:56.768377 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeecbc3-3a7b-4e2a-bff2-a5770b7d4011 None admin] RBAC: Authorizing `identity:create_grant(project_id=496db594664f4ed6bccac97451031dfb, user_id=374e3ae0e52b4d2cb065c4aa8545b2c7, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:56.769861 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeecbc3-3a7b-4e2a-bff2-a5770b7d4011 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:56.786278 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 599/1192] 10.222.0.91 () {58 vars in 1439 bytes} [Tue Aug 30 04:16:56 2022] PUT /identity/v3/projects/496db594664f4ed6bccac97451031dfb/users/374e3ae0e52b4d2cb065c4aa8545b2c7/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:58.923365 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8a868-4497-44b1-953e-c083350b356b None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:58.923965 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8a868-4497-44b1-953e-c083350b356b None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:58.923965 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8a868-4497-44b1-953e-c083350b356b None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:58.925401 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 594/1193] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:16:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:16:58.931683 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624332c5-8026-42dd-89f1-b63e3a640e46 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:58.932387 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624332c5-8026-42dd-89f1-b63e3a640e46 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:58.932387 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624332c5-8026-42dd-89f1-b63e3a640e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:58.954341 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-624332c5-8026-42dd-89f1-b63e3a640e46 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:58.955575 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-624332c5-8026-42dd-89f1-b63e3a640e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:59.051799 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 600/1194] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:16:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:16:59.404305 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e8a868-4497-44b1-953e-c083350b356b None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:59.452988 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:59.563668 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e8a868-4497-44b1-953e-c083350b356b None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:59.600194 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aec022-ad2e-46ae-afd1-8727c33ff42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:59.600860 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aec022-ad2e-46ae-afd1-8727c33ff42b None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:59.601140 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aec022-ad2e-46ae-afd1-8727c33ff42b None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:59.601404 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aec022-ad2e-46ae-afd1-8727c33ff42b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:59.615764 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aec022-ad2e-46ae-afd1-8727c33ff42b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:16:59.621013 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-38aec022-ad2e-46ae-afd1-8727c33ff42b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:16:59.621013 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:16:59.621013 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:16:59.621013 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:16:59.621013 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:16:59.621013 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:16:59.621013 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:16:59.621013 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:16:59.621013 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:16:59.621013 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:16:59.621013 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:16:59.621013 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:16:59.621013 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:16:59.621013 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:16:59.621013 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:16:59.621013 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:16:59.622278 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:16:59.622278 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:16:59.622278 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:16:59.622278 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:16:59.622278 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:16:59.622278 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:16:59.622278 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:16:59.622278 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:16:59.622278 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:16:59.622278 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:16:59.622278 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:16:59.622278 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:16:59.622278 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:16:59.622278 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:16:59.622278 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:16:59.622278 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:16:59.623160 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:16:59.623160 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:16:59.623160 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:16:59.623160 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:16:59.623160 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:16:59.623160 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:16:59.623160 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:16:59.623160 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:16:59.623160 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:16:59.623160 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:16:59.623160 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:16:59.623160 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:16:59.623160 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 595/1195] 10.222.0.91 () {56 vars in 1096 bytes} [Tue Aug 30 04:16:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:16:59.628752 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624332c5-8026-42dd-89f1-b63e3a640e46 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:59.745257 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624332c5-8026-42dd-89f1-b63e3a640e46 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:59.761226 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:59.785010 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1088e8de-aa14-42f9-a8fe-483615ba1622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:59.785642 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1088e8de-aa14-42f9-a8fe-483615ba1622 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:59.785918 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1088e8de-aa14-42f9-a8fe-483615ba1622 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:59.786187 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1088e8de-aa14-42f9-a8fe-483615ba1622 None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:59.786876 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1088e8de-aa14-42f9-a8fe-483615ba1622 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:16:59.787176 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1088e8de-aa14-42f9-a8fe-483615ba1622 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:59.788652 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1088e8de-aa14-42f9-a8fe-483615ba1622 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:59.798961 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 601/1196] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 30 04:16:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:16:59.806113 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aec022-ad2e-46ae-afd1-8727c33ff42b None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:59.909631 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:59.920730 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aec022-ad2e-46ae-afd1-8727c33ff42b None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:59.958903 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3726ced-0c1a-4b01-a01a-cf0293bc4916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:59.959660 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3726ced-0c1a-4b01-a01a-cf0293bc4916 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:59.959805 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3726ced-0c1a-4b01-a01a-cf0293bc4916 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:59.960112 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3726ced-0c1a-4b01-a01a-cf0293bc4916 None admin] PATH_INFO: `/v3/users/374e3ae0e52b4d2cb065c4aa8545b2c7` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:59.961350 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3726ced-0c1a-4b01-a01a-cf0293bc4916 None admin] RBAC: Authorizing `identity:get_user(user_id=374e3ae0e52b4d2cb065c4aa8545b2c7)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:59.962844 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3726ced-0c1a-4b01-a01a-cf0293bc4916 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:59.964571 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 596/1197] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 30 04:16:59 2022] GET /identity/v3/users/374e3ae0e52b4d2cb065c4aa8545b2c7 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:16:59.971046 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1088e8de-aa14-42f9-a8fe-483615ba1622 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:00.078351 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1088e8de-aa14-42f9-a8fe-483615ba1622 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:00.114447 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09e3f53-fc2b-4099-89a7-d4ad1efda537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:00.115055 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e3f53-fc2b-4099-89a7-d4ad1efda537 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:00.115308 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e3f53-fc2b-4099-89a7-d4ad1efda537 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:00.115568 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e3f53-fc2b-4099-89a7-d4ad1efda537 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:00.165496 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:00.192662 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09e3f53-fc2b-4099-89a7-d4ad1efda537 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:00.194159 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09e3f53-fc2b-4099-89a7-d4ad1efda537 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:00.303178 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 602/1198] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 30 04:16:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 04:17:00.309794 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3726ced-0c1a-4b01-a01a-cf0293bc4916 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:00.428274 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3726ced-0c1a-4b01-a01a-cf0293bc4916 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:00.467827 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b09e2c2-92ba-48ff-b995-dd4e04fca995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:00.468570 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09e2c2-92ba-48ff-b995-dd4e04fca995 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:00.468937 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09e2c2-92ba-48ff-b995-dd4e04fca995 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:00.469259 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09e2c2-92ba-48ff-b995-dd4e04fca995 None admin] PATH_INFO: `/v3/projects/496db594664f4ed6bccac97451031dfb` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:00.470524 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b09e2c2-92ba-48ff-b995-dd4e04fca995 None admin] RBAC: Authorizing `identity:get_project(project_id=496db594664f4ed6bccac97451031dfb)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:00.472117 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b09e2c2-92ba-48ff-b995-dd4e04fca995 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:00.473931 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 597/1199] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 30 04:17:00 2022] GET /identity/v3/projects/496db594664f4ed6bccac97451031dfb => generated 361 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:17:00.482394 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09e3f53-fc2b-4099-89a7-d4ad1efda537 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:00.576808 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:00.605428 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09e3f53-fc2b-4099-89a7-d4ad1efda537 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:00.652300 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbc8c5d-bd05-4fdf-aeeb-6301617f54a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:00.652937 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc8c5d-bd05-4fdf-aeeb-6301617f54a8 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:00.653254 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc8c5d-bd05-4fdf-aeeb-6301617f54a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:00.653568 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc8c5d-bd05-4fdf-aeeb-6301617f54a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:00.654367 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbc8c5d-bd05-4fdf-aeeb-6301617f54a8 None admin] RBAC: Adding query filter params (role.id=d8f440a82947486ebb20a633ebee736b, scope.project.id=496db594664f4ed6bccac97451031dfb, user.id=374e3ae0e52b4d2cb065c4aa8545b2c7) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:17:00.654714 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbc8c5d-bd05-4fdf-aeeb-6301617f54a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:00.656292 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbc8c5d-bd05-4fdf-aeeb-6301617f54a8 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:00.663475 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 603/1200] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 30 04:17:00 2022] GET /identity/v3/role_assignments?user.id=374e3ae0e52b4d2cb065c4aa8545b2c7&scope.project.id=496db594664f4ed6bccac97451031dfb&role.id=d8f440a82947486ebb20a633ebee736b => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:17:10.462339 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=86 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:10.660186 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=30 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:04.397143 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff840c7f-bfa6-459d-b7f9-a647db8c7e88 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:04.397805 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff840c7f-bfa6-459d-b7f9-a647db8c7e88 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:04.398175 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff840c7f-bfa6-459d-b7f9-a647db8c7e88 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:04.404190 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 598/1201] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:18:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:18:04.407709 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56062e58-4b5c-4ec8-b030-70e3be8f4a3b None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:04.408572 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56062e58-4b5c-4ec8-b030-70e3be8f4a3b None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:04.408572 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56062e58-4b5c-4ec8-b030-70e3be8f4a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:04.443624 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-56062e58-4b5c-4ec8-b030-70e3be8f4a3b None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:18:04.445232 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-56062e58-4b5c-4ec8-b030-70e3be8f4a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:04.579225 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 604/1202] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:18:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:18:05.016846 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff840c7f-bfa6-459d-b7f9-a647db8c7e88 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:05.205580 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff840c7f-bfa6-459d-b7f9-a647db8c7e88 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:05.268039 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d57c13f-5ee1-44c2-a1dc-b198c8502abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:05.269002 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57c13f-5ee1-44c2-a1dc-b198c8502abf None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:05.269452 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57c13f-5ee1-44c2-a1dc-b198c8502abf None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:05.269893 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57c13f-5ee1-44c2-a1dc-b198c8502abf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:05.290082 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d57c13f-5ee1-44c2-a1dc-b198c8502abf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:05.293524 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d57c13f-5ee1-44c2-a1dc-b198c8502abf None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:05.321259 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-7d57c13f-5ee1-44c2-a1dc-b198c8502abf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:18:05.321259 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:18:05.321259 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:18:05.321259 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:18:05.321259 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:18:05.321259 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:18:05.321259 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:18:05.321259 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:18:05.321259 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:18:05.321259 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:18:05.321259 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:18:05.321259 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:18:05.321259 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:18:05.321259 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:18:05.321259 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:18:05.321259 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:18:05.322645 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:18:05.322645 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:18:05.322645 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:18:05.322645 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:18:05.322645 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:18:05.322645 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:18:05.322645 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:18:05.322645 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:18:05.322645 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:18:05.322645 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:18:05.322645 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:18:05.322645 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:18:05.322645 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:18:05.322645 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:18:05.322645 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:18:05.322645 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:18:05.322645 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:18:05.325045 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:18:05.325045 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:18:05.325045 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:18:05.325045 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 599/1203] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:18:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:18:05.331358 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56062e58-4b5c-4ec8-b030-70e3be8f4a3b None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:05.508147 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56062e58-4b5c-4ec8-b030-70e3be8f4a3b None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:05.564510 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:05.578734 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e1009e-e3cd-466f-925d-d08b7ae5da89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:05.579775 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1009e-e3cd-466f-925d-d08b7ae5da89 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:05.580292 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1009e-e3cd-466f-925d-d08b7ae5da89 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:05.580767 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1009e-e3cd-466f-925d-d08b7ae5da89 None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:05.581913 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e1009e-e3cd-466f-925d-d08b7ae5da89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:18:05.582437 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e1009e-e3cd-466f-925d-d08b7ae5da89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:05.585112 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e1009e-e3cd-466f-925d-d08b7ae5da89 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:05.609186 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 605/1204] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:18:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:18:05.620822 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d57c13f-5ee1-44c2-a1dc-b198c8502abf None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:05.746610 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:05.848085 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d57c13f-5ee1-44c2-a1dc-b198c8502abf None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:05.906781 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa43c4-f157-408d-8f58-4844f8f4c3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:05.908160 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa43c4-f157-408d-8f58-4844f8f4c3bb None admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:05.908708 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa43c4-f157-408d-8f58-4844f8f4c3bb None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:05.909097 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa43c4-f157-408d-8f58-4844f8f4c3bb None admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:05.910978 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fa43c4-f157-408d-8f58-4844f8f4c3bb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:05.914947 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fa43c4-f157-408d-8f58-4844f8f4c3bb None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:05.964017 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 600/1205] 10.222.0.91 () {60 vars in 1132 bytes} [Tue Aug 30 04:18:05 2022] POST /identity/v3/users => generated 251 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:18:09.450943 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d663304-9628-4567-871f-6b23baa2544c None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:09.450943 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d663304-9628-4567-871f-6b23baa2544c None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:09.452095 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d663304-9628-4567-871f-6b23baa2544c None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:09.453373 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 606/1206] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:18:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:18:09.465640 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0c46f-863c-4547-a0c0-af0d6a032ca7 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:09.466452 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0c46f-863c-4547-a0c0-af0d6a032ca7 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:09.466759 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0c46f-863c-4547-a0c0-af0d6a032ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:09.501529 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-e8e0c46f-863c-4547-a0c0-af0d6a032ca7 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:18:09.504318 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-e8e0c46f-863c-4547-a0c0-af0d6a032ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:09.643968 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 601/1207] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:18:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:18:09.943856 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d663304-9628-4567-871f-6b23baa2544c None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:10.123635 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d663304-9628-4567-871f-6b23baa2544c None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:10.175699 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34405a-8bff-42d6-999f-4355f5a1fc8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:10.176741 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34405a-8bff-42d6-999f-4355f5a1fc8a None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:10.177084 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34405a-8bff-42d6-999f-4355f5a1fc8a None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:10.177342 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34405a-8bff-42d6-999f-4355f5a1fc8a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:10.192192 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd34405a-8bff-42d6-999f-4355f5a1fc8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:18:10.197469 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-fd34405a-8bff-42d6-999f-4355f5a1fc8a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:18:10.197469 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:18:10.197469 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:18:10.197469 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:18:10.197469 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:18:10.197469 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:18:10.197469 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:18:10.197469 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:18:10.197469 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:18:10.197469 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:18:10.197469 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:18:10.197469 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:18:10.197469 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:18:10.197469 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:18:10.197469 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:18:10.197469 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:18:10.200880 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:18:10.200880 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:18:10.200880 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:18:10.200880 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:18:10.200880 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:18:10.200880 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:18:10.200880 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:18:10.200880 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:18:10.200880 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:18:10.200880 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:18:10.200880 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:18:10.200880 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:18:10.200880 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:18:10.200880 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:18:10.200880 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:18:10.200880 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:18:10.202582 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:18:10.202582 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:18:10.202582 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:18:10.202582 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:18:10.202582 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:18:10.202582 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:18:10.202582 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:18:10.202582 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:18:10.202582 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:18:10.202582 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:18:10.202582 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:18:10.202582 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:18:10.202582 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 607/1208] 10.222.0.91 () {56 vars in 1102 bytes} [Tue Aug 30 04:18:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:18:10.207794 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e0c46f-863c-4547-a0c0-af0d6a032ca7 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:10.268742 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:10.375046 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e0c46f-863c-4547-a0c0-af0d6a032ca7 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:10.441989 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c4d17a-a787-424f-bf2c-9914366c4386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:10.442986 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c4d17a-a787-424f-bf2c-9914366c4386 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:10.443426 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c4d17a-a787-424f-bf2c-9914366c4386 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:10.443798 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c4d17a-a787-424f-bf2c-9914366c4386 None admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:10.444919 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c4d17a-a787-424f-bf2c-9914366c4386 None admin] RBAC: Adding query filter params (name=service) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:18:10.445370 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c4d17a-a787-424f-bf2c-9914366c4386 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:10.447636 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c4d17a-a787-424f-bf2c-9914366c4386 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:10.464241 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 602/1209] 10.222.0.91 () {56 vars in 1103 bytes} [Tue Aug 30 04:18:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:18:10.473024 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34405a-8bff-42d6-999f-4355f5a1fc8a None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:10.547810 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:10.668303 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34405a-8bff-42d6-999f-4355f5a1fc8a None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:10.728091 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c68038c-b5bc-4a0f-a7c1-e996f6ae3d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:10.729414 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68038c-b5bc-4a0f-a7c1-e996f6ae3d86 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:10.730588 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68038c-b5bc-4a0f-a7c1-e996f6ae3d86 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:10.731264 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68038c-b5bc-4a0f-a7c1-e996f6ae3d86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:10.747547 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c68038c-b5bc-4a0f-a7c1-e996f6ae3d86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:10.750011 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c68038c-b5bc-4a0f-a7c1-e996f6ae3d86 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:10.772474 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-3c68038c-b5bc-4a0f-a7c1-e996f6ae3d86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:18:10.772474 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:18:10.772474 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:18:10.772474 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:18:10.772474 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:18:10.772474 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:18:10.772474 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:18:10.772474 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:18:10.772474 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:18:10.772474 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:18:10.772474 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:18:10.772474 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:18:10.772474 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:18:10.772474 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:18:10.772474 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:18:10.772474 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:18:10.774440 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:18:10.774440 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:18:10.774440 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:18:10.774440 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:18:10.774440 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:18:10.774440 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:18:10.774440 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:18:10.774440 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:18:10.774440 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:18:10.774440 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:18:10.774440 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:18:10.774440 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:18:10.774440 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:18:10.774440 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:18:10.774440 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:18:10.774440 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:18:10.774440 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:18:10.775662 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:18:10.775662 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:18:10.775662 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:18:10.775662 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 608/1210] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:18:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:18:10.784733 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c4d17a-a787-424f-bf2c-9914366c4386 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:10.950396 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:10.954401 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c4d17a-a787-424f-bf2c-9914366c4386 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:11.001983 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e51ca1-b021-4ea7-a9f0-d36f3259e5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:11.002606 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e51ca1-b021-4ea7-a9f0-d36f3259e5ac None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:11.002958 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e51ca1-b021-4ea7-a9f0-d36f3259e5ac None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:11.003215 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e51ca1-b021-4ea7-a9f0-d36f3259e5ac None admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:11.004095 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e51ca1-b021-4ea7-a9f0-d36f3259e5ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:18:11.004464 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e51ca1-b021-4ea7-a9f0-d36f3259e5ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:11.006101 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e51ca1-b021-4ea7-a9f0-d36f3259e5ac None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:11.026077 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 603/1211] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:18:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:18:11.035089 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c68038c-b5bc-4a0f-a7c1-e996f6ae3d86 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:11.197157 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c68038c-b5bc-4a0f-a7c1-e996f6ae3d86 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:11.199522 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:11.257229 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763089ae-7cc1-49fb-89c0-aa93779eda4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:11.258882 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763089ae-7cc1-49fb-89c0-aa93779eda4a None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:11.259552 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763089ae-7cc1-49fb-89c0-aa93779eda4a None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:11.259984 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763089ae-7cc1-49fb-89c0-aa93779eda4a None admin] PATH_INFO: `/v3/users/placement` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:11.274688 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763089ae-7cc1-49fb-89c0-aa93779eda4a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:11.276649 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763089ae-7cc1-49fb-89c0-aa93779eda4a None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:11.299343 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-763089ae-7cc1-49fb-89c0-aa93779eda4a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 04:18:11.299343 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:18:11.299343 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:18:11.299343 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:18:11.299343 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:18:11.299343 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:18:11.299343 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:18:11.299343 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:18:11.299343 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:18:11.299343 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:18:11.299343 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:18:11.299343 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:18:11.299343 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:18:11.299343 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:18:11.299343 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:18:11.299343 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:18:11.306678 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:18:11.306678 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:18:11.306678 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:18:11.306678 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:18:11.306678 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:18:11.306678 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:18:11.306678 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:18:11.306678 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:18:11.306678 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:18:11.306678 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:18:11.306678 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:18:11.306678 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:18:11.306678 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:18:11.306678 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:18:11.306678 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:18:11.306678 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:18:11.306678 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:18:11.306678 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:18:11.308565 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:18:11.308565 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:18:11.308565 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:18:11.308565 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:18:11.308565 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:18:11.308565 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:18:11.308565 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:18:11.308565 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:18:11.308565 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 04:18:11.308565 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:18:11.308565 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 609/1212] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:18:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:18:11.314474 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e51ca1-b021-4ea7-a9f0-d36f3259e5ac None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:11.491259 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e51ca1-b021-4ea7-a9f0-d36f3259e5ac None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:11.542843 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c3245-c081-4e3b-a363-4d2b582a5ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:11.543771 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c3245-c081-4e3b-a363-4d2b582a5ab4 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:11.544023 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c3245-c081-4e3b-a363-4d2b582a5ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:11.544306 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c3245-c081-4e3b-a363-4d2b582a5ab4 None admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:11.545468 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265c3245-c081-4e3b-a363-4d2b582a5ab4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:18:11.545772 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265c3245-c081-4e3b-a363-4d2b582a5ab4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:11.547412 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265c3245-c081-4e3b-a363-4d2b582a5ab4 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:11.573097 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 604/1213] 10.222.0.91 () {56 vars in 1143 bytes} [Tue Aug 30 04:18:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:18:11.581596 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763089ae-7cc1-49fb-89c0-aa93779eda4a None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:11.775232 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763089ae-7cc1-49fb-89c0-aa93779eda4a None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:11.841868 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e23d39-0edb-4143-afaa-73cff282902c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:11.842679 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e23d39-0edb-4143-afaa-73cff282902c None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:11.843109 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e23d39-0edb-4143-afaa-73cff282902c None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:11.845485 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e23d39-0edb-4143-afaa-73cff282902c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:11.906014 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:11.992061 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e23d39-0edb-4143-afaa-73cff282902c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:11.994896 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e23d39-0edb-4143-afaa-73cff282902c None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:12.192808 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 610/1214] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 30 04:18:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 613 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 04:18:12.205225 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c3245-c081-4e3b-a363-4d2b582a5ab4 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:12.250420 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:12.435445 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c3245-c081-4e3b-a363-4d2b582a5ab4 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:12.513220 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aab6f5d-e9cd-4c64-ad9c-b478a619c626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:12.513877 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab6f5d-e9cd-4c64-ad9c-b478a619c626 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:12.514294 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab6f5d-e9cd-4c64-ad9c-b478a619c626 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:12.514673 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab6f5d-e9cd-4c64-ad9c-b478a619c626 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:12.537717 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aab6f5d-e9cd-4c64-ad9c-b478a619c626 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:12.540901 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aab6f5d-e9cd-4c64-ad9c-b478a619c626 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:12.574378 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-9aab6f5d-e9cd-4c64-ad9c-b478a619c626 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:18:12.574378 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:18:12.574378 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:18:12.574378 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:18:12.574378 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:18:12.574378 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:18:12.574378 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:18:12.574378 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:18:12.574378 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:18:12.574378 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:18:12.574378 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:18:12.574378 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:18:12.574378 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:18:12.574378 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:18:12.574378 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:18:12.574378 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:18:12.576702 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:18:12.576702 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:18:12.576702 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:18:12.576702 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:18:12.576702 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:18:12.576702 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:18:12.576702 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:18:12.576702 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:18:12.576702 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:18:12.576702 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:18:12.576702 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:18:12.576702 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:18:12.576702 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:18:12.576702 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:18:12.576702 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:18:12.576702 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:18:12.576702 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:18:12.578859 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:18:12.578859 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:18:12.578859 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:18:12.578859 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 605/1215] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:18:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:18:12.584329 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e23d39-0edb-4143-afaa-73cff282902c None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:12.683187 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:12.747797 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e23d39-0edb-4143-afaa-73cff282902c None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:12.806702 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc3ad7d-47c0-4b72-8729-74b84b3c9c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:12.807602 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3ad7d-47c0-4b72-8729-74b84b3c9c93 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:12.808124 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3ad7d-47c0-4b72-8729-74b84b3c9c93 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:12.808608 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3ad7d-47c0-4b72-8729-74b84b3c9c93 None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:12.809791 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc3ad7d-47c0-4b72-8729-74b84b3c9c93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:18:12.810322 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc3ad7d-47c0-4b72-8729-74b84b3c9c93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:12.812862 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc3ad7d-47c0-4b72-8729-74b84b3c9c93 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:12.834560 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 611/1216] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:18:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:18:12.841848 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aab6f5d-e9cd-4c64-ad9c-b478a619c626 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:12.946337 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:13.006364 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aab6f5d-e9cd-4c64-ad9c-b478a619c626 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:13.071429 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f9a15-847d-4862-9cbe-be37fdc28c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:13.072311 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f9a15-847d-4862-9cbe-be37fdc28c8f None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:13.072795 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f9a15-847d-4862-9cbe-be37fdc28c8f None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:13.073290 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f9a15-847d-4862-9cbe-be37fdc28c8f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:13.083794 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f9a15-847d-4862-9cbe-be37fdc28c8f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:13.085353 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f9a15-847d-4862-9cbe-be37fdc28c8f None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:13.099058 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-ac0f9a15-847d-4862-9cbe-be37fdc28c8f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:18:13.099058 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:18:13.099058 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:18:13.099058 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:18:13.099058 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:18:13.099058 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:18:13.099058 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:18:13.099058 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:18:13.099058 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:18:13.099058 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:18:13.099058 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:18:13.099058 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:18:13.099058 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:18:13.099058 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:18:13.099058 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:18:13.101081 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:18:13.101081 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:18:13.101081 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:18:13.101081 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:18:13.101081 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:18:13.101081 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:18:13.101081 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:18:13.101081 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:18:13.101081 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:18:13.101081 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:18:13.101081 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:18:13.101081 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:18:13.101081 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:18:13.101081 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:18:13.101081 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:18:13.101081 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:18:13.101081 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:18:13.102871 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:18:13.102871 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:18:13.102871 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:18:13.102871 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:18:13.102871 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:18:13.102871 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:18:13.102871 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:18:13.102871 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:18:13.102871 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 606/1217] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 30 04:18:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:18:13.107682 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc3ad7d-47c0-4b72-8729-74b84b3c9c93 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:13.281328 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc3ad7d-47c0-4b72-8729-74b84b3c9c93 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:13.316454 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:13.332919 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3401fbb-526c-43c4-9914-214cd63a9d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:13.333580 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3401fbb-526c-43c4-9914-214cd63a9d07 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:13.333916 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3401fbb-526c-43c4-9914-214cd63a9d07 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:13.334266 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3401fbb-526c-43c4-9914-214cd63a9d07 None admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:13.335099 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3401fbb-526c-43c4-9914-214cd63a9d07 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:18:13.335480 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3401fbb-526c-43c4-9914-214cd63a9d07 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:13.337116 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3401fbb-526c-43c4-9914-214cd63a9d07 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:13.357227 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 612/1218] 10.222.0.91 () {56 vars in 1148 bytes} [Tue Aug 30 04:18:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:18:13.365473 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f9a15-847d-4862-9cbe-be37fdc28c8f None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:13.542456 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f9a15-847d-4862-9cbe-be37fdc28c8f None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:13.582043 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:13.593908 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822f6bf2-7878-4c49-ae47-7ef198f5fe81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:13.593908 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f6bf2-7878-4c49-ae47-7ef198f5fe81 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:13.594318 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f6bf2-7878-4c49-ae47-7ef198f5fe81 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:13.594783 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f6bf2-7878-4c49-ae47-7ef198f5fe81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:13.596185 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822f6bf2-7878-4c49-ae47-7ef198f5fe81 None admin] RBAC: Adding query filter params (role.id=c3eef5523b7a407082ffaa23a9753410, scope.project.id=4e05769361674c8fa995050150ad4cfa, user.id=47a092fbe1334f7e9ae4ba9bdb5e9f4c) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:18:13.596701 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822f6bf2-7878-4c49-ae47-7ef198f5fe81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:13.600295 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822f6bf2-7878-4c49-ae47-7ef198f5fe81 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:13.610141 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 607/1219] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 30 04:18:13 2022] GET /identity/v3/role_assignments?user.id=47a092fbe1334f7e9ae4ba9bdb5e9f4c&scope.project.id=4e05769361674c8fa995050150ad4cfa&role.id=c3eef5523b7a407082ffaa23a9753410 => generated 259 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:18:16.013146 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c24f8c-c444-41d2-8c61-e7be20a3b5e0 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:16.013798 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c24f8c-c444-41d2-8c61-e7be20a3b5e0 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:16.013905 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c24f8c-c444-41d2-8c61-e7be20a3b5e0 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:16.016400 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 613/1220] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:18:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:18:16.023648 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd7a43-4bdc-4397-9569-e6f368a5e534 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:16.024646 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd7a43-4bdc-4397-9569-e6f368a5e534 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:16.024646 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd7a43-4bdc-4397-9569-e6f368a5e534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:16.066091 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-d7fd7a43-4bdc-4397-9569-e6f368a5e534 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:18:16.067602 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-d7fd7a43-4bdc-4397-9569-e6f368a5e534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:16.187778 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 608/1221] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:18:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:18:16.668506 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c24f8c-c444-41d2-8c61-e7be20a3b5e0 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:16.835812 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c24f8c-c444-41d2-8c61-e7be20a3b5e0 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:16.892225 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edafa76-0b00-4f9e-b920-8f5554063ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:16.893252 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edafa76-0b00-4f9e-b920-8f5554063ac3 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:16.893725 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edafa76-0b00-4f9e-b920-8f5554063ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:16.894147 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edafa76-0b00-4f9e-b920-8f5554063ac3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:16.909716 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edafa76-0b00-4f9e-b920-8f5554063ac3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:18:16.914877 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-8edafa76-0b00-4f9e-b920-8f5554063ac3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:18:16.914877 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:18:16.914877 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:18:16.914877 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:18:16.914877 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:18:16.914877 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:18:16.914877 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:18:16.914877 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:18:16.914877 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:18:16.914877 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:18:16.914877 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:18:16.914877 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:18:16.914877 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:18:16.914877 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:18:16.914877 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:18:16.914877 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:18:16.916961 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:18:16.916961 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:18:16.916961 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:18:16.916961 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:18:16.916961 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:18:16.916961 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:18:16.916961 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:18:16.916961 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:18:16.916961 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:18:16.916961 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:18:16.916961 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:18:16.916961 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:18:16.916961 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:18:16.916961 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:18:16.916961 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:18:16.916961 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:18:16.919975 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:18:16.919975 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:18:16.919975 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:18:16.919975 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:18:16.919975 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:18:16.919975 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:18:16.919975 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:18:16.919975 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:18:16.919975 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:18:16.919975 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:18:16.919975 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:18:16.919975 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:18:16.919975 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 614/1222] 10.222.0.91 () {56 vars in 1102 bytes} [Tue Aug 30 04:18:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:18:16.924810 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd7a43-4bdc-4397-9569-e6f368a5e534 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:17.116350 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd7a43-4bdc-4397-9569-e6f368a5e534 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:17.160612 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:17.181279 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86361af9-eb97-4590-9c78-6e496c2cf1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:17.182004 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86361af9-eb97-4590-9c78-6e496c2cf1e5 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:17.182470 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86361af9-eb97-4590-9c78-6e496c2cf1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:17.182967 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86361af9-eb97-4590-9c78-6e496c2cf1e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:17.184042 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86361af9-eb97-4590-9c78-6e496c2cf1e5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:18:17.184537 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86361af9-eb97-4590-9c78-6e496c2cf1e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:17.186476 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86361af9-eb97-4590-9c78-6e496c2cf1e5 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:17.201404 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 609/1223] 10.222.0.91 () {56 vars in 1103 bytes} [Tue Aug 30 04:18:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:18:17.209741 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edafa76-0b00-4f9e-b920-8f5554063ac3 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:17.316401 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:17.421255 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edafa76-0b00-4f9e-b920-8f5554063ac3 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:17.477955 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5393035b-3490-4857-b19f-b6ba650c2826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:17.478648 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393035b-3490-4857-b19f-b6ba650c2826 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:17.478924 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393035b-3490-4857-b19f-b6ba650c2826 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:17.479222 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393035b-3490-4857-b19f-b6ba650c2826 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:17.499708 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5393035b-3490-4857-b19f-b6ba650c2826 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:17.502038 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5393035b-3490-4857-b19f-b6ba650c2826 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:17.523878 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-5393035b-3490-4857-b19f-b6ba650c2826 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:18:17.523878 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:18:17.523878 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:18:17.523878 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:18:17.523878 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:18:17.523878 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:18:17.523878 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:18:17.523878 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:18:17.523878 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:18:17.523878 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:18:17.523878 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:18:17.523878 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:18:17.523878 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:18:17.523878 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:18:17.523878 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:18:17.523878 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:18:17.526045 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:18:17.526045 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:18:17.526045 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:18:17.526045 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:18:17.526045 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:18:17.526045 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:18:17.526045 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:18:17.526045 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:18:17.526045 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:18:17.526045 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:18:17.526045 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:18:17.526045 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:18:17.526045 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:18:17.526045 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:18:17.526045 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:18:17.526045 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:18:17.526045 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:18:17.528402 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:18:17.528402 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:18:17.528402 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:18:17.528402 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 615/1224] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:18:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:18:17.532672 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86361af9-eb97-4590-9c78-6e496c2cf1e5 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:17.689078 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86361af9-eb97-4590-9c78-6e496c2cf1e5 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:17.731590 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2cb8a2-00c8-480c-a14b-f7b060ff5641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:17.732236 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2cb8a2-00c8-480c-a14b-f7b060ff5641 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:17.732514 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2cb8a2-00c8-480c-a14b-f7b060ff5641 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:17.732784 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2cb8a2-00c8-480c-a14b-f7b060ff5641 None admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:17.733455 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2cb8a2-00c8-480c-a14b-f7b060ff5641 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:18:17.733755 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2cb8a2-00c8-480c-a14b-f7b060ff5641 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:17.735189 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2cb8a2-00c8-480c-a14b-f7b060ff5641 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:17.750444 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 610/1225] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:18:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:18:17.757079 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5393035b-3490-4857-b19f-b6ba650c2826 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:17.945124 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:17.955838 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5393035b-3490-4857-b19f-b6ba650c2826 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:18.017824 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5649a4-9823-4591-98fb-9351cb6aafa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:18.019033 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5649a4-9823-4591-98fb-9351cb6aafa8 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:18.019670 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5649a4-9823-4591-98fb-9351cb6aafa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:18.020166 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5649a4-9823-4591-98fb-9351cb6aafa8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:18.038214 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5649a4-9823-4591-98fb-9351cb6aafa8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:18.040698 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5649a4-9823-4591-98fb-9351cb6aafa8 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:18.060882 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-7b5649a4-9823-4591-98fb-9351cb6aafa8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 04:18:18.060882 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:18:18.060882 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:18:18.060882 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:18:18.060882 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:18:18.060882 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:18:18.060882 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:18:18.060882 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:18:18.060882 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:18:18.060882 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:18:18.060882 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:18:18.060882 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:18:18.060882 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:18:18.060882 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:18:18.060882 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:18:18.060882 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:18:18.062912 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:18:18.062912 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:18:18.062912 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:18:18.062912 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:18:18.062912 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:18:18.062912 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:18:18.062912 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:18:18.062912 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:18:18.062912 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:18:18.062912 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:18:18.062912 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:18:18.062912 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:18:18.062912 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:18:18.062912 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:18:18.062912 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:18:18.062912 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:18:18.062912 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:18:18.062912 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:18:18.064769 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:18:18.064769 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:18:18.064769 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:18:18.064769 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:18:18.064769 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:18:18.064769 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:18:18.064769 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:18:18.064769 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:18:18.064769 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 04:18:18.064769 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:18:18.064769 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 616/1226] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:18:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:18:18.071267 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2cb8a2-00c8-480c-a14b-f7b060ff5641 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:18.172398 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:18.278011 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2cb8a2-00c8-480c-a14b-f7b060ff5641 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:18.341807 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732277be-74c3-444d-aeed-9063ac3c0538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:18.342446 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732277be-74c3-444d-aeed-9063ac3c0538 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:18.342722 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732277be-74c3-444d-aeed-9063ac3c0538 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:18.342983 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732277be-74c3-444d-aeed-9063ac3c0538 None admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:18.343743 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732277be-74c3-444d-aeed-9063ac3c0538 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:18:18.344095 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732277be-74c3-444d-aeed-9063ac3c0538 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:18.345589 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732277be-74c3-444d-aeed-9063ac3c0538 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:18.366489 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 611/1227] 10.222.0.91 () {56 vars in 1143 bytes} [Tue Aug 30 04:18:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:18:18.375851 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5649a4-9823-4591-98fb-9351cb6aafa8 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:18.566377 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5649a4-9823-4591-98fb-9351cb6aafa8 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:18.622894 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e7f6ff-d0c0-4647-afe8-b43812f7e6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:18.624169 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7f6ff-d0c0-4647-afe8-b43812f7e6ef None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:18.624706 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7f6ff-d0c0-4647-afe8-b43812f7e6ef None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:18.625196 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7f6ff-d0c0-4647-afe8-b43812f7e6ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:18.640603 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e7f6ff-d0c0-4647-afe8-b43812f7e6ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:18.641896 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e7f6ff-d0c0-4647-afe8-b43812f7e6ef None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:18.658648 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-83e7f6ff-d0c0-4647-afe8-b43812f7e6ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:18:18.658648 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:18:18.658648 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:18:18.658648 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:18:18.658648 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:18:18.658648 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:18:18.658648 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:18:18.658648 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:18:18.658648 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:18:18.658648 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:18:18.658648 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:18:18.658648 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:18:18.658648 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:18:18.658648 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:18:18.658648 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:18:18.658648 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:18:18.660626 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:18:18.660626 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:18:18.660626 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:18:18.660626 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:18:18.660626 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:18:18.660626 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:18:18.660626 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:18:18.660626 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:18:18.660626 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:18:18.660626 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:18:18.660626 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:18:18.660626 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:18:18.660626 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:18:18.660626 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:18:18.660626 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:18:18.660626 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:18:18.660626 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:18:18.663059 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:18:18.663059 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:18:18.663059 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:18:18.663059 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 617/1228] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:18:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:18:18.670142 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732277be-74c3-444d-aeed-9063ac3c0538 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:18.821521 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732277be-74c3-444d-aeed-9063ac3c0538 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:18.825841 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:18.878629 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd27319-c1dc-4e44-abfb-bb65a6c9e077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:18.880985 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd27319-c1dc-4e44-abfb-bb65a6c9e077 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:18.881282 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd27319-c1dc-4e44-abfb-bb65a6c9e077 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:18.881698 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd27319-c1dc-4e44-abfb-bb65a6c9e077 None admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:18.882521 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd27319-c1dc-4e44-abfb-bb65a6c9e077 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:18:18.882825 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd27319-c1dc-4e44-abfb-bb65a6c9e077 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:18.884442 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd27319-c1dc-4e44-abfb-bb65a6c9e077 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:18.904542 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 612/1229] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:18:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:18:18.911677 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e7f6ff-d0c0-4647-afe8-b43812f7e6ef None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:18.931149 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:19.127766 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e7f6ff-d0c0-4647-afe8-b43812f7e6ef None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:19.194066 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39bb23-a99c-424d-b5f7-4b3896ab2424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:19.194851 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39bb23-a99c-424d-b5f7-4b3896ab2424 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:19.195209 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39bb23-a99c-424d-b5f7-4b3896ab2424 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:19.195613 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39bb23-a99c-424d-b5f7-4b3896ab2424 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:19.208658 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c39bb23-a99c-424d-b5f7-4b3896ab2424 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:19.212077 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c39bb23-a99c-424d-b5f7-4b3896ab2424 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:19.230450 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-6c39bb23-a99c-424d-b5f7-4b3896ab2424 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:18:19.230450 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:18:19.230450 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:18:19.230450 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:18:19.230450 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:18:19.230450 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:18:19.230450 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:18:19.230450 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:18:19.230450 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:18:19.230450 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:18:19.230450 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:18:19.230450 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:18:19.230450 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:18:19.230450 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:18:19.230450 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:18:19.232164 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:18:19.232164 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:18:19.232164 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:18:19.232164 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:18:19.232164 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:18:19.232164 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:18:19.232164 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:18:19.232164 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:18:19.232164 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:18:19.232164 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:18:19.232164 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:18:19.232164 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:18:19.232164 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:18:19.232164 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:18:19.232164 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:18:19.232164 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:18:19.232164 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:18:19.233963 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:18:19.233963 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:18:19.233963 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:18:19.233963 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:18:19.233963 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:18:19.233963 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:18:19.233963 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:18:19.233963 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:18:19.233963 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 618/1230] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 30 04:18:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:18:19.240080 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd27319-c1dc-4e44-abfb-bb65a6c9e077 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:19.403092 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd27319-c1dc-4e44-abfb-bb65a6c9e077 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:19.445507 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf0b73-8b34-4c36-8986-3a8cb159681d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:19.446146 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf0b73-8b34-4c36-8986-3a8cb159681d None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:19.446417 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf0b73-8b34-4c36-8986-3a8cb159681d None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:19.446718 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf0b73-8b34-4c36-8986-3a8cb159681d None admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:19.447454 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febf0b73-8b34-4c36-8986-3a8cb159681d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:18:19.447755 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febf0b73-8b34-4c36-8986-3a8cb159681d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:19.449559 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febf0b73-8b34-4c36-8986-3a8cb159681d None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:19.464981 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 613/1231] 10.222.0.91 () {56 vars in 1148 bytes} [Tue Aug 30 04:18:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:18:19.472856 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39bb23-a99c-424d-b5f7-4b3896ab2424 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:19.578906 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:19.638650 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39bb23-a99c-424d-b5f7-4b3896ab2424 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:19.705627 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f1cf9e-0692-4dbe-90e8-b24d0e1575df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:19.706533 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1cf9e-0692-4dbe-90e8-b24d0e1575df None admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:19.706948 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1cf9e-0692-4dbe-90e8-b24d0e1575df None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:19.707408 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1cf9e-0692-4dbe-90e8-b24d0e1575df None admin] PATH_INFO: `/v3/projects/4e05769361674c8fa995050150ad4cfa/users/47a092fbe1334f7e9ae4ba9bdb5e9f4c/roles/c3eef5523b7a407082ffaa23a9753410` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:19.726311 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f1cf9e-0692-4dbe-90e8-b24d0e1575df None admin] RBAC: Authorizing `identity:create_grant(project_id=4e05769361674c8fa995050150ad4cfa, user_id=47a092fbe1334f7e9ae4ba9bdb5e9f4c, role_id=c3eef5523b7a407082ffaa23a9753410)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:19.727922 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f1cf9e-0692-4dbe-90e8-b24d0e1575df None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:19.751366 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 619/1232] 10.222.0.91 () {58 vars in 1439 bytes} [Tue Aug 30 04:18:19 2022] PUT /identity/v3/projects/4e05769361674c8fa995050150ad4cfa/users/47a092fbe1334f7e9ae4ba9bdb5e9f4c/roles/c3eef5523b7a407082ffaa23a9753410 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:18:22.097317 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87109f00-e60f-404a-af4a-01de0aec7efb None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:22.098361 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87109f00-e60f-404a-af4a-01de0aec7efb None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:22.098361 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87109f00-e60f-404a-af4a-01de0aec7efb None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:22.099515 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 614/1233] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:18:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:18:22.108020 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95041d4a-4e98-404e-a9a7-25d501df3b45 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:22.108640 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95041d4a-4e98-404e-a9a7-25d501df3b45 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:22.109180 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95041d4a-4e98-404e-a9a7-25d501df3b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:22.144289 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-95041d4a-4e98-404e-a9a7-25d501df3b45 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:18:22.146382 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-95041d4a-4e98-404e-a9a7-25d501df3b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:22.262103 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 620/1234] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:18:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:18:22.626719 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87109f00-e60f-404a-af4a-01de0aec7efb None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:22.673158 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:22.811294 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87109f00-e60f-404a-af4a-01de0aec7efb None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:22.858039 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61931d8d-20ff-4f3f-874c-6ca7e0b2d444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:22.858876 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61931d8d-20ff-4f3f-874c-6ca7e0b2d444 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:22.859156 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61931d8d-20ff-4f3f-874c-6ca7e0b2d444 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:22.859428 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61931d8d-20ff-4f3f-874c-6ca7e0b2d444 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:22.873173 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61931d8d-20ff-4f3f-874c-6ca7e0b2d444 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:18:22.878174 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-61931d8d-20ff-4f3f-874c-6ca7e0b2d444 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:18:22.878174 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:18:22.878174 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:18:22.878174 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:18:22.878174 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:18:22.878174 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:18:22.878174 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:18:22.878174 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:18:22.878174 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:18:22.878174 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:18:22.878174 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:18:22.878174 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:18:22.878174 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:18:22.878174 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:18:22.878174 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:18:22.878174 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:18:22.880088 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:18:22.880088 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:18:22.880088 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:18:22.880088 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:18:22.880088 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:18:22.880088 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:18:22.880088 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:18:22.880088 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:18:22.880088 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:18:22.880088 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:18:22.880088 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:18:22.880088 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:18:22.880088 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:18:22.880088 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:18:22.880088 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:18:22.880088 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:18:22.882098 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:18:22.882098 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:18:22.882098 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:18:22.882098 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:18:22.882098 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:18:22.882098 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:18:22.882098 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:18:22.882098 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:18:22.882098 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:18:22.882098 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:18:22.882098 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:18:22.882098 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:18:22.882098 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 615/1235] 10.222.0.91 () {56 vars in 1102 bytes} [Tue Aug 30 04:18:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:18:22.887388 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95041d4a-4e98-404e-a9a7-25d501df3b45 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:22.956212 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:23.042063 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95041d4a-4e98-404e-a9a7-25d501df3b45 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:23.100534 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6583fb2e-9100-45aa-9a96-83dd98bc277d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:23.101200 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583fb2e-9100-45aa-9a96-83dd98bc277d None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:23.101474 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583fb2e-9100-45aa-9a96-83dd98bc277d None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:23.101743 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583fb2e-9100-45aa-9a96-83dd98bc277d None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:23.102456 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6583fb2e-9100-45aa-9a96-83dd98bc277d None admin] RBAC: Adding query filter params (name=service) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:18:23.102759 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6583fb2e-9100-45aa-9a96-83dd98bc277d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:23.104338 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6583fb2e-9100-45aa-9a96-83dd98bc277d None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:23.116356 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 621/1236] 10.222.0.91 () {56 vars in 1103 bytes} [Tue Aug 30 04:18:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:18:23.123667 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61931d8d-20ff-4f3f-874c-6ca7e0b2d444 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:23.263318 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:23.301211 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61931d8d-20ff-4f3f-874c-6ca7e0b2d444 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:23.374016 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af7869f-16d6-4183-a71f-c75c7da07bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:23.375111 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7869f-16d6-4183-a71f-c75c7da07bc0 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:23.375759 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7869f-16d6-4183-a71f-c75c7da07bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:23.376181 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7869f-16d6-4183-a71f-c75c7da07bc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:23.399710 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af7869f-16d6-4183-a71f-c75c7da07bc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:23.402642 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af7869f-16d6-4183-a71f-c75c7da07bc0 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:23.433783 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-7af7869f-16d6-4183-a71f-c75c7da07bc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:18:23.433783 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:18:23.433783 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:18:23.433783 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:18:23.433783 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:18:23.433783 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:18:23.433783 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:18:23.433783 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:18:23.433783 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:18:23.433783 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:18:23.433783 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:18:23.433783 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:18:23.433783 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:18:23.433783 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:18:23.433783 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:18:23.433783 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:18:23.435104 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:18:23.435104 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:18:23.435104 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:18:23.435104 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:18:23.435104 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:18:23.435104 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:18:23.435104 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:18:23.435104 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:18:23.435104 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:18:23.435104 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:18:23.435104 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:18:23.435104 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:18:23.435104 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:18:23.435104 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:18:23.435104 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:18:23.435104 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:18:23.435104 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:18:23.436210 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:18:23.436210 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:18:23.436210 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:18:23.436210 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 616/1237] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:18:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:18:23.445683 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6583fb2e-9100-45aa-9a96-83dd98bc277d None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:23.599245 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6583fb2e-9100-45aa-9a96-83dd98bc277d None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:23.611035 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:23.642733 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee5fa14-5667-4184-bcf9-c4f85886c29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:23.643350 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5fa14-5667-4184-bcf9-c4f85886c29b None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:23.643661 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5fa14-5667-4184-bcf9-c4f85886c29b None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:23.644014 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5fa14-5667-4184-bcf9-c4f85886c29b None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:23.644606 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee5fa14-5667-4184-bcf9-c4f85886c29b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:18:23.644957 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee5fa14-5667-4184-bcf9-c4f85886c29b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:23.646322 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee5fa14-5667-4184-bcf9-c4f85886c29b None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:23.661159 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 622/1238] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:18:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:18:23.667851 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af7869f-16d6-4183-a71f-c75c7da07bc0 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:23.820396 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af7869f-16d6-4183-a71f-c75c7da07bc0 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:23.873272 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a81b0fb-77f1-4d34-8b2c-17c1c557ed52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:23.874373 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81b0fb-77f1-4d34-8b2c-17c1c557ed52 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:23.874865 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81b0fb-77f1-4d34-8b2c-17c1c557ed52 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:23.875335 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81b0fb-77f1-4d34-8b2c-17c1c557ed52 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:23.880529 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:23.892117 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a81b0fb-77f1-4d34-8b2c-17c1c557ed52 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:23.894748 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a81b0fb-77f1-4d34-8b2c-17c1c557ed52 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:23.918200 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-1a81b0fb-77f1-4d34-8b2c-17c1c557ed52 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 04:18:23.918200 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:18:23.918200 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:18:23.918200 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:18:23.918200 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:18:23.918200 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:18:23.918200 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:18:23.918200 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:18:23.918200 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:18:23.918200 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:18:23.918200 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:18:23.918200 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:18:23.918200 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:18:23.918200 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:18:23.918200 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:18:23.918200 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:18:23.920584 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:18:23.920584 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:18:23.920584 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:18:23.920584 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:18:23.920584 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:18:23.920584 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:18:23.920584 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:18:23.920584 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:18:23.920584 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:18:23.920584 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:18:23.920584 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:18:23.920584 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:18:23.920584 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:18:23.920584 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:18:23.920584 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:18:23.920584 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:18:23.920584 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:18:23.920584 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:18:23.923053 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:18:23.923053 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:18:23.923053 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:18:23.923053 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:18:23.923053 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:18:23.923053 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:18:23.923053 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:18:23.923053 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:18:23.923053 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 04:18:23.923053 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:18:23.923053 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 617/1239] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:18:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:18:23.929048 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee5fa14-5667-4184-bcf9-c4f85886c29b None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:24.089762 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee5fa14-5667-4184-bcf9-c4f85886c29b None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:24.148368 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a656b9-0f96-4fcf-a2c3-b333586c37eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:24.149343 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a656b9-0f96-4fcf-a2c3-b333586c37eb None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:24.149806 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a656b9-0f96-4fcf-a2c3-b333586c37eb None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:24.150271 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a656b9-0f96-4fcf-a2c3-b333586c37eb None admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:24.151690 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a656b9-0f96-4fcf-a2c3-b333586c37eb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:18:24.152761 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a656b9-0f96-4fcf-a2c3-b333586c37eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:24.155993 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a656b9-0f96-4fcf-a2c3-b333586c37eb None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:24.186359 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 623/1240] 10.222.0.91 () {56 vars in 1143 bytes} [Tue Aug 30 04:18:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:18:24.195102 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a81b0fb-77f1-4d34-8b2c-17c1c557ed52 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:24.347452 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a81b0fb-77f1-4d34-8b2c-17c1c557ed52 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:24.399265 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a52dfb2-c386-4a48-bdbc-fe50d3765d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:24.399791 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52dfb2-c386-4a48-bdbc-fe50d3765d93 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:24.400106 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52dfb2-c386-4a48-bdbc-fe50d3765d93 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:24.400373 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52dfb2-c386-4a48-bdbc-fe50d3765d93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:24.495080 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:24.514654 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a52dfb2-c386-4a48-bdbc-fe50d3765d93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:24.516281 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a52dfb2-c386-4a48-bdbc-fe50d3765d93 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:24.696040 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 618/1241] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 30 04:18:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 04:18:24.703510 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a656b9-0f96-4fcf-a2c3-b333586c37eb None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:24.756158 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:24.872493 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a656b9-0f96-4fcf-a2c3-b333586c37eb None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:24.950788 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be94d1dc-fc94-4825-9d85-9721258a7adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:24.951736 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94d1dc-fc94-4825-9d85-9721258a7adb None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:24.952649 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94d1dc-fc94-4825-9d85-9721258a7adb None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:24.953074 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94d1dc-fc94-4825-9d85-9721258a7adb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:24.977293 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be94d1dc-fc94-4825-9d85-9721258a7adb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:24.981344 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be94d1dc-fc94-4825-9d85-9721258a7adb None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:25.015667 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-be94d1dc-fc94-4825-9d85-9721258a7adb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:18:25.015667 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:18:25.015667 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:18:25.015667 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:18:25.015667 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:18:25.015667 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:18:25.015667 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:18:25.015667 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:18:25.015667 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:18:25.015667 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:18:25.015667 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:18:25.015667 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:18:25.015667 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:18:25.015667 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:18:25.015667 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:18:25.015667 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:18:25.017898 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:18:25.017898 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:18:25.017898 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:18:25.017898 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:18:25.017898 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:18:25.017898 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:18:25.017898 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:18:25.017898 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:18:25.017898 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:18:25.017898 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:18:25.017898 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:18:25.017898 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:18:25.017898 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:18:25.017898 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:18:25.017898 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:18:25.017898 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:18:25.017898 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:18:25.019109 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:18:25.019109 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:18:25.019109 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:18:25.019341 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 624/1242] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:18:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:18:25.032019 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a52dfb2-c386-4a48-bdbc-fe50d3765d93 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:25.232742 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:25.242975 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a52dfb2-c386-4a48-bdbc-fe50d3765d93 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:25.294286 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c563bf-5903-452a-8fd8-d702e2197ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:25.295469 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c563bf-5903-452a-8fd8-d702e2197ea5 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:25.295788 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c563bf-5903-452a-8fd8-d702e2197ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:25.296242 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c563bf-5903-452a-8fd8-d702e2197ea5 None admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:25.297081 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c563bf-5903-452a-8fd8-d702e2197ea5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:18:25.297566 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c563bf-5903-452a-8fd8-d702e2197ea5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:25.299028 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c563bf-5903-452a-8fd8-d702e2197ea5 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:25.315054 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 619/1243] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:18:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:18:25.324397 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be94d1dc-fc94-4825-9d85-9721258a7adb None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:25.471595 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:25.513245 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be94d1dc-fc94-4825-9d85-9721258a7adb None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:25.565318 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95fef3d-3442-464f-8fe2-e8ad3effb987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:25.566200 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95fef3d-3442-464f-8fe2-e8ad3effb987 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:25.566671 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95fef3d-3442-464f-8fe2-e8ad3effb987 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:25.567102 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95fef3d-3442-464f-8fe2-e8ad3effb987 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:25.578257 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95fef3d-3442-464f-8fe2-e8ad3effb987 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:25.580066 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95fef3d-3442-464f-8fe2-e8ad3effb987 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:25.596372 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-d95fef3d-3442-464f-8fe2-e8ad3effb987 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:18:25.596372 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:18:25.596372 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:18:25.596372 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:18:25.596372 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:18:25.596372 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:18:25.596372 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:18:25.596372 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:18:25.596372 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:18:25.596372 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:18:25.596372 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:18:25.596372 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:18:25.596372 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:18:25.596372 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:18:25.596372 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:18:25.598583 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:18:25.598583 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:18:25.598583 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:18:25.598583 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:18:25.598583 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:18:25.598583 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:18:25.598583 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:18:25.598583 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:18:25.598583 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:18:25.598583 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:18:25.598583 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:18:25.598583 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:18:25.598583 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:18:25.598583 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:18:25.598583 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:18:25.598583 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:18:25.598583 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:18:25.600659 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:18:25.600659 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:18:25.600659 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:18:25.600659 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:18:25.600659 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:18:25.600659 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:18:25.600659 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:18:25.600659 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:18:25.604194 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 625/1244] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 30 04:18:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:18:25.608797 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c563bf-5903-452a-8fd8-d702e2197ea5 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:25.762944 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c563bf-5903-452a-8fd8-d702e2197ea5 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:25.822670 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335722bb-ec6f-45a5-8b95-641d8d8bd34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:25.823221 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335722bb-ec6f-45a5-8b95-641d8d8bd34a None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:25.823498 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335722bb-ec6f-45a5-8b95-641d8d8bd34a None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:25.823977 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335722bb-ec6f-45a5-8b95-641d8d8bd34a None admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:25.824930 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335722bb-ec6f-45a5-8b95-641d8d8bd34a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:18:25.825250 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335722bb-ec6f-45a5-8b95-641d8d8bd34a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:25.827517 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335722bb-ec6f-45a5-8b95-641d8d8bd34a None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:25.845212 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 620/1245] 10.222.0.91 () {56 vars in 1148 bytes} [Tue Aug 30 04:18:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:18:25.852398 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95fef3d-3442-464f-8fe2-e8ad3effb987 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:26.006303 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95fef3d-3442-464f-8fe2-e8ad3effb987 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:26.089279 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b279a-48c8-49d5-85a9-4990637a1392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:26.089916 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b279a-48c8-49d5-85a9-4990637a1392 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:26.090401 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b279a-48c8-49d5-85a9-4990637a1392 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:26.090974 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b279a-48c8-49d5-85a9-4990637a1392 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:26.091669 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52b279a-48c8-49d5-85a9-4990637a1392 None admin] RBAC: Adding query filter params (role.id=c3eef5523b7a407082ffaa23a9753410, scope.project.id=4e05769361674c8fa995050150ad4cfa, user.id=47a092fbe1334f7e9ae4ba9bdb5e9f4c) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:18:26.091889 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52b279a-48c8-49d5-85a9-4990637a1392 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:26.093380 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52b279a-48c8-49d5-85a9-4990637a1392 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:26.102292 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 626/1246] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 30 04:18:25 2022] GET /identity/v3/role_assignments?user.id=47a092fbe1334f7e9ae4ba9bdb5e9f4c&scope.project.id=4e05769361674c8fa995050150ad4cfa&role.id=c3eef5523b7a407082ffaa23a9753410 => generated 608 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:18:28.677061 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a02997-7166-48c2-8a7a-72fe04aef327 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:28.677061 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a02997-7166-48c2-8a7a-72fe04aef327 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:28.677061 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a02997-7166-48c2-8a7a-72fe04aef327 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:28.677061 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 621/1247] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:18:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:18:28.686405 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4631e9ac-8ebc-4f73-8726-d19471763878 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:28.687309 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4631e9ac-8ebc-4f73-8726-d19471763878 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:28.687309 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4631e9ac-8ebc-4f73-8726-d19471763878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:28.698221 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:28.720460 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-4631e9ac-8ebc-4f73-8726-d19471763878 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:18:28.722562 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-4631e9ac-8ebc-4f73-8726-d19471763878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:28.826601 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 627/1248] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:18:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:18:29.301945 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a02997-7166-48c2-8a7a-72fe04aef327 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:29.327099 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:29.440285 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a02997-7166-48c2-8a7a-72fe04aef327 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:29.494475 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6dc84c-c953-4aa0-b4e4-b78df1a92fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:29.496023 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6dc84c-c953-4aa0-b4e4-b78df1a92fb8 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:29.496916 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6dc84c-c953-4aa0-b4e4-b78df1a92fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:29.497761 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6dc84c-c953-4aa0-b4e4-b78df1a92fb8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:29.517878 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6dc84c-c953-4aa0-b4e4-b78df1a92fb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:18:29.524608 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-3e6dc84c-c953-4aa0-b4e4-b78df1a92fb8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:18:29.524608 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:18:29.524608 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:18:29.524608 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:18:29.524608 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:18:29.524608 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:18:29.524608 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:18:29.524608 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:18:29.524608 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:18:29.524608 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:18:29.524608 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:18:29.524608 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:18:29.524608 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:18:29.524608 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:18:29.524608 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:18:29.524608 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:18:29.527557 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:18:29.527557 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:18:29.527557 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:18:29.527557 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:18:29.527557 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:18:29.527557 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:18:29.527557 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:18:29.527557 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:18:29.527557 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:18:29.527557 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:18:29.527557 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:18:29.527557 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:18:29.527557 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:18:29.527557 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:18:29.527557 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:18:29.527557 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:18:29.530186 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:18:29.530186 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:18:29.530186 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:18:29.530186 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:18:29.530186 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:18:29.530186 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:18:29.530186 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:18:29.530186 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:18:29.530186 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:18:29.530186 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:18:29.530186 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:18:29.530186 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:18:29.530186 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 622/1249] 10.222.0.91 () {56 vars in 1096 bytes} [Tue Aug 30 04:18:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:18:29.538493 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4631e9ac-8ebc-4f73-8726-d19471763878 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:29.710881 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4631e9ac-8ebc-4f73-8726-d19471763878 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:29.761259 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:29.768770 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b4c7bf-04fb-42dc-abfe-644e87bc58c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:29.770052 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4c7bf-04fb-42dc-abfe-644e87bc58c2 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:29.770733 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4c7bf-04fb-42dc-abfe-644e87bc58c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:29.771256 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4c7bf-04fb-42dc-abfe-644e87bc58c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:29.772346 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b4c7bf-04fb-42dc-abfe-644e87bc58c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:18:29.772772 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b4c7bf-04fb-42dc-abfe-644e87bc58c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:29.774752 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b4c7bf-04fb-42dc-abfe-644e87bc58c2 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:29.787416 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 628/1250] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 30 04:18:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:18:29.796657 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6dc84c-c953-4aa0-b4e4-b78df1a92fb8 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:29.924471 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:29.957592 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6dc84c-c953-4aa0-b4e4-b78df1a92fb8 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:30.012545 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d53d05e-55a8-4750-813d-69cf54ac5703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:30.012913 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d53d05e-55a8-4750-813d-69cf54ac5703 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:30.013153 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d53d05e-55a8-4750-813d-69cf54ac5703 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:30.013388 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d53d05e-55a8-4750-813d-69cf54ac5703 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:30.028603 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d53d05e-55a8-4750-813d-69cf54ac5703 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:30.030176 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d53d05e-55a8-4750-813d-69cf54ac5703 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:30.051237 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-6d53d05e-55a8-4750-813d-69cf54ac5703 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:18:30.051237 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:18:30.051237 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:18:30.051237 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:18:30.051237 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:18:30.051237 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:18:30.051237 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:18:30.051237 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:18:30.051237 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:18:30.051237 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:18:30.051237 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:18:30.051237 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:18:30.051237 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:18:30.051237 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:18:30.051237 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:18:30.051237 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:18:30.053324 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:18:30.053324 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:18:30.053324 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:18:30.053324 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:18:30.053324 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:18:30.053324 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:18:30.053324 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:18:30.053324 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:18:30.053324 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:18:30.053324 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:18:30.053324 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:18:30.053324 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:18:30.053324 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:18:30.053324 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:18:30.053324 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:18:30.053324 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:18:30.053324 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:18:30.055201 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:18:30.055201 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:18:30.055201 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:18:30.055201 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 623/1251] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:18:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:18:30.062355 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b4c7bf-04fb-42dc-abfe-644e87bc58c2 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:30.197828 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b4c7bf-04fb-42dc-abfe-644e87bc58c2 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:30.249501 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc00854-e559-43a1-893c-add8deb283c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:30.250360 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc00854-e559-43a1-893c-add8deb283c5 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:30.250705 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc00854-e559-43a1-893c-add8deb283c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:30.250965 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc00854-e559-43a1-893c-add8deb283c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:30.251639 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc00854-e559-43a1-893c-add8deb283c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:18:30.252003 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc00854-e559-43a1-893c-add8deb283c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:30.253516 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc00854-e559-43a1-893c-add8deb283c5 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:30.275670 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 629/1252] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:18:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:18:30.278405 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d53d05e-55a8-4750-813d-69cf54ac5703 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:30.421425 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d53d05e-55a8-4750-813d-69cf54ac5703 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:30.462366 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:30.477903 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1784ad-3f25-4b46-a8ba-bdf3e44f74ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:30.478864 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1784ad-3f25-4b46-a8ba-bdf3e44f74ff None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:30.479207 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1784ad-3f25-4b46-a8ba-bdf3e44f74ff None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:30.479541 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1784ad-3f25-4b46-a8ba-bdf3e44f74ff None admin] PATH_INFO: `/v3/users/placement` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:30.490472 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1784ad-3f25-4b46-a8ba-bdf3e44f74ff None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:30.492390 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1784ad-3f25-4b46-a8ba-bdf3e44f74ff None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:30.510297 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-3f1784ad-3f25-4b46-a8ba-bdf3e44f74ff None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 04:18:30.510297 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:18:30.510297 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:18:30.510297 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:18:30.510297 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:18:30.510297 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:18:30.510297 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:18:30.510297 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:18:30.510297 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:18:30.510297 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:18:30.510297 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:18:30.510297 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:18:30.510297 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:18:30.510297 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:18:30.510297 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:18:30.510297 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:18:30.512028 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:18:30.512028 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:18:30.512028 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:18:30.512028 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:18:30.512028 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:18:30.512028 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:18:30.512028 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:18:30.512028 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:18:30.512028 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:18:30.512028 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:18:30.512028 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:18:30.512028 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:18:30.512028 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:18:30.512028 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:18:30.512028 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:18:30.512028 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:18:30.512028 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:18:30.512028 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:18:30.513200 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:18:30.513200 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:18:30.513200 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:18:30.513200 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:18:30.513200 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:18:30.513200 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:18:30.513200 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:18:30.513200 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:18:30.513200 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 04:18:30.513200 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:18:30.513200 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 624/1253] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:18:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:18:30.522666 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc00854-e559-43a1-893c-add8deb283c5 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:30.619228 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:30.709266 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc00854-e559-43a1-893c-add8deb283c5 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:30.762147 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f1617-184c-45ef-8f5f-684b91c77661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:30.763116 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f1617-184c-45ef-8f5f-684b91c77661 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:30.763116 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f1617-184c-45ef-8f5f-684b91c77661 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:30.763531 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f1617-184c-45ef-8f5f-684b91c77661 None admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:30.764783 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2f1617-184c-45ef-8f5f-684b91c77661 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:18:30.765249 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2f1617-184c-45ef-8f5f-684b91c77661 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:30.767213 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2f1617-184c-45ef-8f5f-684b91c77661 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:30.793621 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 630/1254] 10.222.0.91 () {56 vars in 1143 bytes} [Tue Aug 30 04:18:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:18:30.801668 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1784ad-3f25-4b46-a8ba-bdf3e44f74ff None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:30.956597 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1784ad-3f25-4b46-a8ba-bdf3e44f74ff None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:31.015428 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ae5291-c1ba-44b6-8891-e368791fe41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:31.016317 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae5291-c1ba-44b6-8891-e368791fe41b None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:31.016832 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae5291-c1ba-44b6-8891-e368791fe41b None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:31.017185 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae5291-c1ba-44b6-8891-e368791fe41b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:31.134132 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:31.153191 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ae5291-c1ba-44b6-8891-e368791fe41b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:31.155565 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ae5291-c1ba-44b6-8891-e368791fe41b None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:31.283858 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 625/1255] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 30 04:18:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 04:18:31.290368 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f1617-184c-45ef-8f5f-684b91c77661 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:31.425255 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f1617-184c-45ef-8f5f-684b91c77661 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:31.446562 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:31.474495 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae0f23b-ba95-457c-91e8-70db9fbc656b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:31.475164 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae0f23b-ba95-457c-91e8-70db9fbc656b None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:31.475442 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae0f23b-ba95-457c-91e8-70db9fbc656b None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:31.475709 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae0f23b-ba95-457c-91e8-70db9fbc656b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:31.489297 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae0f23b-ba95-457c-91e8-70db9fbc656b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:31.490830 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae0f23b-ba95-457c-91e8-70db9fbc656b None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:31.509063 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-7ae0f23b-ba95-457c-91e8-70db9fbc656b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:18:31.509063 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:18:31.509063 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:18:31.509063 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:18:31.509063 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:18:31.509063 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:18:31.509063 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:18:31.509063 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:18:31.509063 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:18:31.509063 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:18:31.509063 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:18:31.509063 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:18:31.509063 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:18:31.509063 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:18:31.509063 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:18:31.509063 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:18:31.511072 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:18:31.511072 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:18:31.511072 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:18:31.511072 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:18:31.511072 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:18:31.511072 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:18:31.511072 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:18:31.511072 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:18:31.511072 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:18:31.511072 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:18:31.511072 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:18:31.511072 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:18:31.511072 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:18:31.511072 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:18:31.511072 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:18:31.511072 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:18:31.511072 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:18:31.513107 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:18:31.513107 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:18:31.513107 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:18:31.513107 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 631/1256] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:18:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:18:31.520234 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ae5291-c1ba-44b6-8891-e368791fe41b None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:31.703736 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:31.720863 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ae5291-c1ba-44b6-8891-e368791fe41b None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:31.763161 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bdc425-e3bb-4c37-a71c-8a1ba9ebf23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:31.763794 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bdc425-e3bb-4c37-a71c-8a1ba9ebf23e None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:31.764135 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bdc425-e3bb-4c37-a71c-8a1ba9ebf23e None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:31.764524 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bdc425-e3bb-4c37-a71c-8a1ba9ebf23e None admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:31.765373 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bdc425-e3bb-4c37-a71c-8a1ba9ebf23e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:18:31.765678 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bdc425-e3bb-4c37-a71c-8a1ba9ebf23e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:31.767154 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bdc425-e3bb-4c37-a71c-8a1ba9ebf23e None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:31.782633 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 626/1257] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:18:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:18:31.789207 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae0f23b-ba95-457c-91e8-70db9fbc656b None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:31.923262 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae0f23b-ba95-457c-91e8-70db9fbc656b None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:31.977503 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b75e25-ef6e-4c4a-873e-8ccfe9d6c244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:31.978157 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b75e25-ef6e-4c4a-873e-8ccfe9d6c244 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:31.978426 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b75e25-ef6e-4c4a-873e-8ccfe9d6c244 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:31.978691 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b75e25-ef6e-4c4a-873e-8ccfe9d6c244 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:31.987621 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b75e25-ef6e-4c4a-873e-8ccfe9d6c244 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:31.989376 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b75e25-ef6e-4c4a-873e-8ccfe9d6c244 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:32.006799 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-39b75e25-ef6e-4c4a-873e-8ccfe9d6c244 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:18:32.006799 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:18:32.006799 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:18:32.006799 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:18:32.006799 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:18:32.006799 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:18:32.006799 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:18:32.006799 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:18:32.006799 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:18:32.006799 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:18:32.006799 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:18:32.006799 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:18:32.006799 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:18:32.006799 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:18:32.006799 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:18:32.008660 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:18:32.008660 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:18:32.008660 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:18:32.008660 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:18:32.008660 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:18:32.008660 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:18:32.008660 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:18:32.008660 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:18:32.008660 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:18:32.008660 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:18:32.008660 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:18:32.008660 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:18:32.008660 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:18:32.008660 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:18:32.008660 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:18:32.008660 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:18:32.008660 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:18:32.010467 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:18:32.010467 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:18:32.010467 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:18:32.010467 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:18:32.010467 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:18:32.010467 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:18:32.010467 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:18:32.010467 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:18:32.010467 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 632/1258] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 30 04:18:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:18:32.020457 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bdc425-e3bb-4c37-a71c-8a1ba9ebf23e None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:32.172260 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bdc425-e3bb-4c37-a71c-8a1ba9ebf23e None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:32.233682 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc6291-cd42-4966-84aa-561c9b03d184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:32.234633 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc6291-cd42-4966-84aa-561c9b03d184 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:32.235118 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc6291-cd42-4966-84aa-561c9b03d184 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:32.235594 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc6291-cd42-4966-84aa-561c9b03d184 None admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:32.236999 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accc6291-cd42-4966-84aa-561c9b03d184 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:18:32.237522 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accc6291-cd42-4966-84aa-561c9b03d184 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:32.240329 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accc6291-cd42-4966-84aa-561c9b03d184 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:32.267950 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 627/1259] 10.222.0.91 () {56 vars in 1148 bytes} [Tue Aug 30 04:18:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:18:32.275390 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b75e25-ef6e-4c4a-873e-8ccfe9d6c244 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:32.328044 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:32.417436 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b75e25-ef6e-4c4a-873e-8ccfe9d6c244 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:32.462017 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8885f30f-9d37-4e25-b15c-ecb3e0fd82ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:32.462643 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885f30f-9d37-4e25-b15c-ecb3e0fd82ff None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:32.462932 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885f30f-9d37-4e25-b15c-ecb3e0fd82ff None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:32.463202 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885f30f-9d37-4e25-b15c-ecb3e0fd82ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:32.463991 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8885f30f-9d37-4e25-b15c-ecb3e0fd82ff None admin] RBAC: Adding query filter params (role.id=d8f440a82947486ebb20a633ebee736b, scope.project.id=4e05769361674c8fa995050150ad4cfa, user.id=47a092fbe1334f7e9ae4ba9bdb5e9f4c) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:18:32.464298 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8885f30f-9d37-4e25-b15c-ecb3e0fd82ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:32.466526 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8885f30f-9d37-4e25-b15c-ecb3e0fd82ff None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:32.473314 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 633/1260] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 30 04:18:32 2022] GET /identity/v3/role_assignments?user.id=47a092fbe1334f7e9ae4ba9bdb5e9f4c&scope.project.id=4e05769361674c8fa995050150ad4cfa&role.id=d8f440a82947486ebb20a633ebee736b => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:18:34.484269 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659081e0-b45a-45d2-b15f-acb517dcf3f2 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:34.485135 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659081e0-b45a-45d2-b15f-acb517dcf3f2 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:34.485135 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659081e0-b45a-45d2-b15f-acb517dcf3f2 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:34.486697 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 628/1261] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:18:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:18:34.493382 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5671e-d9e5-495a-8720-1c8d3867cddd None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:34.494187 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5671e-d9e5-495a-8720-1c8d3867cddd None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:34.494187 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5671e-d9e5-495a-8720-1c8d3867cddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:34.516607 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-cce5671e-d9e5-495a-8720-1c8d3867cddd None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:18:34.517872 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-cce5671e-d9e5-495a-8720-1c8d3867cddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:34.603077 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 634/1262] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:18:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 04:18:34.872950 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659081e0-b45a-45d2-b15f-acb517dcf3f2 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:34.885674 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:34.995875 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659081e0-b45a-45d2-b15f-acb517dcf3f2 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:35.048502 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3995efa5-d0b5-468b-82ba-6620c2c672fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:35.049671 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995efa5-d0b5-468b-82ba-6620c2c672fb None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:35.050258 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995efa5-d0b5-468b-82ba-6620c2c672fb None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:35.050700 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995efa5-d0b5-468b-82ba-6620c2c672fb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:35.069490 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3995efa5-d0b5-468b-82ba-6620c2c672fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:18:35.076038 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-3995efa5-d0b5-468b-82ba-6620c2c672fb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:18:35.076038 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:18:35.076038 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:18:35.076038 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:18:35.076038 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:18:35.076038 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:18:35.076038 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:18:35.076038 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:18:35.076038 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:18:35.076038 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:18:35.076038 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:18:35.076038 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:18:35.076038 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:18:35.076038 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:18:35.076038 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:18:35.076038 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:18:35.077888 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:18:35.077888 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:18:35.077888 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:18:35.077888 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:18:35.077888 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:18:35.077888 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:18:35.077888 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:18:35.077888 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:18:35.077888 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:18:35.077888 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:18:35.077888 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:18:35.077888 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:18:35.077888 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:18:35.077888 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:18:35.077888 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:18:35.077888 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:18:35.079546 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:18:35.079546 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:18:35.079546 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:18:35.079546 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:18:35.079546 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:18:35.079546 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:18:35.079546 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:18:35.079546 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:18:35.079546 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:18:35.079546 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:18:35.079546 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:18:35.079546 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:18:35.079546 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 629/1263] 10.222.0.91 () {56 vars in 1096 bytes} [Tue Aug 30 04:18:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:18:35.088835 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce5671e-d9e5-495a-8720-1c8d3867cddd None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:35.117961 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:35.219138 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce5671e-d9e5-495a-8720-1c8d3867cddd None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:35.274874 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f14a85-5947-40ab-ba32-bae77e004178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:35.275887 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f14a85-5947-40ab-ba32-bae77e004178 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:35.276418 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f14a85-5947-40ab-ba32-bae77e004178 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:35.276854 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f14a85-5947-40ab-ba32-bae77e004178 None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:35.278196 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f14a85-5947-40ab-ba32-bae77e004178 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:18:35.278741 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f14a85-5947-40ab-ba32-bae77e004178 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:35.281410 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f14a85-5947-40ab-ba32-bae77e004178 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:35.298180 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 635/1264] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 30 04:18:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:18:35.304975 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3995efa5-d0b5-468b-82ba-6620c2c672fb None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:35.390228 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:35.430053 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3995efa5-d0b5-468b-82ba-6620c2c672fb None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:35.471349 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa83ec-2be0-42e6-9551-bedd7869e174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:35.471950 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa83ec-2be0-42e6-9551-bedd7869e174 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:35.472219 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa83ec-2be0-42e6-9551-bedd7869e174 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:35.472487 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa83ec-2be0-42e6-9551-bedd7869e174 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:35.485055 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aa83ec-2be0-42e6-9551-bedd7869e174 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:35.486564 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aa83ec-2be0-42e6-9551-bedd7869e174 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:35.503845 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-a2aa83ec-2be0-42e6-9551-bedd7869e174 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:18:35.503845 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:18:35.503845 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:18:35.503845 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:18:35.503845 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:18:35.503845 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:18:35.503845 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:18:35.503845 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:18:35.503845 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:18:35.503845 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:18:35.503845 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:18:35.503845 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:18:35.503845 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:18:35.503845 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:18:35.503845 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:18:35.503845 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:18:35.505915 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:18:35.505915 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:18:35.505915 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:18:35.505915 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:18:35.505915 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:18:35.505915 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:18:35.505915 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:18:35.505915 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:18:35.505915 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:18:35.505915 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:18:35.505915 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:18:35.505915 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:18:35.505915 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:18:35.505915 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:18:35.505915 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:18:35.505915 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:18:35.505915 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:18:35.507775 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:18:35.507775 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:18:35.507775 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:18:35.507775 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 630/1265] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:18:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:18:35.515033 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f14a85-5947-40ab-ba32-bae77e004178 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:35.645211 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:35.667510 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f14a85-5947-40ab-ba32-bae77e004178 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:35.709497 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc3674-81a3-4f4a-8e43-ec09ceb18ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:35.710155 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc3674-81a3-4f4a-8e43-ec09ceb18ba5 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:35.710430 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc3674-81a3-4f4a-8e43-ec09ceb18ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:35.710700 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc3674-81a3-4f4a-8e43-ec09ceb18ba5 None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:35.711385 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc3674-81a3-4f4a-8e43-ec09ceb18ba5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:18:35.711691 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc3674-81a3-4f4a-8e43-ec09ceb18ba5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:35.713153 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc3674-81a3-4f4a-8e43-ec09ceb18ba5 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:35.727775 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 636/1266] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:18:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:18:35.734408 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa83ec-2be0-42e6-9551-bedd7869e174 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:35.849831 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa83ec-2be0-42e6-9551-bedd7869e174 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:35.873889 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:35.890842 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5971b81-ed3d-46e4-bf22-06fce0a2dcf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:35.891485 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5971b81-ed3d-46e4-bf22-06fce0a2dcf2 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:35.891755 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5971b81-ed3d-46e4-bf22-06fce0a2dcf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:35.892057 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5971b81-ed3d-46e4-bf22-06fce0a2dcf2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:35.900548 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5971b81-ed3d-46e4-bf22-06fce0a2dcf2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:35.902063 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5971b81-ed3d-46e4-bf22-06fce0a2dcf2 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:35.915783 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-b5971b81-ed3d-46e4-bf22-06fce0a2dcf2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 04:18:35.915783 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:18:35.915783 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:18:35.915783 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:18:35.915783 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:18:35.915783 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:18:35.915783 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:18:35.915783 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:18:35.915783 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:18:35.915783 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:18:35.915783 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:18:35.915783 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:18:35.915783 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:18:35.915783 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:18:35.915783 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:18:35.915783 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:18:35.923303 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:18:35.923303 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:18:35.923303 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:18:35.923303 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:18:35.923303 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:18:35.923303 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:18:35.923303 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:18:35.923303 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:18:35.923303 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:18:35.923303 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:18:35.923303 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:18:35.923303 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:18:35.923303 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:18:35.923303 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:18:35.923303 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:18:35.923303 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:18:35.923303 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:18:35.923303 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:18:35.925420 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:18:35.925420 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:18:35.925420 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:18:35.925420 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:18:35.925420 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:18:35.925420 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:18:35.925420 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:18:35.925420 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:18:35.925420 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 04:18:35.925420 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:18:35.925420 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 631/1267] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:18:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:18:35.926762 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc3674-81a3-4f4a-8e43-ec09ceb18ba5 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:36.052393 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc3674-81a3-4f4a-8e43-ec09ceb18ba5 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:36.094456 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd1721-bbf4-4669-ac68-e7a83a007df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:36.095083 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd1721-bbf4-4669-ac68-e7a83a007df7 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:36.095358 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd1721-bbf4-4669-ac68-e7a83a007df7 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:36.095626 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd1721-bbf4-4669-ac68-e7a83a007df7 None admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:36.096408 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd1721-bbf4-4669-ac68-e7a83a007df7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:18:36.096714 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd1721-bbf4-4669-ac68-e7a83a007df7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:36.098178 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd1721-bbf4-4669-ac68-e7a83a007df7 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:36.108600 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:36.119341 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 637/1268] 10.222.0.91 () {56 vars in 1143 bytes} [Tue Aug 30 04:18:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:18:36.127334 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5971b81-ed3d-46e4-bf22-06fce0a2dcf2 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:36.275000 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5971b81-ed3d-46e4-bf22-06fce0a2dcf2 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:36.338724 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d04436-f8b7-49ba-9c8c-222341389776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:36.339804 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d04436-f8b7-49ba-9c8c-222341389776 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:36.340473 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d04436-f8b7-49ba-9c8c-222341389776 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:36.340964 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d04436-f8b7-49ba-9c8c-222341389776 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:36.362065 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d04436-f8b7-49ba-9c8c-222341389776 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:36.364873 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d04436-f8b7-49ba-9c8c-222341389776 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:36.394918 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-e6d04436-f8b7-49ba-9c8c-222341389776 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:18:36.394918 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:18:36.394918 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:18:36.394918 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:18:36.394918 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:18:36.394918 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:18:36.394918 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:18:36.394918 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:18:36.394918 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:18:36.394918 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:18:36.394918 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:18:36.394918 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:18:36.394918 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:18:36.394918 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:18:36.394918 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:18:36.394918 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:18:36.396256 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:18:36.396256 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:18:36.396256 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:18:36.396256 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:18:36.396256 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:18:36.396256 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:18:36.396256 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:18:36.396256 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:18:36.396256 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:18:36.396256 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:18:36.396256 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:18:36.396256 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:18:36.396256 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:18:36.396256 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:18:36.396256 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:18:36.396256 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:18:36.396256 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:18:36.397430 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:18:36.397430 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:18:36.397430 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:18:36.397430 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 632/1269] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:18:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:18:36.403773 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd1721-bbf4-4669-ac68-e7a83a007df7 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:36.527885 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd1721-bbf4-4669-ac68-e7a83a007df7 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:36.570484 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c199082e-56a8-4c3e-bc44-10b1ab244f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:36.571119 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199082e-56a8-4c3e-bc44-10b1ab244f09 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:36.571398 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199082e-56a8-4c3e-bc44-10b1ab244f09 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:36.571664 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199082e-56a8-4c3e-bc44-10b1ab244f09 None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:36.572379 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c199082e-56a8-4c3e-bc44-10b1ab244f09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:18:36.572689 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c199082e-56a8-4c3e-bc44-10b1ab244f09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:36.574232 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c199082e-56a8-4c3e-bc44-10b1ab244f09 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:36.587340 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 638/1270] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:18:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:18:36.593905 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d04436-f8b7-49ba-9c8c-222341389776 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:36.631323 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:36.709627 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d04436-f8b7-49ba-9c8c-222341389776 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:36.750019 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3975df5-c69e-468a-9732-10a3f00aaf7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:36.750662 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3975df5-c69e-468a-9732-10a3f00aaf7c None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:36.750938 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3975df5-c69e-468a-9732-10a3f00aaf7c None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:36.751216 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3975df5-c69e-468a-9732-10a3f00aaf7c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:36.758862 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3975df5-c69e-468a-9732-10a3f00aaf7c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:36.760435 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3975df5-c69e-468a-9732-10a3f00aaf7c None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:36.773524 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-a3975df5-c69e-468a-9732-10a3f00aaf7c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:18:36.773524 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:18:36.773524 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:18:36.773524 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:18:36.773524 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:18:36.773524 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:18:36.773524 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:18:36.773524 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:18:36.773524 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:18:36.773524 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:18:36.773524 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:18:36.773524 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:18:36.773524 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:18:36.773524 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:18:36.773524 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:18:36.775086 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:18:36.775086 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:18:36.775086 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:18:36.775086 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:18:36.775086 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:18:36.775086 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:18:36.775086 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:18:36.775086 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:18:36.775086 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:18:36.775086 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:18:36.775086 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:18:36.775086 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:18:36.775086 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:18:36.775086 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:18:36.775086 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:18:36.775086 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:18:36.775086 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:18:36.776821 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:18:36.776821 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:18:36.776821 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:18:36.776821 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:18:36.776821 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:18:36.776821 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:18:36.776821 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:18:36.776821 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:18:36.776821 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 633/1271] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 30 04:18:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:18:36.781218 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c199082e-56a8-4c3e-bc44-10b1ab244f09 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:36.847079 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:36.896711 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c199082e-56a8-4c3e-bc44-10b1ab244f09 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:36.935648 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d556f00-64d1-4ea9-8f8d-e12e7bac45da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:36.936309 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d556f00-64d1-4ea9-8f8d-e12e7bac45da None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:36.936583 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d556f00-64d1-4ea9-8f8d-e12e7bac45da None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:36.936853 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d556f00-64d1-4ea9-8f8d-e12e7bac45da None admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:36.937566 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d556f00-64d1-4ea9-8f8d-e12e7bac45da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:18:36.937869 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d556f00-64d1-4ea9-8f8d-e12e7bac45da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:36.939339 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d556f00-64d1-4ea9-8f8d-e12e7bac45da None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:36.953758 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 639/1272] 10.222.0.91 () {56 vars in 1148 bytes} [Tue Aug 30 04:18:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:18:36.960666 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3975df5-c69e-468a-9732-10a3f00aaf7c None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:37.091663 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:37.103696 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3975df5-c69e-468a-9732-10a3f00aaf7c None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:37.146121 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c911229-68fb-44bd-8522-ec2c17e9ab7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:37.146838 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c911229-68fb-44bd-8522-ec2c17e9ab7a None admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:37.147299 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c911229-68fb-44bd-8522-ec2c17e9ab7a None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:37.147753 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c911229-68fb-44bd-8522-ec2c17e9ab7a None admin] PATH_INFO: `/v3/projects/4e05769361674c8fa995050150ad4cfa/users/47a092fbe1334f7e9ae4ba9bdb5e9f4c/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:37.150841 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c911229-68fb-44bd-8522-ec2c17e9ab7a None admin] RBAC: Authorizing `identity:create_grant(project_id=4e05769361674c8fa995050150ad4cfa, user_id=47a092fbe1334f7e9ae4ba9bdb5e9f4c, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:37.153409 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c911229-68fb-44bd-8522-ec2c17e9ab7a None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:37.172342 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 634/1273] 10.222.0.91 () {58 vars in 1439 bytes} [Tue Aug 30 04:18:36 2022] PUT /identity/v3/projects/4e05769361674c8fa995050150ad4cfa/users/47a092fbe1334f7e9ae4ba9bdb5e9f4c/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:18:39.190778 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcdfb5c-2903-410a-b57b-acb7a49e4182 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:39.191635 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcdfb5c-2903-410a-b57b-acb7a49e4182 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:39.191635 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcdfb5c-2903-410a-b57b-acb7a49e4182 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:39.193069 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 640/1274] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:18:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:18:39.199176 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8704206-a6ba-40d6-9124-54289ebcf5ae None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:39.200759 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8704206-a6ba-40d6-9124-54289ebcf5ae None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:39.200759 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8704206-a6ba-40d6-9124-54289ebcf5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:39.225752 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-c8704206-a6ba-40d6-9124-54289ebcf5ae None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:18:39.229307 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-c8704206-a6ba-40d6-9124-54289ebcf5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:39.356499 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 635/1275] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:18:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 04:18:39.683176 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcdfb5c-2903-410a-b57b-acb7a49e4182 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:39.812883 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcdfb5c-2903-410a-b57b-acb7a49e4182 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:39.835234 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:39.864777 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761992a6-dddb-41a1-9a5b-21afaffdbc27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:39.865856 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761992a6-dddb-41a1-9a5b-21afaffdbc27 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:39.866323 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761992a6-dddb-41a1-9a5b-21afaffdbc27 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:39.866780 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761992a6-dddb-41a1-9a5b-21afaffdbc27 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:39.883144 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761992a6-dddb-41a1-9a5b-21afaffdbc27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:18:39.888289 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-761992a6-dddb-41a1-9a5b-21afaffdbc27 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:18:39.888289 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:18:39.888289 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:18:39.888289 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:18:39.888289 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:18:39.888289 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:18:39.888289 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:18:39.888289 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:18:39.888289 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:18:39.888289 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:18:39.888289 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:18:39.888289 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:18:39.888289 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:18:39.888289 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:18:39.888289 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:18:39.888289 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:18:39.889570 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:18:39.889570 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:18:39.889570 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:18:39.889570 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:18:39.889570 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:18:39.889570 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:18:39.889570 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:18:39.889570 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:18:39.889570 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:18:39.889570 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:18:39.889570 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:18:39.889570 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:18:39.889570 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:18:39.889570 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:18:39.889570 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:18:39.889570 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:18:39.890515 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:18:39.890515 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:18:39.890515 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:18:39.890515 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:18:39.890515 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:18:39.890515 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:18:39.890515 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:18:39.890515 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:18:39.890515 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:18:39.890515 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:18:39.890515 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:18:39.890515 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:18:39.890515 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 641/1276] 10.222.0.91 () {56 vars in 1096 bytes} [Tue Aug 30 04:18:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:18:39.898212 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8704206-a6ba-40d6-9124-54289ebcf5ae None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:40.003617 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:40.033709 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8704206-a6ba-40d6-9124-54289ebcf5ae None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:40.083250 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c4956-0592-4cbb-8cbb-f68fa99ad9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:40.084297 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c4956-0592-4cbb-8cbb-f68fa99ad9a7 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:40.084594 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c4956-0592-4cbb-8cbb-f68fa99ad9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:40.084907 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c4956-0592-4cbb-8cbb-f68fa99ad9a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:40.085847 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484c4956-0592-4cbb-8cbb-f68fa99ad9a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:18:40.086161 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484c4956-0592-4cbb-8cbb-f68fa99ad9a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:40.087889 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484c4956-0592-4cbb-8cbb-f68fa99ad9a7 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:40.100755 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 636/1277] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 30 04:18:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:18:40.107836 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761992a6-dddb-41a1-9a5b-21afaffdbc27 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:40.273270 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761992a6-dddb-41a1-9a5b-21afaffdbc27 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:40.314625 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb6b6d-4189-43e8-8689-2f066ad3c33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:40.315281 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb6b6d-4189-43e8-8689-2f066ad3c33e None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:40.315556 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb6b6d-4189-43e8-8689-2f066ad3c33e None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:40.315830 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb6b6d-4189-43e8-8689-2f066ad3c33e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:40.328095 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcb6b6d-4189-43e8-8689-2f066ad3c33e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:40.329621 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcb6b6d-4189-43e8-8689-2f066ad3c33e None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:40.346249 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-3fcb6b6d-4189-43e8-8689-2f066ad3c33e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:18:40.346249 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:18:40.346249 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:18:40.346249 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:18:40.346249 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:18:40.346249 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:18:40.346249 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:18:40.346249 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:18:40.346249 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:18:40.346249 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:18:40.346249 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:18:40.346249 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:18:40.346249 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:18:40.346249 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:18:40.346249 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:18:40.346249 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:18:40.348452 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:18:40.348452 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:18:40.348452 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:18:40.348452 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:18:40.348452 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:18:40.348452 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:18:40.348452 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:18:40.348452 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:18:40.348452 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:18:40.348452 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:18:40.348452 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:18:40.348452 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:18:40.348452 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:18:40.348452 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:18:40.348452 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:18:40.348452 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:18:40.348452 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:18:40.350316 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:18:40.350316 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:18:40.350316 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:18:40.350316 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 642/1278] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:18:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:18:40.353867 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c4956-0592-4cbb-8cbb-f68fa99ad9a7 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:40.472763 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c4956-0592-4cbb-8cbb-f68fa99ad9a7 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:40.517937 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce11b79d-2b54-45db-9a6f-04ddff5309bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:40.518573 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11b79d-2b54-45db-9a6f-04ddff5309bc None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:40.518848 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11b79d-2b54-45db-9a6f-04ddff5309bc None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:40.519115 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11b79d-2b54-45db-9a6f-04ddff5309bc None admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:40.519768 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce11b79d-2b54-45db-9a6f-04ddff5309bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:18:40.520107 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce11b79d-2b54-45db-9a6f-04ddff5309bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:40.521619 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce11b79d-2b54-45db-9a6f-04ddff5309bc None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:40.537330 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 637/1279] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:18:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:18:40.544571 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb6b6d-4189-43e8-8689-2f066ad3c33e None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:40.581449 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:40.667672 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb6b6d-4189-43e8-8689-2f066ad3c33e None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:40.710647 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1e6b6e-894b-4033-8ca8-d05572ce7bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:40.711403 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e6b6e-894b-4033-8ca8-d05572ce7bfb None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:40.711866 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e6b6e-894b-4033-8ca8-d05572ce7bfb None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:40.712096 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e6b6e-894b-4033-8ca8-d05572ce7bfb None admin] PATH_INFO: `/v3/users/placement` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:40.722139 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1e6b6e-894b-4033-8ca8-d05572ce7bfb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:40.723703 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1e6b6e-894b-4033-8ca8-d05572ce7bfb None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:40.737599 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-1c1e6b6e-894b-4033-8ca8-d05572ce7bfb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 04:18:40.737599 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:18:40.737599 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:18:40.737599 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:18:40.737599 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:18:40.737599 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:18:40.737599 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:18:40.737599 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:18:40.737599 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:18:40.737599 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:18:40.737599 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:18:40.737599 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:18:40.737599 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:18:40.737599 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:18:40.737599 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:18:40.737599 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:18:40.739343 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:18:40.739343 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:18:40.739343 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:18:40.739343 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:18:40.739343 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:18:40.739343 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:18:40.739343 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:18:40.739343 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:18:40.739343 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:18:40.739343 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:18:40.739343 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:18:40.739343 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:18:40.739343 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:18:40.739343 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:18:40.739343 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:18:40.739343 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:18:40.739343 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:18:40.739343 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:18:40.740418 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:18:40.740418 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:18:40.740418 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:18:40.740418 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:18:40.740418 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:18:40.740418 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:18:40.740418 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:18:40.740418 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:18:40.740418 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 04:18:40.740418 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:18:40.740418 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 643/1280] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:18:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:18:40.748167 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce11b79d-2b54-45db-9a6f-04ddff5309bc None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:40.752614 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:40.877538 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce11b79d-2b54-45db-9a6f-04ddff5309bc None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:40.942934 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60275a-0dce-4acb-8580-5961e49dfe0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:40.943956 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60275a-0dce-4acb-8580-5961e49dfe0a None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:40.944429 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60275a-0dce-4acb-8580-5961e49dfe0a None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:40.944885 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60275a-0dce-4acb-8580-5961e49dfe0a None admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:40.946184 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef60275a-0dce-4acb-8580-5961e49dfe0a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:18:40.946674 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef60275a-0dce-4acb-8580-5961e49dfe0a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:40.950272 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef60275a-0dce-4acb-8580-5961e49dfe0a None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:40.986964 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 638/1281] 10.222.0.91 () {56 vars in 1143 bytes} [Tue Aug 30 04:18:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:18:40.993980 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1e6b6e-894b-4033-8ca8-d05572ce7bfb None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:41.126047 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:41.138007 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1e6b6e-894b-4033-8ca8-d05572ce7bfb None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:41.178341 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aa116e-1e26-4a58-b8d5-9acc138b7047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:41.179348 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa116e-1e26-4a58-b8d5-9acc138b7047 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:41.179796 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa116e-1e26-4a58-b8d5-9acc138b7047 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:41.180325 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa116e-1e26-4a58-b8d5-9acc138b7047 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:41.313698 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aa116e-1e26-4a58-b8d5-9acc138b7047 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:41.316458 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aa116e-1e26-4a58-b8d5-9acc138b7047 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:41.471108 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:41.483038 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 644/1282] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 30 04:18:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 04:18:41.490275 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60275a-0dce-4acb-8580-5961e49dfe0a None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:41.580005 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:41.627518 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60275a-0dce-4acb-8580-5961e49dfe0a None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:41.669796 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685f23c-d78a-4a54-88b3-db17b82a20a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:41.670799 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685f23c-d78a-4a54-88b3-db17b82a20a6 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:41.671072 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685f23c-d78a-4a54-88b3-db17b82a20a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:41.671340 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685f23c-d78a-4a54-88b3-db17b82a20a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:41.683412 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6685f23c-d78a-4a54-88b3-db17b82a20a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:41.685290 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6685f23c-d78a-4a54-88b3-db17b82a20a6 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:41.702000 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-6685f23c-d78a-4a54-88b3-db17b82a20a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:18:41.702000 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:18:41.702000 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:18:41.702000 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:18:41.702000 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:18:41.702000 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:18:41.702000 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:18:41.702000 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:18:41.702000 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:18:41.702000 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:18:41.702000 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:18:41.702000 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:18:41.702000 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:18:41.702000 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:18:41.702000 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:18:41.702000 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:18:41.703975 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:18:41.703975 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:18:41.703975 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:18:41.703975 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:18:41.703975 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:18:41.703975 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:18:41.703975 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:18:41.703975 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:18:41.703975 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:18:41.703975 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:18:41.703975 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:18:41.703975 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:18:41.703975 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:18:41.703975 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:18:41.703975 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:18:41.703975 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:18:41.703975 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:18:41.706042 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:18:41.706042 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:18:41.706042 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:18:41.706042 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 639/1283] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:18:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:18:41.710627 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aa116e-1e26-4a58-b8d5-9acc138b7047 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:41.826872 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aa116e-1e26-4a58-b8d5-9acc138b7047 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:41.868162 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305f5aee-ec0c-4379-b78e-047aa56e2f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:41.868840 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f5aee-ec0c-4379-b78e-047aa56e2f90 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:41.869149 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f5aee-ec0c-4379-b78e-047aa56e2f90 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:41.869494 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f5aee-ec0c-4379-b78e-047aa56e2f90 None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:41.870298 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305f5aee-ec0c-4379-b78e-047aa56e2f90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:18:41.870646 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305f5aee-ec0c-4379-b78e-047aa56e2f90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:41.872388 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305f5aee-ec0c-4379-b78e-047aa56e2f90 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:41.886208 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 645/1284] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 30 04:18:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:18:41.892339 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685f23c-d78a-4a54-88b3-db17b82a20a6 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:42.012401 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685f23c-d78a-4a54-88b3-db17b82a20a6 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:42.034054 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:42.067229 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faf2b07-a40b-4a49-a55a-93389d7b65e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:42.068555 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf2b07-a40b-4a49-a55a-93389d7b65e3 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:42.069037 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf2b07-a40b-4a49-a55a-93389d7b65e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:42.069710 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf2b07-a40b-4a49-a55a-93389d7b65e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:42.083196 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faf2b07-a40b-4a49-a55a-93389d7b65e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:42.085857 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faf2b07-a40b-4a49-a55a-93389d7b65e3 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:42.109584 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application [None req-3faf2b07-a40b-4a49-a55a-93389d7b65e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:18:42.109584 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:18:42.109584 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:18:42.109584 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:18:42.109584 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:18:42.109584 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:18:42.109584 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:18:42.109584 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:18:42.109584 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:18:42.109584 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:18:42.109584 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:18:42.109584 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:18:42.109584 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:18:42.109584 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:18:42.109584 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:18:42.110666 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:18:42.110666 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:18:42.110666 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:18:42.110666 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:18:42.110666 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:18:42.110666 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:18:42.110666 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:18:42.110666 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:18:42.110666 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application with Lock( Aug 30 04:18:42.110666 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:18:42.110666 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:18:42.110666 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:18:42.110666 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:18:42.110666 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:18:42.110666 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:18:42.110666 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:18:42.110666 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:18:42.111584 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:18:42.111584 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:18:42.111584 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:18:42.111584 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:18:42.111584 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:18:42.111584 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:18:42.111584 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:18:42.111584 dv-cinder-854265-2-smb devstack@keystone.service[81547]: ERROR keystone.server.flask.application Aug 30 04:18:42.111584 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 640/1285] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 30 04:18:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:18:42.121913 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305f5aee-ec0c-4379-b78e-047aa56e2f90 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:42.226159 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:42.286095 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305f5aee-ec0c-4379-b78e-047aa56e2f90 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:42.326390 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daf1f92-247d-4cff-bcb0-138147dc7ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:42.327124 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf1f92-247d-4cff-bcb0-138147dc7ee3 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:42.327285 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf1f92-247d-4cff-bcb0-138147dc7ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:42.327532 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf1f92-247d-4cff-bcb0-138147dc7ee3 None admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:42.328268 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daf1f92-247d-4cff-bcb0-138147dc7ee3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:18:42.328570 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daf1f92-247d-4cff-bcb0-138147dc7ee3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:42.330056 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daf1f92-247d-4cff-bcb0-138147dc7ee3 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:42.344838 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 646/1286] 10.222.0.91 () {56 vars in 1148 bytes} [Tue Aug 30 04:18:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:18:42.354282 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faf2b07-a40b-4a49-a55a-93389d7b65e3 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:42.476534 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faf2b07-a40b-4a49-a55a-93389d7b65e3 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:42.517816 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07397299-a514-492a-beb2-01ddb2f424b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:42.518606 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07397299-a514-492a-beb2-01ddb2f424b2 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:42.518772 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07397299-a514-492a-beb2-01ddb2f424b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:42.519014 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07397299-a514-492a-beb2-01ddb2f424b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:42.519830 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07397299-a514-492a-beb2-01ddb2f424b2 None admin] RBAC: Adding query filter params (role.id=d8f440a82947486ebb20a633ebee736b, scope.project.id=4e05769361674c8fa995050150ad4cfa, user.id=47a092fbe1334f7e9ae4ba9bdb5e9f4c) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:18:42.520261 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07397299-a514-492a-beb2-01ddb2f424b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:42.522066 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07397299-a514-492a-beb2-01ddb2f424b2 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:42.529663 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 641/1287] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 30 04:18:42 2022] GET /identity/v3/role_assignments?user.id=47a092fbe1334f7e9ae4ba9bdb5e9f4c&scope.project.id=4e05769361674c8fa995050150ad4cfa&role.id=d8f440a82947486ebb20a633ebee736b => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:18:44.581638 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f2e15-903b-4e35-812a-1f28e4443b99 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:44.582292 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f2e15-903b-4e35-812a-1f28e4443b99 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:44.582292 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f2e15-903b-4e35-812a-1f28e4443b99 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:44.583689 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 647/1288] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:18:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:18:44.589828 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753d709-1128-464c-969a-12b9016b0576 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:44.590715 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753d709-1128-464c-969a-12b9016b0576 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:44.591006 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753d709-1128-464c-969a-12b9016b0576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:44.613485 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-8753d709-1128-464c-969a-12b9016b0576 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:18:44.614751 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-8753d709-1128-464c-969a-12b9016b0576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:44.657778 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:44.704413 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 642/1289] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:18:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:18:44.993616 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f2e15-903b-4e35-812a-1f28e4443b99 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:45.151392 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f2e15-903b-4e35-812a-1f28e4443b99 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:45.166376 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:45.195119 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f352949e-2848-466b-a7c1-1f875e0aa3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:45.195871 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f352949e-2848-466b-a7c1-1f875e0aa3e1 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:45.196325 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f352949e-2848-466b-a7c1-1f875e0aa3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:45.196696 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f352949e-2848-466b-a7c1-1f875e0aa3e1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:45.197345 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f352949e-2848-466b-a7c1-1f875e0aa3e1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:45.198995 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f352949e-2848-466b-a7c1-1f875e0aa3e1 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:45.209414 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-f352949e-2848-466b-a7c1-1f875e0aa3e1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 04:18:45.209414 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:18:45.209414 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:18:45.209414 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:18:45.209414 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:18:45.209414 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:18:45.209414 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:18:45.209414 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:18:45.209414 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 04:18:45.209414 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:18:45.209414 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:18:45.209414 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:18:45.209414 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:18:45.209414 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:18:45.209414 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:18:45.209414 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:18:45.209414 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:18:45.211072 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:18:45.211072 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:18:45.211072 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:18:45.211072 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:18:45.211072 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:18:45.211072 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:18:45.211072 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:18:45.211072 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:18:45.211072 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:18:45.211072 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:18:45.211072 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:18:45.211072 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:18:45.211072 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:18:45.211072 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:18:45.211072 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:18:45.211072 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:18:45.212894 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:18:45.212894 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:18:45.212894 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:18:45.212894 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:18:45.212894 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:18:45.212894 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:18:45.212894 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:18:45.212894 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:18:45.212894 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:18:45.212894 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:18:45.212894 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:18:45.212894 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:18:45.212894 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 04:18:45.212894 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:18:45.212894 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 648/1290] 10.222.0.91 () {56 vars in 1117 bytes} [Tue Aug 30 04:18:44 2022] GET /identity/v3/services/placement => generated 90 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:18:45.218164 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8753d709-1128-464c-969a-12b9016b0576 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:45.406248 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8753d709-1128-464c-969a-12b9016b0576 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:45.474222 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acd5824-3ffd-4c9a-96b7-aafc2d9f158b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:45.475258 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd5824-3ffd-4c9a-96b7-aafc2d9f158b None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:45.475730 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd5824-3ffd-4c9a-96b7-aafc2d9f158b None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:45.476249 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd5824-3ffd-4c9a-96b7-aafc2d9f158b None admin] PATH_INFO: `/v3/services` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:45.477397 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acd5824-3ffd-4c9a-96b7-aafc2d9f158b None admin] RBAC: Adding query filter params (name=placement) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:18:45.477936 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acd5824-3ffd-4c9a-96b7-aafc2d9f158b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:45.480606 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acd5824-3ffd-4c9a-96b7-aafc2d9f158b None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:45.490533 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 643/1291] 10.222.0.91 () {56 vars in 1116 bytes} [Tue Aug 30 04:18:45 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:18:45.497564 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f352949e-2848-466b-a7c1-1f875e0aa3e1 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:45.624519 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f352949e-2848-466b-a7c1-1f875e0aa3e1 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:45.665662 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684f4fba-1343-41bd-909d-59770284e0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:45.666253 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f4fba-1343-41bd-909d-59770284e0e5 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:45.666583 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f4fba-1343-41bd-909d-59770284e0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:45.666894 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f4fba-1343-41bd-909d-59770284e0e5 None admin] PATH_INFO: `/v3/services` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:45.667603 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684f4fba-1343-41bd-909d-59770284e0e5 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:18:45.668013 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684f4fba-1343-41bd-909d-59770284e0e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:45.669588 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684f4fba-1343-41bd-909d-59770284e0e5 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:45.675648 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 649/1292] 10.222.0.91 () {56 vars in 1116 bytes} [Tue Aug 30 04:18:45 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:18:47.757664 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17a60f-93e0-4cad-a950-d9d87970b1ea None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:47.758268 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17a60f-93e0-4cad-a950-d9d87970b1ea None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:47.758268 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17a60f-93e0-4cad-a950-d9d87970b1ea None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:47.759721 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 644/1293] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:18:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:18:47.766748 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64381ed8-51be-4174-bbc7-2431d67ca0c6 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:47.767342 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64381ed8-51be-4174-bbc7-2431d67ca0c6 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:47.767342 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64381ed8-51be-4174-bbc7-2431d67ca0c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:47.787376 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-64381ed8-51be-4174-bbc7-2431d67ca0c6 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:18:47.788947 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-64381ed8-51be-4174-bbc7-2431d67ca0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:47.825701 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:47.872541 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 650/1294] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:18:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 04:18:48.147333 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd17a60f-93e0-4cad-a950-d9d87970b1ea None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:48.200757 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:48.291556 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd17a60f-93e0-4cad-a950-d9d87970b1ea None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:48.333943 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e732154-6e6d-4220-a05f-1715fa48d3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:48.334579 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e732154-6e6d-4220-a05f-1715fa48d3fc None admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:48.334852 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e732154-6e6d-4220-a05f-1715fa48d3fc None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:48.335121 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e732154-6e6d-4220-a05f-1715fa48d3fc None admin] PATH_INFO: `/v3/services` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:48.335787 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e732154-6e6d-4220-a05f-1715fa48d3fc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:48.337259 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e732154-6e6d-4220-a05f-1715fa48d3fc None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:48.355299 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 645/1295] 10.222.0.91 () {60 vars in 1141 bytes} [Tue Aug 30 04:18:48 2022] POST /identity/v3/services => generated 246 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:18:50.424163 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad929d-f635-435e-95f2-9f7d67dd3ecc None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:50.425016 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad929d-f635-435e-95f2-9f7d67dd3ecc None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:50.425199 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad929d-f635-435e-95f2-9f7d67dd3ecc None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:50.427609 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 651/1296] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:18:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:18:50.434065 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280eac4-ae4d-4d29-810c-a822894d3d25 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:50.434728 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280eac4-ae4d-4d29-810c-a822894d3d25 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:50.434728 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280eac4-ae4d-4d29-810c-a822894d3d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:50.455206 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-a280eac4-ae4d-4d29-810c-a822894d3d25 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:18:50.456481 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-a280eac4-ae4d-4d29-810c-a822894d3d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:50.547901 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 646/1297] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:18:50 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:18:50.817954 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad929d-f635-435e-95f2-9f7d67dd3ecc None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:50.946849 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad929d-f635-435e-95f2-9f7d67dd3ecc None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:51.012791 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af36950-edb6-4f19-acb8-dc47b3805d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:51.013830 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af36950-edb6-4f19-acb8-dc47b3805d10 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:51.014298 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af36950-edb6-4f19-acb8-dc47b3805d10 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:51.014741 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af36950-edb6-4f19-acb8-dc47b3805d10 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:51.015768 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af36950-edb6-4f19-acb8-dc47b3805d10 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:51.018335 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af36950-edb6-4f19-acb8-dc47b3805d10 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:51.035840 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-7af36950-edb6-4f19-acb8-dc47b3805d10 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 04:18:51.035840 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:18:51.035840 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:18:51.035840 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:18:51.035840 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:18:51.035840 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:18:51.035840 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:18:51.035840 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:18:51.035840 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 04:18:51.035840 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:18:51.035840 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:18:51.035840 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:18:51.035840 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:18:51.035840 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:18:51.035840 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:18:51.035840 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:18:51.035840 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:18:51.037927 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:18:51.037927 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:18:51.037927 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:18:51.037927 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:18:51.037927 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:18:51.037927 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:18:51.037927 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:18:51.037927 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:18:51.037927 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:18:51.037927 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:18:51.037927 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:18:51.037927 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:18:51.037927 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:18:51.037927 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:18:51.037927 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:18:51.037927 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:18:51.039606 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:18:51.039606 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:18:51.039606 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:18:51.039606 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:18:51.039606 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:18:51.039606 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:18:51.039606 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:18:51.039606 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:18:51.039606 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:18:51.039606 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:18:51.039606 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:18:51.039606 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:18:51.039606 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 04:18:51.039606 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:18:51.039606 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 652/1298] 10.222.0.91 () {56 vars in 1117 bytes} [Tue Aug 30 04:18:50 2022] GET /identity/v3/services/placement => generated 90 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:18:51.046029 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a280eac4-ae4d-4d29-810c-a822894d3d25 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:51.076578 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:51.176391 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a280eac4-ae4d-4d29-810c-a822894d3d25 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:51.230908 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df72c83e-5a76-4894-8148-6b3994fe2b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:51.231893 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df72c83e-5a76-4894-8148-6b3994fe2b74 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:51.232408 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df72c83e-5a76-4894-8148-6b3994fe2b74 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:51.232888 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df72c83e-5a76-4894-8148-6b3994fe2b74 None admin] PATH_INFO: `/v3/services` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:51.234057 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df72c83e-5a76-4894-8148-6b3994fe2b74 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:18:51.234592 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df72c83e-5a76-4894-8148-6b3994fe2b74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:51.237320 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df72c83e-5a76-4894-8148-6b3994fe2b74 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:51.248329 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 647/1299] 10.222.0.91 () {56 vars in 1116 bytes} [Tue Aug 30 04:18:51 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:18:51.255451 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af36950-edb6-4f19-acb8-dc47b3805d10 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:51.295514 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:51.387530 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af36950-edb6-4f19-acb8-dc47b3805d10 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:51.441149 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb4559d-f623-41e2-959c-bdbb1660d643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:51.441893 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb4559d-f623-41e2-959c-bdbb1660d643 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:51.442027 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb4559d-f623-41e2-959c-bdbb1660d643 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:51.442280 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb4559d-f623-41e2-959c-bdbb1660d643 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:51.442990 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb4559d-f623-41e2-959c-bdbb1660d643 None admin] RBAC: Adding query filter params (interface=public, service_id=99178f2af20e4f6aa32427e38ed8f610, region_id=RegionOne) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:18:51.443295 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb4559d-f623-41e2-959c-bdbb1660d643 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:51.444711 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb4559d-f623-41e2-959c-bdbb1660d643 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:51.450749 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 653/1300] 10.222.0.91 () {56 vars in 1251 bytes} [Tue Aug 30 04:18:51 2022] GET /identity/v3/endpoints?service_id=99178f2af20e4f6aa32427e38ed8f610&interface=public®ion_id=RegionOne => generated 194 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:18:51.460844 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df72c83e-5a76-4894-8148-6b3994fe2b74 None admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:51.612795 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:51.637947 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df72c83e-5a76-4894-8148-6b3994fe2b74 None admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:51.681614 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fd5e40-03b7-4e46-9fa7-f5672cc00017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:51.682306 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd5e40-03b7-4e46-9fa7-f5672cc00017 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:51.682623 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd5e40-03b7-4e46-9fa7-f5672cc00017 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:51.682937 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd5e40-03b7-4e46-9fa7-f5672cc00017 None admin] PATH_INFO: `/v3/services` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:51.684084 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fd5e40-03b7-4e46-9fa7-f5672cc00017 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:51.685579 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fd5e40-03b7-4e46-9fa7-f5672cc00017 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:51.698191 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 648/1301] 10.222.0.91 () {56 vars in 1087 bytes} [Tue Aug 30 04:18:51 2022] GET /identity/v3/services => generated 2191 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:18:53.979878 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7d015-be21-473e-aee0-1533bb03f528 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:53.980514 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7d015-be21-473e-aee0-1533bb03f528 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:53.980514 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7d015-be21-473e-aee0-1533bb03f528 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:53.982209 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 654/1302] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:18:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:18:53.988550 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef51101-89b2-467e-87e9-ae5ad63b911b None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:53.989193 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef51101-89b2-467e-87e9-ae5ad63b911b None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:53.989193 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef51101-89b2-467e-87e9-ae5ad63b911b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:54.009851 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-3ef51101-89b2-467e-87e9-ae5ad63b911b None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:18:54.011112 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-3ef51101-89b2-467e-87e9-ae5ad63b911b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:54.092559 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 649/1303] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:18:53 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 04:18:54.362738 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7d015-be21-473e-aee0-1533bb03f528 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:54.493947 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:54.503998 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7d015-be21-473e-aee0-1533bb03f528 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:54.547478 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67df8404-870f-4cb6-a699-17c19bed2b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:54.548168 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df8404-870f-4cb6-a699-17c19bed2b4b None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:54.548445 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df8404-870f-4cb6-a699-17c19bed2b4b None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:54.548715 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df8404-870f-4cb6-a699-17c19bed2b4b None admin] PATH_INFO: `/v3/services/placement` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:54.549325 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67df8404-870f-4cb6-a699-17c19bed2b4b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:54.550770 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67df8404-870f-4cb6-a699-17c19bed2b4b None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:54.561552 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-67df8404-870f-4cb6-a699-17c19bed2b4b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 04:18:54.561552 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:18:54.561552 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:18:54.561552 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:18:54.561552 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:18:54.561552 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:18:54.561552 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:18:54.561552 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:18:54.561552 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 04:18:54.561552 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:18:54.561552 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:18:54.561552 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:18:54.561552 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:18:54.561552 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:18:54.561552 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:18:54.561552 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:18:54.561552 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:18:54.562848 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:18:54.562848 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:18:54.562848 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:18:54.562848 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:18:54.562848 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:18:54.562848 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:18:54.562848 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:18:54.562848 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:18:54.562848 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:18:54.562848 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:18:54.562848 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:18:54.562848 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:18:54.562848 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:18:54.562848 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:18:54.562848 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:18:54.562848 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:18:54.564123 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:18:54.564123 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Aug 30 04:18:54.564123 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:18:54.564123 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:18:54.564123 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:18:54.564123 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:18:54.564123 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:18:54.564123 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:18:54.564123 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:18:54.564123 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:18:54.564123 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:18:54.564123 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:18:54.564123 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 04:18:54.564123 dv-cinder-854265-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Aug 30 04:18:54.564123 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 655/1304] 10.222.0.91 () {56 vars in 1117 bytes} [Tue Aug 30 04:18:54 2022] GET /identity/v3/services/placement => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:18:54.569360 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef51101-89b2-467e-87e9-ae5ad63b911b None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:54.670677 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:54.716274 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef51101-89b2-467e-87e9-ae5ad63b911b None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:54.759666 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef8e73c-cd54-4486-8ab6-94bf5a3264d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:54.760336 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8e73c-cd54-4486-8ab6-94bf5a3264d2 None admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:54.760613 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8e73c-cd54-4486-8ab6-94bf5a3264d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:54.760885 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8e73c-cd54-4486-8ab6-94bf5a3264d2 None admin] PATH_INFO: `/v3/services` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:54.761547 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef8e73c-cd54-4486-8ab6-94bf5a3264d2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:18:54.762448 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef8e73c-cd54-4486-8ab6-94bf5a3264d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:54.764103 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef8e73c-cd54-4486-8ab6-94bf5a3264d2 None admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:54.770261 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 650/1305] 10.222.0.91 () {56 vars in 1116 bytes} [Tue Aug 30 04:18:54 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:18:54.780346 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67df8404-870f-4cb6-a699-17c19bed2b4b None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:54.921589 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67df8404-870f-4cb6-a699-17c19bed2b4b None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:54.963388 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b20e77-fac2-41cd-93a3-cd4b6e18a847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:54.964051 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b20e77-fac2-41cd-93a3-cd4b6e18a847 None admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:54.964331 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b20e77-fac2-41cd-93a3-cd4b6e18a847 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:54.964600 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b20e77-fac2-41cd-93a3-cd4b6e18a847 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:54.965443 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b20e77-fac2-41cd-93a3-cd4b6e18a847 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:54.967385 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b20e77-fac2-41cd-93a3-cd4b6e18a847 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:54.998586 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 656/1306] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:18:54 2022] POST /identity/v3/endpoints => generated 331 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:19:04.766851 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=30 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:04.988694 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:11.791580 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ac886-1f43-4bd6-985a-4b446002eed0 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:11.792746 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ac886-1f43-4bd6-985a-4b446002eed0 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:11.793244 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ac886-1f43-4bd6-985a-4b446002eed0 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:11.801926 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f580381-f8c3-44ef-9910-7e9c26cef461 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:11.802958 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f580381-f8c3-44ef-9910-7e9c26cef461 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:11.803463 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f580381-f8c3-44ef-9910-7e9c26cef461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:11.808567 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 651/1307] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:20:11 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:20:11.908686 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-3f580381-f8c3-44ef-9910-7e9c26cef461 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:20:11.910623 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-3f580381-f8c3-44ef-9910-7e9c26cef461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:12.111169 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 657/1308] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:20:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:20:12.399701 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b11c903-d47d-487d-be52-cf995b6b032d None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:12.400444 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b11c903-d47d-487d-be52-cf995b6b032d None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:12.400959 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b11c903-d47d-487d-be52-cf995b6b032d None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:12.402675 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 652/1309] 10.222.0.91 () {54 vars in 965 bytes} [Tue Aug 30 04:20:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:20:12.410331 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beca91d-6d08-4c02-a735-199ebe541cf6 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:12.410701 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beca91d-6d08-4c02-a735-199ebe541cf6 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:12.410877 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beca91d-6d08-4c02-a735-199ebe541cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:12.703290 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-0beca91d-6d08-4c02-a735-199ebe541cf6 None None] MFA Rules not processed for user `1c05f49ae42b4f9583ff10b2cfce52a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:20:12.705150 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-0beca91d-6d08-4c02-a735-199ebe541cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:12.779102 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:12.858712 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 658/1310] 10.222.0.91 () {58 vars in 1062 bytes} [Tue Aug 30 04:20:12 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 449 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 30 04:20:12.868795 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b11c903-d47d-487d-be52-cf995b6b032d None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:12.871311 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-1b11c903-d47d-487d-be52-cf995b6b032d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:13.128690 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b11c903-d47d-487d-be52-cf995b6b032d None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:13.397053 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcbcae2-202f-4e98-80c9-57ac569c70aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:13.398028 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcbcae2-202f-4e98-80c9-57ac569c70aa service neutron] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:13.398468 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcbcae2-202f-4e98-80c9-57ac569c70aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:13.398924 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcbcae2-202f-4e98-80c9-57ac569c70aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:13.402167 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-7bcbcae2-202f-4e98-80c9-57ac569c70aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:13.541684 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:13.636789 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcbcae2-202f-4e98-80c9-57ac569c70aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:13.639975 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcbcae2-202f-4e98-80c9-57ac569c70aa service neutron] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:13.670371 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 653/1311] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:20:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 802 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:20:16.532947 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df500f1d-f25b-447e-9bcd-7463e7010d19 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:16.533555 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df500f1d-f25b-447e-9bcd-7463e7010d19 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:16.534102 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df500f1d-f25b-447e-9bcd-7463e7010d19 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:16.536785 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 659/1312] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:20:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:20:16.542843 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55be53f-6a17-497a-b178-d8fad20f2b22 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:16.543705 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55be53f-6a17-497a-b178-d8fad20f2b22 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:16.543705 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55be53f-6a17-497a-b178-d8fad20f2b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:16.638982 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-b55be53f-6a17-497a-b178-d8fad20f2b22 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:20:16.640634 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-b55be53f-6a17-497a-b178-d8fad20f2b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:16.821536 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 654/1313] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:20:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:20:17.123457 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df500f1d-f25b-447e-9bcd-7463e7010d19 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:17.125127 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-df500f1d-f25b-447e-9bcd-7463e7010d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:17.256549 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df500f1d-f25b-447e-9bcd-7463e7010d19 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:17.340880 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:17.344983 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120794bf-32d0-4aa1-b242-96e9f423cd26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:17.345627 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120794bf-32d0-4aa1-b242-96e9f423cd26 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:17.345913 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120794bf-32d0-4aa1-b242-96e9f423cd26 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:17.346188 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120794bf-32d0-4aa1-b242-96e9f423cd26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:17.348878 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-120794bf-32d0-4aa1-b242-96e9f423cd26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:17.493121 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120794bf-32d0-4aa1-b242-96e9f423cd26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:17.494504 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120794bf-32d0-4aa1-b242-96e9f423cd26 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:17.517079 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 660/1314] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:20:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:20:19.954383 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82773891-311c-4517-8839-ef0a30d34bf3 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:19.955185 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82773891-311c-4517-8839-ef0a30d34bf3 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:19.955185 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82773891-311c-4517-8839-ef0a30d34bf3 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:19.956580 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 655/1315] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:20:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:20:19.964915 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb676f-e2c3-471d-8a52-ee61c1b8519b None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:19.965751 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb676f-e2c3-471d-8a52-ee61c1b8519b None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:19.965751 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb676f-e2c3-471d-8a52-ee61c1b8519b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:20.070104 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-53eb676f-e2c3-471d-8a52-ee61c1b8519b None None] MFA Rules not processed for user `9852d8eb74a94618897a59fe50939721`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:20:20.072313 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-53eb676f-e2c3-471d-8a52-ee61c1b8519b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:20.179456 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:20.274493 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 661/1316] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:20:19 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:20:20.638212 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82773891-311c-4517-8839-ef0a30d34bf3 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:20.640760 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-82773891-311c-4517-8839-ef0a30d34bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:20.654524 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:20.781721 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82773891-311c-4517-8839-ef0a30d34bf3 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:20.883760 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0fda0c-cf81-4cee-93e5-cf5a7946db26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:20.884323 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0fda0c-cf81-4cee-93e5-cf5a7946db26 service neutron] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:20.884598 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0fda0c-cf81-4cee-93e5-cf5a7946db26 service neutron] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:20.884868 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0fda0c-cf81-4cee-93e5-cf5a7946db26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:20.886566 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-7f0fda0c-cf81-4cee-93e5-cf5a7946db26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:20.971289 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:21.045479 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0fda0c-cf81-4cee-93e5-cf5a7946db26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:21.047351 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0fda0c-cf81-4cee-93e5-cf5a7946db26 service neutron] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:21.071838 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 656/1317] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:20:20 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:20:23.983972 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea5e29-5424-4026-9b70-da313526dfd1 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:23.984604 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea5e29-5424-4026-9b70-da313526dfd1 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:23.984839 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea5e29-5424-4026-9b70-da313526dfd1 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:23.987444 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 662/1318] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:20:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:20:23.997246 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99083f66-a837-4758-a220-e4d8937c396a None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:23.997862 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99083f66-a837-4758-a220-e4d8937c396a None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:23.998148 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99083f66-a837-4758-a220-e4d8937c396a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:24.141244 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-99083f66-a837-4758-a220-e4d8937c396a None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:20:24.143164 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-99083f66-a837-4758-a220-e4d8937c396a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:24.283688 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 657/1319] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:20:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:20:24.604700 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea5e29-5424-4026-9b70-da313526dfd1 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:24.606448 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-35ea5e29-5424-4026-9b70-da313526dfd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:24.752596 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea5e29-5424-4026-9b70-da313526dfd1 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:24.854937 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fb3d9f-d4fe-494e-a779-dc5840630728 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:24.855564 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb3d9f-d4fe-494e-a779-dc5840630728 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:24.855889 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb3d9f-d4fe-494e-a779-dc5840630728 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:24.856331 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb3d9f-d4fe-494e-a779-dc5840630728 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:24.858183 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-82fb3d9f-d4fe-494e-a779-dc5840630728 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:24.867333 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:25.002349 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fb3d9f-d4fe-494e-a779-dc5840630728 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:25.003947 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fb3d9f-d4fe-494e-a779-dc5840630728 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:25.026464 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 663/1320] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:20:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:20:28.027783 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01b2b8-fd9b-4912-8a62-e376fa5c1539 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:28.029582 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01b2b8-fd9b-4912-8a62-e376fa5c1539 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:28.029582 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01b2b8-fd9b-4912-8a62-e376fa5c1539 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:28.034991 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 658/1321] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:20:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:20:28.037290 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34cbd24-e915-4af5-876d-1dc638043a65 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:28.037833 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34cbd24-e915-4af5-876d-1dc638043a65 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:28.038144 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34cbd24-e915-4af5-876d-1dc638043a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:28.120545 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-e34cbd24-e915-4af5-876d-1dc638043a65 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:20:28.121842 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-e34cbd24-e915-4af5-876d-1dc638043a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:28.205975 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:28.259624 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 664/1322] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:20:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:20:28.633397 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38883fd3-186d-4bc5-8bbf-e0aab548a068 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:28.633844 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38883fd3-186d-4bc5-8bbf-e0aab548a068 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:28.634335 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38883fd3-186d-4bc5-8bbf-e0aab548a068 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:28.639973 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 659/1323] 10.222.0.91 () {54 vars in 965 bytes} [Tue Aug 30 04:20:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:20:28.647210 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f0c5b-6751-4111-a278-79247cef2ea2 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:28.647651 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f0c5b-6751-4111-a278-79247cef2ea2 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:28.648090 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f0c5b-6751-4111-a278-79247cef2ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:28.759002 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-193f0c5b-6751-4111-a278-79247cef2ea2 None None] MFA Rules not processed for user `1c05f49ae42b4f9583ff10b2cfce52a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:20:28.760627 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-193f0c5b-6751-4111-a278-79247cef2ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:28.919780 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 665/1324] 10.222.0.91 () {58 vars in 1062 bytes} [Tue Aug 30 04:20:28 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:20:28.932852 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38883fd3-186d-4bc5-8bbf-e0aab548a068 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:28.935263 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-38883fd3-186d-4bc5-8bbf-e0aab548a068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:28.967502 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:29.096901 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38883fd3-186d-4bc5-8bbf-e0aab548a068 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:29.225590 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b35eca-7435-4541-83f4-56e54696007e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:29.226187 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b35eca-7435-4541-83f4-56e54696007e service neutron] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:29.226537 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b35eca-7435-4541-83f4-56e54696007e service neutron] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:29.226903 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b35eca-7435-4541-83f4-56e54696007e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:29.228925 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-41b35eca-7435-4541-83f4-56e54696007e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:29.346374 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:29.417239 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b35eca-7435-4541-83f4-56e54696007e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:29.420110 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b35eca-7435-4541-83f4-56e54696007e service neutron] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:29.457410 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 660/1325] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:20:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:20:32.682322 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939cfaea-10f1-4652-af25-8099a2a159f0 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:32.682829 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939cfaea-10f1-4652-af25-8099a2a159f0 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:32.683125 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939cfaea-10f1-4652-af25-8099a2a159f0 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:32.685733 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 666/1326] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:20:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:20:32.691692 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eca301-82cf-4f1a-846b-a48377d58a29 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:32.692277 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eca301-82cf-4f1a-846b-a48377d58a29 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:32.692388 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eca301-82cf-4f1a-846b-a48377d58a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:32.776213 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-a8eca301-82cf-4f1a-846b-a48377d58a29 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:20:32.776586 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-a8eca301-82cf-4f1a-846b-a48377d58a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:32.915996 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 661/1327] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:20:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:20:33.228977 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939cfaea-10f1-4652-af25-8099a2a159f0 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:33.230594 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-939cfaea-10f1-4652-af25-8099a2a159f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:33.311141 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:33.368780 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939cfaea-10f1-4652-af25-8099a2a159f0 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:33.465684 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a7170f-0181-4286-9971-af9e5126abff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:33.467056 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a7170f-0181-4286-9971-af9e5126abff service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:33.467056 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a7170f-0181-4286-9971-af9e5126abff service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:33.467356 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a7170f-0181-4286-9971-af9e5126abff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:33.469235 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-52a7170f-0181-4286-9971-af9e5126abff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:33.622148 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:33.625666 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a7170f-0181-4286-9971-af9e5126abff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:33.627238 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a7170f-0181-4286-9971-af9e5126abff service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:33.651162 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 667/1328] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:20:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:20:36.287812 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580101d-d006-4f99-8304-25b59a1459dc None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:36.288718 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580101d-d006-4f99-8304-25b59a1459dc None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:36.288718 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580101d-d006-4f99-8304-25b59a1459dc None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:36.289823 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 662/1329] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:20:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:20:36.297143 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb1f0b3-1f81-4448-b652-bc05811884bb None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:36.297785 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb1f0b3-1f81-4448-b652-bc05811884bb None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:36.297785 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb1f0b3-1f81-4448-b652-bc05811884bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:36.406500 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-3cb1f0b3-1f81-4448-b652-bc05811884bb None None] MFA Rules not processed for user `9852d8eb74a94618897a59fe50939721`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:20:36.408877 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-3cb1f0b3-1f81-4448-b652-bc05811884bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:36.567366 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 668/1330] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:20:36 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:20:36.915040 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c580101d-d006-4f99-8304-25b59a1459dc None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:36.916992 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-c580101d-d006-4f99-8304-25b59a1459dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:36.960734 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:37.078897 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c580101d-d006-4f99-8304-25b59a1459dc None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:37.206811 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c69c4-8f9c-4ede-8fcf-a52c35d93c41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:37.207446 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c69c4-8f9c-4ede-8fcf-a52c35d93c41 service neutron] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:37.207728 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c69c4-8f9c-4ede-8fcf-a52c35d93c41 service neutron] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:37.208133 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c69c4-8f9c-4ede-8fcf-a52c35d93c41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:37.209900 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-900c69c4-8f9c-4ede-8fcf-a52c35d93c41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:37.325742 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:37.375229 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c69c4-8f9c-4ede-8fcf-a52c35d93c41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:37.376828 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c69c4-8f9c-4ede-8fcf-a52c35d93c41 service neutron] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:37.403359 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 663/1331] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:20:36 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:20:40.163774 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc48fa3-04f9-43b9-9ae2-75a94d3ff346 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:40.164757 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc48fa3-04f9-43b9-9ae2-75a94d3ff346 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:40.164757 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc48fa3-04f9-43b9-9ae2-75a94d3ff346 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:40.165988 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 669/1332] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:20:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:20:40.173449 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc9f27-6158-4c2a-8b13-20b65167b154 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:40.174070 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc9f27-6158-4c2a-8b13-20b65167b154 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:40.174070 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc9f27-6158-4c2a-8b13-20b65167b154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:40.254274 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-6cdc9f27-6158-4c2a-8b13-20b65167b154 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:20:40.255544 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-6cdc9f27-6158-4c2a-8b13-20b65167b154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:40.390290 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 664/1333] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:20:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:20:40.704277 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc48fa3-04f9-43b9-9ae2-75a94d3ff346 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:40.706020 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-ddc48fa3-04f9-43b9-9ae2-75a94d3ff346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:40.801711 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:40.857661 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc48fa3-04f9-43b9-9ae2-75a94d3ff346 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:40.992097 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9cd0c3-dbe8-4fb3-a099-96ca0102931a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:40.992779 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9cd0c3-dbe8-4fb3-a099-96ca0102931a service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:40.993159 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9cd0c3-dbe8-4fb3-a099-96ca0102931a service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:40.993530 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9cd0c3-dbe8-4fb3-a099-96ca0102931a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:40.995353 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-9c9cd0c3-dbe8-4fb3-a099-96ca0102931a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:41.172184 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9cd0c3-dbe8-4fb3-a099-96ca0102931a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:41.173737 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9cd0c3-dbe8-4fb3-a099-96ca0102931a service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:41.187433 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:41.198875 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 670/1334] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:20:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:20:43.424521 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f8a2e-3122-4912-9f87-087aa223d827 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:43.425202 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f8a2e-3122-4912-9f87-087aa223d827 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:43.425202 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f8a2e-3122-4912-9f87-087aa223d827 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:43.426454 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 665/1335] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:20:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:20:43.432571 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0664c-a0f1-4ee8-906a-126b0feb214c None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:43.433203 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0664c-a0f1-4ee8-906a-126b0feb214c None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:43.433203 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0664c-a0f1-4ee8-906a-126b0feb214c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:43.522053 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-0cd0664c-a0f1-4ee8-906a-126b0feb214c None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:20:43.523335 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-0cd0664c-a0f1-4ee8-906a-126b0feb214c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:43.663296 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 671/1336] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:20:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:20:43.961839 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f8a2e-3122-4912-9f87-087aa223d827 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:43.963408 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-110f8a2e-3122-4912-9f87-087aa223d827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:44.009678 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:44.089324 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f8a2e-3122-4912-9f87-087aa223d827 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:44.178599 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ed865-ebef-414a-afe4-e0966ad60f43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:44.179215 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ed865-ebef-414a-afe4-e0966ad60f43 service neutron] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:44.179488 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ed865-ebef-414a-afe4-e0966ad60f43 service neutron] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:44.179752 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ed865-ebef-414a-afe4-e0966ad60f43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:44.181419 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-4c3ed865-ebef-414a-afe4-e0966ad60f43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:44.279791 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:44.311612 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ed865-ebef-414a-afe4-e0966ad60f43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:44.313137 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ed865-ebef-414a-afe4-e0966ad60f43 service neutron] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:44.334080 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 666/1337] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:20:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:20:46.853494 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca70260-9129-4eb4-9bf9-6d3d5840f0ef None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:46.854069 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca70260-9129-4eb4-9bf9-6d3d5840f0ef None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:46.854069 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca70260-9129-4eb4-9bf9-6d3d5840f0ef None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:46.855788 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 672/1338] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:20:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:20:46.862150 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b60ae-f10e-4ef2-a1c3-ba1d9a7eec76 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:46.862797 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b60ae-f10e-4ef2-a1c3-ba1d9a7eec76 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:46.862797 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b60ae-f10e-4ef2-a1c3-ba1d9a7eec76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:46.946886 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-d06b60ae-f10e-4ef2-a1c3-ba1d9a7eec76 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:20:46.948113 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-d06b60ae-f10e-4ef2-a1c3-ba1d9a7eec76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:47.074214 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 667/1339] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:20:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:20:47.376645 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca70260-9129-4eb4-9bf9-6d3d5840f0ef None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:47.378495 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-7ca70260-9129-4eb4-9bf9-6d3d5840f0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:47.481365 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:47.514271 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca70260-9129-4eb4-9bf9-6d3d5840f0ef None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:47.604862 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049dc8eb-b85c-4335-96f1-10ba435e5681 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:47.605651 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049dc8eb-b85c-4335-96f1-10ba435e5681 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:47.606011 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049dc8eb-b85c-4335-96f1-10ba435e5681 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:47.606426 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049dc8eb-b85c-4335-96f1-10ba435e5681 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:47.608235 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-049dc8eb-b85c-4335-96f1-10ba435e5681 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:47.742187 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049dc8eb-b85c-4335-96f1-10ba435e5681 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:47.743674 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049dc8eb-b85c-4335-96f1-10ba435e5681 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:47.765463 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 673/1340] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:20:47 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:20:52.867500 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6f42f-7e3e-4b2f-aa77-61ff6a882e0c None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:52.868452 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6f42f-7e3e-4b2f-aa77-61ff6a882e0c None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:52.868452 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6f42f-7e3e-4b2f-aa77-61ff6a882e0c None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:52.870053 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 668/1341] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:20:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:20:52.877643 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe21e0f-07b4-4115-a1b4-f2d7dbdc8460 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:52.878525 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe21e0f-07b4-4115-a1b4-f2d7dbdc8460 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:52.878525 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe21e0f-07b4-4115-a1b4-f2d7dbdc8460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:52.884904 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:52.976312 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-0fe21e0f-07b4-4115-a1b4-f2d7dbdc8460 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:20:52.977434 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-0fe21e0f-07b4-4115-a1b4-f2d7dbdc8460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:53.163297 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 674/1342] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:20:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:20:53.472457 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a6f42f-7e3e-4b2f-aa77-61ff6a882e0c None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:53.474696 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-40a6f42f-7e3e-4b2f-aa77-61ff6a882e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:53.546993 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:53.630302 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a6f42f-7e3e-4b2f-aa77-61ff6a882e0c None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:53.724083 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670e2bd7-3b04-4ea8-8f44-fc40505da7d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:53.724624 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e2bd7-3b04-4ea8-8f44-fc40505da7d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:53.724896 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e2bd7-3b04-4ea8-8f44-fc40505da7d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:53.725164 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e2bd7-3b04-4ea8-8f44-fc40505da7d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:53.726859 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-670e2bd7-3b04-4ea8-8f44-fc40505da7d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:53.843353 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:53.865713 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670e2bd7-3b04-4ea8-8f44-fc40505da7d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:53.867311 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670e2bd7-3b04-4ea8-8f44-fc40505da7d6 service neutron] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:53.890451 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 669/1343] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:20:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:20:57.502255 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed83906d-e7ae-44f7-a307-d3abf9a479e6 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:57.503073 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed83906d-e7ae-44f7-a307-d3abf9a479e6 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:57.503073 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed83906d-e7ae-44f7-a307-d3abf9a479e6 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:57.504251 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 675/1344] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:20:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:20:57.511448 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16111ce-207d-4443-809c-81a51c217167 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:57.512110 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16111ce-207d-4443-809c-81a51c217167 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:57.512528 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16111ce-207d-4443-809c-81a51c217167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:57.628509 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-f16111ce-207d-4443-809c-81a51c217167 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:20:57.630126 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-f16111ce-207d-4443-809c-81a51c217167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:57.800686 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 670/1345] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:20:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:20:58.107618 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed83906d-e7ae-44f7-a307-d3abf9a479e6 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:58.109275 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-ed83906d-e7ae-44f7-a307-d3abf9a479e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:58.278088 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:58.328488 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed83906d-e7ae-44f7-a307-d3abf9a479e6 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:58.444945 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61ff05c-b3bc-4153-b214-e9843acecdea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:58.445971 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ff05c-b3bc-4153-b214-e9843acecdea service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:58.446483 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ff05c-b3bc-4153-b214-e9843acecdea service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:58.446917 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ff05c-b3bc-4153-b214-e9843acecdea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:58.450193 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-e61ff05c-b3bc-4153-b214-e9843acecdea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:58.645649 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61ff05c-b3bc-4153-b214-e9843acecdea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:58.648064 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61ff05c-b3bc-4153-b214-e9843acecdea service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:58.684651 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 676/1346] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:20:58 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:21:04.258495 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca56def9-a445-4212-853d-8ad53b7cff9f None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:04.259103 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca56def9-a445-4212-853d-8ad53b7cff9f None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:04.259665 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca56def9-a445-4212-853d-8ad53b7cff9f None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:04.262613 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 671/1347] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:21:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:21:04.271803 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5a396-939f-420c-af4b-384f34f1c8d9 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:04.272573 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5a396-939f-420c-af4b-384f34f1c8d9 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:04.272885 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5a396-939f-420c-af4b-384f34f1c8d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:04.303116 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:04.397720 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-68c5a396-939f-420c-af4b-384f34f1c8d9 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:21:04.399873 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-68c5a396-939f-420c-af4b-384f34f1c8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:04.589786 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 677/1348] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:21:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:21:04.948857 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca56def9-a445-4212-853d-8ad53b7cff9f None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:04.951466 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-ca56def9-a445-4212-853d-8ad53b7cff9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:05.074156 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:05.157440 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca56def9-a445-4212-853d-8ad53b7cff9f None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:05.304834 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f4ba1b-d8c2-4458-bab0-09c8bf09c1e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:05.305791 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f4ba1b-d8c2-4458-bab0-09c8bf09c1e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:05.306254 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f4ba1b-d8c2-4458-bab0-09c8bf09c1e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:05.306714 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f4ba1b-d8c2-4458-bab0-09c8bf09c1e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:05.309880 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-d8f4ba1b-d8c2-4458-bab0-09c8bf09c1e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:05.475622 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:05.483057 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f4ba1b-d8c2-4458-bab0-09c8bf09c1e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:05.485548 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f4ba1b-d8c2-4458-bab0-09c8bf09c1e5 service neutron] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:05.515211 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 672/1349] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:21:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:21:11.130619 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973456a-d10d-4984-bfb0-a5dec5de42d2 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:11.131265 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973456a-d10d-4984-bfb0-a5dec5de42d2 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:11.131497 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973456a-d10d-4984-bfb0-a5dec5de42d2 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:11.134398 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 678/1350] 10.222.0.91 () {54 vars in 921 bytes} [Tue Aug 30 04:21:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:21:11.141293 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049e2cc-ba0c-4fd2-98d6-b81489242674 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:11.141903 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049e2cc-ba0c-4fd2-98d6-b81489242674 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:11.141903 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049e2cc-ba0c-4fd2-98d6-b81489242674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:11.270076 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-2049e2cc-ba0c-4fd2-98d6-b81489242674 None None] MFA Rules not processed for user `47a092fbe1334f7e9ae4ba9bdb5e9f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:21:11.271830 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-2049e2cc-ba0c-4fd2-98d6-b81489242674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:11.441742 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 673/1351] 10.222.0.91 () {58 vars in 1018 bytes} [Tue Aug 30 04:21:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:21:14.592413 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=59 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:17.690868 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77079507-29b0-4f01-8f31-9024798a866a None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:17.692019 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77079507-29b0-4f01-8f31-9024798a866a None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:17.692380 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77079507-29b0-4f01-8f31-9024798a866a None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:17.694148 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 679/1352] 10.222.0.91 () {54 vars in 921 bytes} [Tue Aug 30 04:21:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:21:17.700947 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603c08f-f184-4862-99b1-19cf418f6fc8 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:17.701525 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603c08f-f184-4862-99b1-19cf418f6fc8 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:17.701608 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603c08f-f184-4862-99b1-19cf418f6fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:17.776789 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:17.808661 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-7603c08f-f184-4862-99b1-19cf418f6fc8 None None] MFA Rules not processed for user `47a092fbe1334f7e9ae4ba9bdb5e9f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:21:17.809942 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-7603c08f-f184-4862-99b1-19cf418f6fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:17.944711 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 674/1353] 10.222.0.91 () {58 vars in 1018 bytes} [Tue Aug 30 04:21:17 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:21:21.122999 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7dead1-76fc-4155-8c29-7e893ad089b7 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:21.123578 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7dead1-76fc-4155-8c29-7e893ad089b7 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:21.124216 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7dead1-76fc-4155-8c29-7e893ad089b7 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:21.126701 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 680/1354] 10.222.0.91 () {54 vars in 921 bytes} [Tue Aug 30 04:21:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:21:21.134093 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1c2eb-b014-42fb-a8ae-7804be8863c2 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:21.135027 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1c2eb-b014-42fb-a8ae-7804be8863c2 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:21.135216 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1c2eb-b014-42fb-a8ae-7804be8863c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:21.298304 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-0da1c2eb-b014-42fb-a8ae-7804be8863c2 None None] MFA Rules not processed for user `47a092fbe1334f7e9ae4ba9bdb5e9f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:21:21.299739 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-0da1c2eb-b014-42fb-a8ae-7804be8863c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:21.366823 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:21.458083 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 675/1355] 10.222.0.91 () {58 vars in 1018 bytes} [Tue Aug 30 04:21:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:21:25.446568 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af1f33-e7b6-4355-932f-7663d18b5c7e None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:25.447486 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af1f33-e7b6-4355-932f-7663d18b5c7e None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:25.447486 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af1f33-e7b6-4355-932f-7663d18b5c7e None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:25.449637 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 681/1356] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:21:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:21:25.456200 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d97da-142b-46fa-a958-6acccce7ebe0 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:25.457106 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d97da-142b-46fa-a958-6acccce7ebe0 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:25.457252 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d97da-142b-46fa-a958-6acccce7ebe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:25.586966 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-775d97da-142b-46fa-a958-6acccce7ebe0 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:21:25.589296 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-775d97da-142b-46fa-a958-6acccce7ebe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:25.830495 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 676/1357] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:21:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:21:26.387409 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9c3f8-4b8a-4ab7-891b-51129069aa3a None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:26.387954 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9c3f8-4b8a-4ab7-891b-51129069aa3a None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:26.389708 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9c3f8-4b8a-4ab7-891b-51129069aa3a None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:26.394787 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 682/1358] 10.222.0.91 () {54 vars in 962 bytes} [Tue Aug 30 04:21:26 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:21:26.415097 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574fee4e-30b1-41e2-869b-062e04e7d542 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:26.416015 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574fee4e-30b1-41e2-869b-062e04e7d542 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:26.427531 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574fee4e-30b1-41e2-869b-062e04e7d542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:26.482261 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:26.613166 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-574fee4e-30b1-41e2-869b-062e04e7d542 None None] MFA Rules not processed for user `d806295278ae4997b5c6968aa553290c`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:21:26.615218 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-574fee4e-30b1-41e2-869b-062e04e7d542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:26.885980 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 677/1359] 10.222.0.91 () {58 vars in 1059 bytes} [Tue Aug 30 04:21:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 472 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:21:26.900150 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea9c3f8-4b8a-4ab7-891b-51129069aa3a None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:26.902968 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-2ea9c3f8-4b8a-4ab7-891b-51129069aa3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:27.192688 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea9c3f8-4b8a-4ab7-891b-51129069aa3a None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:27.283700 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:27.347292 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af47057-5d7a-4531-a693-55e2e7eb5d7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd806295278ae4997b5c6968aa553290c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:27.348120 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af47057-5d7a-4531-a693-55e2e7eb5d7b service nova] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:27.348403 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af47057-5d7a-4531-a693-55e2e7eb5d7b service nova] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:27.349036 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af47057-5d7a-4531-a693-55e2e7eb5d7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:27.350967 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-5af47057-5d7a-4531-a693-55e2e7eb5d7b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:27.514162 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af47057-5d7a-4531-a693-55e2e7eb5d7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:27.517224 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af47057-5d7a-4531-a693-55e2e7eb5d7b service nova] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:27.556687 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 683/1360] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:21:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 657 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:21:30.212066 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aceefd6-16f8-4f22-b7eb-6e176fa640a3 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:30.213048 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aceefd6-16f8-4f22-b7eb-6e176fa640a3 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:30.213048 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aceefd6-16f8-4f22-b7eb-6e176fa640a3 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:30.214930 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 678/1361] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:21:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:21:30.221828 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89822b72-1e03-43ef-84c8-dc619dfc86a9 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:30.222687 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89822b72-1e03-43ef-84c8-dc619dfc86a9 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:30.222687 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89822b72-1e03-43ef-84c8-dc619dfc86a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:30.318766 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-89822b72-1e03-43ef-84c8-dc619dfc86a9 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:21:30.320397 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-89822b72-1e03-43ef-84c8-dc619dfc86a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:30.374101 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:30.478945 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 684/1362] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:21:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:21:30.843224 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aceefd6-16f8-4f22-b7eb-6e176fa640a3 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:30.844806 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-5aceefd6-16f8-4f22-b7eb-6e176fa640a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:30.948387 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:31.070183 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aceefd6-16f8-4f22-b7eb-6e176fa640a3 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:31.234272 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c8e1a7-4735-46ba-abec-60e8fd8e95a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd806295278ae4997b5c6968aa553290c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:31.234909 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8e1a7-4735-46ba-abec-60e8fd8e95a9 service nova] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:31.235362 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8e1a7-4735-46ba-abec-60e8fd8e95a9 service nova] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:31.235639 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8e1a7-4735-46ba-abec-60e8fd8e95a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:31.237392 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-14c8e1a7-4735-46ba-abec-60e8fd8e95a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:31.265990 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:31.349055 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c8e1a7-4735-46ba-abec-60e8fd8e95a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:31.355765 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c8e1a7-4735-46ba-abec-60e8fd8e95a9 service nova] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:31.373443 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 679/1363] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:21:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:21:34.049905 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd0128-dd44-4e5a-a93f-8c3d5500a440 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:34.050704 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd0128-dd44-4e5a-a93f-8c3d5500a440 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:34.050704 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd0128-dd44-4e5a-a93f-8c3d5500a440 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:34.052161 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 685/1364] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:21:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:21:34.058161 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084beb6-5ac9-4ad5-b446-4d190388b04e None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:34.058964 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084beb6-5ac9-4ad5-b446-4d190388b04e None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:34.058964 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084beb6-5ac9-4ad5-b446-4d190388b04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:34.152913 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-9084beb6-5ac9-4ad5-b446-4d190388b04e None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:21:34.155105 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-9084beb6-5ac9-4ad5-b446-4d190388b04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:34.288780 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:34.296022 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 680/1365] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:21:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:21:34.633014 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dbf21d-8c9a-4b90-8a47-76c260bdddad None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:34.633515 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dbf21d-8c9a-4b90-8a47-76c260bdddad None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:34.634068 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dbf21d-8c9a-4b90-8a47-76c260bdddad None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:34.636873 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 686/1366] 10.222.0.91 () {54 vars in 962 bytes} [Tue Aug 30 04:21:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:21:34.643261 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd6e4f6-eaee-4aa0-8555-a8cfcbd6bd99 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:34.643544 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd6e4f6-eaee-4aa0-8555-a8cfcbd6bd99 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:34.643866 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd6e4f6-eaee-4aa0-8555-a8cfcbd6bd99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:34.736660 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-3bd6e4f6-eaee-4aa0-8555-a8cfcbd6bd99 None None] MFA Rules not processed for user `d806295278ae4997b5c6968aa553290c`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:21:34.737897 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-3bd6e4f6-eaee-4aa0-8555-a8cfcbd6bd99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:34.880715 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 681/1367] 10.222.0.91 () {58 vars in 1059 bytes} [Tue Aug 30 04:21:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:21:34.889225 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dbf21d-8c9a-4b90-8a47-76c260bdddad None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:34.890875 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-75dbf21d-8c9a-4b90-8a47-76c260bdddad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:35.069460 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dbf21d-8c9a-4b90-8a47-76c260bdddad None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:35.095714 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:35.216107 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85674f40-f52c-4b9d-abf7-3174c4229ec8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd806295278ae4997b5c6968aa553290c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:35.216929 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85674f40-f52c-4b9d-abf7-3174c4229ec8 service nova] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:35.217368 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85674f40-f52c-4b9d-abf7-3174c4229ec8 service nova] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:35.217827 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85674f40-f52c-4b9d-abf7-3174c4229ec8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:35.220002 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-85674f40-f52c-4b9d-abf7-3174c4229ec8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:35.330906 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85674f40-f52c-4b9d-abf7-3174c4229ec8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:35.332617 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85674f40-f52c-4b9d-abf7-3174c4229ec8 service nova] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:35.355054 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 687/1368] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:21:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:21:35.481055 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1bc063-7a83-470b-ad3e-c9965c883d7e None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:35.481878 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1bc063-7a83-470b-ad3e-c9965c883d7e None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:35.481878 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1bc063-7a83-470b-ad3e-c9965c883d7e None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:35.483470 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 682/1369] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:21:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:21:35.489490 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b7e96-3683-499d-9154-112124e2ba34 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:35.489838 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b7e96-3683-499d-9154-112124e2ba34 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:35.490055 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b7e96-3683-499d-9154-112124e2ba34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:35.537506 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:35.620113 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-6a2b7e96-3683-499d-9154-112124e2ba34 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:21:35.620529 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-6a2b7e96-3683-499d-9154-112124e2ba34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:35.768951 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 688/1370] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:21:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:21:36.504834 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2977d49-8002-4949-85be-df1cba51aaa1 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:36.505705 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2977d49-8002-4949-85be-df1cba51aaa1 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:36.505705 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2977d49-8002-4949-85be-df1cba51aaa1 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:36.508659 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 683/1371] 10.222.0.91 () {54 vars in 964 bytes} [Tue Aug 30 04:21:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:21:36.517299 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8144d093-6fd7-4e46-babc-bb79c9f29c21 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:36.518030 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8144d093-6fd7-4e46-babc-bb79c9f29c21 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:36.518030 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8144d093-6fd7-4e46-babc-bb79c9f29c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:36.628169 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-8144d093-6fd7-4e46-babc-bb79c9f29c21 None None] MFA Rules not processed for user `812abdd745f149e6a0166cd9040f28e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:21:36.630067 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-8144d093-6fd7-4e46-babc-bb79c9f29c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:36.704939 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:36.758162 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 689/1372] 10.222.0.91 () {58 vars in 1061 bytes} [Tue Aug 30 04:21:36 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:21:36.777563 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2977d49-8002-4949-85be-df1cba51aaa1 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:36.780754 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-f2977d49-8002-4949-85be-df1cba51aaa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:36.848778 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:36.912271 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2977d49-8002-4949-85be-df1cba51aaa1 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:37.021979 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64042e7c-cedf-4915-ad0b-f2e72d2626d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:37.023341 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64042e7c-cedf-4915-ad0b-f2e72d2626d3 service cinder] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:37.024146 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64042e7c-cedf-4915-ad0b-f2e72d2626d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:37.024660 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64042e7c-cedf-4915-ad0b-f2e72d2626d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:37.027891 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-64042e7c-cedf-4915-ad0b-f2e72d2626d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:37.194486 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:37.223582 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64042e7c-cedf-4915-ad0b-f2e72d2626d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:37.226373 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64042e7c-cedf-4915-ad0b-f2e72d2626d3 service cinder] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:37.262894 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 684/1373] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:21:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:21:38.001948 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d1ffa-371d-4378-9c2b-85a150075371 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:38.002803 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d1ffa-371d-4378-9c2b-85a150075371 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:38.002803 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d1ffa-371d-4378-9c2b-85a150075371 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:38.004819 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 690/1374] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:21:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:21:38.012679 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80aa90-7df3-4042-9c06-6bfedbd011b6 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:38.013522 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80aa90-7df3-4042-9c06-6bfedbd011b6 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:38.013904 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80aa90-7df3-4042-9c06-6bfedbd011b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:38.139895 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-5e80aa90-7df3-4042-9c06-6bfedbd011b6 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:21:38.142088 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-5e80aa90-7df3-4042-9c06-6bfedbd011b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:38.328313 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 685/1375] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:21:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:21:38.735985 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d1ffa-371d-4378-9c2b-85a150075371 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:38.737945 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-8b4d1ffa-371d-4378-9c2b-85a150075371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:38.921596 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d1ffa-371d-4378-9c2b-85a150075371 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:38.987173 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:39.098582 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e3c0df-127e-4438-aa43-a2c6f52073fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd806295278ae4997b5c6968aa553290c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:39.099669 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3c0df-127e-4438-aa43-a2c6f52073fd service nova] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:39.100255 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3c0df-127e-4438-aa43-a2c6f52073fd service nova] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:39.100717 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3c0df-127e-4438-aa43-a2c6f52073fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:39.105221 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-25e3c0df-127e-4438-aa43-a2c6f52073fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:39.300925 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e3c0df-127e-4438-aa43-a2c6f52073fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:39.303891 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e3c0df-127e-4438-aa43-a2c6f52073fd service nova] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:39.340598 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 691/1376] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:21:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 605 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:21:41.578710 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f508903-0945-4226-a018-dff32cc4b1e6 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:41.579418 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f508903-0945-4226-a018-dff32cc4b1e6 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:41.579647 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f508903-0945-4226-a018-dff32cc4b1e6 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:41.582504 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 686/1377] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:21:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:21:41.588859 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927df761-e4c1-4e97-9d56-236f01989044 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:41.589646 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927df761-e4c1-4e97-9d56-236f01989044 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:41.589646 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927df761-e4c1-4e97-9d56-236f01989044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:41.696638 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-927df761-e4c1-4e97-9d56-236f01989044 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:21:41.700073 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-927df761-e4c1-4e97-9d56-236f01989044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:41.718658 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:41.892530 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 692/1378] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:21:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:21:42.227116 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f508903-0945-4226-a018-dff32cc4b1e6 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:42.229735 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-4f508903-0945-4226-a018-dff32cc4b1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:42.338575 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:42.518362 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f508903-0945-4226-a018-dff32cc4b1e6 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:42.737973 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0690ce-0fdc-41b2-96f8-83ccbd074511 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd806295278ae4997b5c6968aa553290c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:42.739276 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0690ce-0fdc-41b2-96f8-83ccbd074511 service nova] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:42.739853 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0690ce-0fdc-41b2-96f8-83ccbd074511 service nova] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:42.740458 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0690ce-0fdc-41b2-96f8-83ccbd074511 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:42.744312 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-0a0690ce-0fdc-41b2-96f8-83ccbd074511 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:42.783372 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:42.916391 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0690ce-0fdc-41b2-96f8-83ccbd074511 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:42.920551 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0690ce-0fdc-41b2-96f8-83ccbd074511 service nova] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:42.967564 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 687/1379] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:21:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 741 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:21:45.637409 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d166c4c9-a56f-4ab9-8ff4-dfc1e6e657cc None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:45.638721 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d166c4c9-a56f-4ab9-8ff4-dfc1e6e657cc None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:45.639375 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d166c4c9-a56f-4ab9-8ff4-dfc1e6e657cc None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:45.641622 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 693/1380] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:21:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:21:45.649189 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e58be45-1ce3-44b1-80b3-4f0028805035 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:45.649973 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e58be45-1ce3-44b1-80b3-4f0028805035 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:45.650146 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e58be45-1ce3-44b1-80b3-4f0028805035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:45.813549 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-5e58be45-1ce3-44b1-80b3-4f0028805035 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:21:45.815770 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-5e58be45-1ce3-44b1-80b3-4f0028805035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:45.968977 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:45.980149 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 688/1381] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:21:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:21:46.317877 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d166c4c9-a56f-4ab9-8ff4-dfc1e6e657cc None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:46.322092 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-d166c4c9-a56f-4ab9-8ff4-dfc1e6e657cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:46.582161 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:46.599896 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d166c4c9-a56f-4ab9-8ff4-dfc1e6e657cc None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:46.807707 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6f37db-4ca8-463b-8963-c9c5696985c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd806295278ae4997b5c6968aa553290c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:46.807707 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f37db-4ca8-463b-8963-c9c5696985c9 service nova] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:46.807707 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f37db-4ca8-463b-8963-c9c5696985c9 service nova] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:46.807707 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f37db-4ca8-463b-8963-c9c5696985c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:46.816866 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-8a6f37db-4ca8-463b-8963-c9c5696985c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:46.931957 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6f37db-4ca8-463b-8963-c9c5696985c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:46.934717 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6f37db-4ca8-463b-8963-c9c5696985c9 service nova] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:46.952501 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:46.976581 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 694/1382] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:21:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 661 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:21:49.150113 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4faf0-17d2-4253-98f7-92d64b70caa0 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:49.151139 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4faf0-17d2-4253-98f7-92d64b70caa0 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:49.151443 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4faf0-17d2-4253-98f7-92d64b70caa0 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:49.153155 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 689/1383] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:21:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:21:49.160654 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b95539-f19d-43eb-8355-c0c47fc05675 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:49.161264 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b95539-f19d-43eb-8355-c0c47fc05675 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:49.161264 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b95539-f19d-43eb-8355-c0c47fc05675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:49.311350 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-42b95539-f19d-43eb-8355-c0c47fc05675 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:21:49.313384 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-42b95539-f19d-43eb-8355-c0c47fc05675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:49.471329 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 695/1384] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:21:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:21:49.884456 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f4faf0-17d2-4253-98f7-92d64b70caa0 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:49.886301 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-19f4faf0-17d2-4253-98f7-92d64b70caa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:50.100737 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f4faf0-17d2-4253-98f7-92d64b70caa0 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:50.214784 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:50.304604 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda640f-f4a0-42ec-acb9-118e55506841 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd806295278ae4997b5c6968aa553290c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:50.304961 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda640f-f4a0-42ec-acb9-118e55506841 service nova] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:50.305433 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda640f-f4a0-42ec-acb9-118e55506841 service nova] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:50.305889 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda640f-f4a0-42ec-acb9-118e55506841 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:50.309118 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-beda640f-f4a0-42ec-acb9-118e55506841 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:50.473564 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beda640f-f4a0-42ec-acb9-118e55506841 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:50.475767 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beda640f-f4a0-42ec-acb9-118e55506841 service nova] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:50.506434 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 690/1385] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:21:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 623 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:21:52.955967 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672c557-14c7-42ef-9a83-26e81e354d51 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:52.956576 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672c557-14c7-42ef-9a83-26e81e354d51 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:52.956847 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672c557-14c7-42ef-9a83-26e81e354d51 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:52.959438 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 696/1386] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:21:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:21:52.967902 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3870e6-81e7-49fa-9531-afc3403d8df8 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:52.968805 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3870e6-81e7-49fa-9531-afc3403d8df8 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:52.968970 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3870e6-81e7-49fa-9531-afc3403d8df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:53.061146 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-8c3870e6-81e7-49fa-9531-afc3403d8df8 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:21:53.063828 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-8c3870e6-81e7-49fa-9531-afc3403d8df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:53.125562 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:53.248374 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 691/1387] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:21:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:21:53.548858 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b672c557-14c7-42ef-9a83-26e81e354d51 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:53.551448 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-b672c557-14c7-42ef-9a83-26e81e354d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:53.668631 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:53.769224 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b672c557-14c7-42ef-9a83-26e81e354d51 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:53.952211 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f87d1b-030f-4ff7-a3c3-5b82bb7166b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd806295278ae4997b5c6968aa553290c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:53.953353 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f87d1b-030f-4ff7-a3c3-5b82bb7166b9 service nova] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:53.953829 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f87d1b-030f-4ff7-a3c3-5b82bb7166b9 service nova] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:53.954298 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f87d1b-030f-4ff7-a3c3-5b82bb7166b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:53.957501 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-15f87d1b-030f-4ff7-a3c3-5b82bb7166b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:54.023375 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:54.090916 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f87d1b-030f-4ff7-a3c3-5b82bb7166b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:54.092636 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f87d1b-030f-4ff7-a3c3-5b82bb7166b9 service nova] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:54.117365 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 697/1388] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:21:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:21:54.460417 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9748a6-7337-4234-a045-743631ccc480 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:54.461413 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9748a6-7337-4234-a045-743631ccc480 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:54.461413 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9748a6-7337-4234-a045-743631ccc480 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:54.463435 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 692/1389] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:21:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:21:54.470315 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84878e09-a6ac-4d39-b715-e982c60d7460 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:54.470607 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84878e09-a6ac-4d39-b715-e982c60d7460 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:54.470802 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84878e09-a6ac-4d39-b715-e982c60d7460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:54.559008 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-84878e09-a6ac-4d39-b715-e982c60d7460 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:21:54.560502 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-84878e09-a6ac-4d39-b715-e982c60d7460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:54.715391 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 698/1390] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:21:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:21:55.070174 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090bffc-d259-4d4c-a98f-f40bd0f11792 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:55.070557 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090bffc-d259-4d4c-a98f-f40bd0f11792 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:55.070976 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090bffc-d259-4d4c-a98f-f40bd0f11792 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:55.073402 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 693/1391] 10.222.0.91 () {54 vars in 967 bytes} [Tue Aug 30 04:21:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:21:55.082467 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82af39-f07f-4e71-988c-b86bbbb20365 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:55.083089 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82af39-f07f-4e71-988c-b86bbbb20365 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:55.083439 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82af39-f07f-4e71-988c-b86bbbb20365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:55.111029 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:55.208266 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-0f82af39-f07f-4e71-988c-b86bbbb20365 None None] MFA Rules not processed for user `2af2e1344bc54bf388e5ec025ab94c2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:21:55.209562 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-0f82af39-f07f-4e71-988c-b86bbbb20365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:55.338691 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 699/1392] 10.222.0.91 () {58 vars in 1064 bytes} [Tue Aug 30 04:21:55 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:21:55.348138 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b090bffc-d259-4d4c-a98f-f40bd0f11792 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:55.351178 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-b090bffc-d259-4d4c-a98f-f40bd0f11792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:55.520649 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b090bffc-d259-4d4c-a98f-f40bd0f11792 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:55.598790 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:55.626199 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e562130f-24ee-405e-be62-bb3f7dd7144d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2e1344bc54bf388e5ec025ab94c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:55.627050 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e562130f-24ee-405e-be62-bb3f7dd7144d service glance] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:55.627448 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e562130f-24ee-405e-be62-bb3f7dd7144d service glance] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:55.627820 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e562130f-24ee-405e-be62-bb3f7dd7144d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:55.629947 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-e562130f-24ee-405e-be62-bb3f7dd7144d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:55.821866 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e562130f-24ee-405e-be62-bb3f7dd7144d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:55.823661 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e562130f-24ee-405e-be62-bb3f7dd7144d service glance] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:55.848735 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 694/1393] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:21:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:21:56.362229 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479d369-5c87-4e26-87d9-b44f9db8e097 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:56.363123 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479d369-5c87-4e26-87d9-b44f9db8e097 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:56.363123 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479d369-5c87-4e26-87d9-b44f9db8e097 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:56.364258 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 700/1394] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:21:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:21:56.370688 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47566bc3-f2f7-4cfa-a1a6-c940735c145e None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:56.371022 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47566bc3-f2f7-4cfa-a1a6-c940735c145e None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:56.371233 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47566bc3-f2f7-4cfa-a1a6-c940735c145e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:56.472741 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-47566bc3-f2f7-4cfa-a1a6-c940735c145e None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:21:56.474037 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-47566bc3-f2f7-4cfa-a1a6-c940735c145e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:56.531380 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:56.600365 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 695/1395] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:21:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:21:56.847085 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9082f386-d011-48ed-bb10-2c76826f366d None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:56.847544 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9082f386-d011-48ed-bb10-2c76826f366d None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:56.848091 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9082f386-d011-48ed-bb10-2c76826f366d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:56.897713 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47566bc3-f2f7-4cfa-a1a6-c940735c145e None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:56.899802 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-47566bc3-f2f7-4cfa-a1a6-c940735c145e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:56.948248 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-9082f386-d011-48ed-bb10-2c76826f366d None None] MFA Rules not processed for user `1bc12faf48984335a3515dcde85b5cb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:21:56.950217 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-9082f386-d011-48ed-bb10-2c76826f366d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:57.022409 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:57.039540 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47566bc3-f2f7-4cfa-a1a6-c940735c145e None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:57.067132 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 701/1396] 10.222.0.91 () {58 vars in 1009 bytes} [Tue Aug 30 04:21:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:21:57.121573 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:57.134895 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac798e1-b9c6-4055-9164-b29fabf7dfba None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:57.135201 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac798e1-b9c6-4055-9164-b29fabf7dfba None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:57.135584 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac798e1-b9c6-4055-9164-b29fabf7dfba None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:57.137186 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 702/1397] 10.222.0.91 () {54 vars in 943 bytes} [Tue Aug 30 04:21:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:21:57.147096 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d424c89-a1d7-4afd-b9aa-c45d89414096 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:57.147581 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d424c89-a1d7-4afd-b9aa-c45d89414096 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:57.148029 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d424c89-a1d7-4afd-b9aa-c45d89414096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:57.210714 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed6735a-1b56-4889-961d-e826b896ed4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd806295278ae4997b5c6968aa553290c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:57.212196 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6735a-1b56-4889-961d-e826b896ed4b service nova] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:57.212578 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6735a-1b56-4889-961d-e826b896ed4b service nova] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:57.213064 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6735a-1b56-4889-961d-e826b896ed4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:57.216345 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-2ed6735a-1b56-4889-961d-e826b896ed4b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:57.241656 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-9d424c89-a1d7-4afd-b9aa-c45d89414096 None None] MFA Rules not processed for user `94b50f9552124b07822ae63c1d553864`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:21:57.243113 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-9d424c89-a1d7-4afd-b9aa-c45d89414096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:57.363590 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed6735a-1b56-4889-961d-e826b896ed4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:57.365522 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed6735a-1b56-4889-961d-e826b896ed4b service nova] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:57.389793 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 696/1398] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:21:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:21:57.416182 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 703/1399] 10.222.0.91 () {58 vars in 1040 bytes} [Tue Aug 30 04:21:57 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:21:57.423450 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed6735a-1b56-4889-961d-e826b896ed4b service nova] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:57.424741 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-2ed6735a-1b56-4889-961d-e826b896ed4b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:57.507644 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:57.540704 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed6735a-1b56-4889-961d-e826b896ed4b service nova] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:57.745441 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1788d4d-9979-49a7-86da-8c7a25d77a0a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b50f9552124b07822ae63c1d553864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:57.746451 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1788d4d-9979-49a7-86da-8c7a25d77a0a service swift] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:57.746933 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1788d4d-9979-49a7-86da-8c7a25d77a0a service swift] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:57.747381 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1788d4d-9979-49a7-86da-8c7a25d77a0a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:57.750727 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-b1788d4d-9979-49a7-86da-8c7a25d77a0a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:57.909407 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1788d4d-9979-49a7-86da-8c7a25d77a0a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:57.912345 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1788d4d-9979-49a7-86da-8c7a25d77a0a service swift] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:57.929385 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 697/1400] 10.222.0.91 () {60 vars in 1384 bytes} [Tue Aug 30 04:21:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:21:59.636291 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56bcb18-fed4-4d15-9e53-051a4bb39cba None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:59.636892 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56bcb18-fed4-4d15-9e53-051a4bb39cba None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:59.637135 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56bcb18-fed4-4d15-9e53-051a4bb39cba None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:59.641432 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 704/1401] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:21:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:21:59.649389 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a25a3-9b25-4b6a-98be-ca35a88685c2 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:59.649989 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a25a3-9b25-4b6a-98be-ca35a88685c2 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:59.650861 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a25a3-9b25-4b6a-98be-ca35a88685c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:59.673988 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:59.771358 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-976a25a3-9b25-4b6a-98be-ca35a88685c2 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:21:59.773512 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-976a25a3-9b25-4b6a-98be-ca35a88685c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:59.956098 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 698/1402] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:21:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:22:00.301643 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56bcb18-fed4-4d15-9e53-051a4bb39cba None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:00.303321 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-a56bcb18-fed4-4d15-9e53-051a4bb39cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:00.373977 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:00.606518 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56bcb18-fed4-4d15-9e53-051a4bb39cba None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:00.834856 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:00.859309 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48feb130-8b8d-40c7-a37b-48767d0d67a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd806295278ae4997b5c6968aa553290c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:00.860165 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48feb130-8b8d-40c7-a37b-48767d0d67a3 service nova] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:00.860957 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48feb130-8b8d-40c7-a37b-48767d0d67a3 service nova] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:00.861428 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48feb130-8b8d-40c7-a37b-48767d0d67a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:00.863604 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-48feb130-8b8d-40c7-a37b-48767d0d67a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:01.088656 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48feb130-8b8d-40c7-a37b-48767d0d67a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:01.091859 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48feb130-8b8d-40c7-a37b-48767d0d67a3 service nova] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:01.127370 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 705/1403] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:22:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 826 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:22:03.361911 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14c888-e143-4419-9382-ac612340f7ac None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:03.363950 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14c888-e143-4419-9382-ac612340f7ac None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:03.364459 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14c888-e143-4419-9382-ac612340f7ac None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:03.367987 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 699/1404] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:22:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:22:03.373750 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9264aaad-3e12-4bf5-8389-0520ced526dd None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:03.374639 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9264aaad-3e12-4bf5-8389-0520ced526dd None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:03.374639 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9264aaad-3e12-4bf5-8389-0520ced526dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:03.475009 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-9264aaad-3e12-4bf5-8389-0520ced526dd None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:22:03.476582 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-9264aaad-3e12-4bf5-8389-0520ced526dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:03.597901 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:03.660129 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 706/1405] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:22:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:22:03.974983 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da14c888-e143-4419-9382-ac612340f7ac None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:03.978103 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-da14c888-e143-4419-9382-ac612340f7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:04.149698 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:04.276097 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da14c888-e143-4419-9382-ac612340f7ac None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:04.485943 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd78ebb-d7f9-4f3e-b75c-3aa905883ac9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd806295278ae4997b5c6968aa553290c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:04.487728 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd78ebb-d7f9-4f3e-b75c-3aa905883ac9 service nova] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:04.488095 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd78ebb-d7f9-4f3e-b75c-3aa905883ac9 service nova] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:04.488536 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd78ebb-d7f9-4f3e-b75c-3aa905883ac9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:04.490494 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-dfd78ebb-d7f9-4f3e-b75c-3aa905883ac9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:04.577588 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:04.636859 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd78ebb-d7f9-4f3e-b75c-3aa905883ac9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:04.638883 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd78ebb-d7f9-4f3e-b75c-3aa905883ac9 service nova] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:04.673840 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 700/1406] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:22:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 699 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:22:07.042873 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d2655a-c741-456b-b2be-971beda391c6 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:07.043829 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d2655a-c741-456b-b2be-971beda391c6 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:07.043829 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d2655a-c741-456b-b2be-971beda391c6 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:07.045178 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 707/1407] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:22:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:22:07.052975 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a353ce-1b1c-49da-a136-316773b406ba None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:07.055728 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a353ce-1b1c-49da-a136-316773b406ba None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:07.056386 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a353ce-1b1c-49da-a136-316773b406ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:07.198551 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-f0a353ce-1b1c-49da-a136-316773b406ba None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:22:07.199876 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-f0a353ce-1b1c-49da-a136-316773b406ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:07.372369 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 701/1408] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:22:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:22:07.895746 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d2655a-c741-456b-b2be-971beda391c6 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:07.899602 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-c3d2655a-c741-456b-b2be-971beda391c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:08.154909 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d2655a-c741-456b-b2be-971beda391c6 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:08.226443 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:08.326876 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb1eb6-dfc5-406d-907d-c0334df3f6f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd806295278ae4997b5c6968aa553290c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:08.327575 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb1eb6-dfc5-406d-907d-c0334df3f6f1 service nova] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:08.327840 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb1eb6-dfc5-406d-907d-c0334df3f6f1 service nova] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:08.328156 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb1eb6-dfc5-406d-907d-c0334df3f6f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:08.329985 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-77cb1eb6-dfc5-406d-907d-c0334df3f6f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:08.496132 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cb1eb6-dfc5-406d-907d-c0334df3f6f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:08.499826 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cb1eb6-dfc5-406d-907d-c0334df3f6f1 service nova] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:08.541175 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 708/1409] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:22:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 647 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:22:17.369213 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=87 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:18.536040 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=76 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:22.053918 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d658e-30cf-43a6-b433-04567e663ddd None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:22.055708 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d658e-30cf-43a6-b433-04567e663ddd None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:22.055708 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d658e-30cf-43a6-b433-04567e663ddd None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:22.056930 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 702/1410] 10.222.0.91 () {54 vars in 918 bytes} [Tue Aug 30 04:22:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:22:22.063328 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee58859f-4360-46cd-a457-9673a4740b18 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:22.063992 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee58859f-4360-46cd-a457-9673a4740b18 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:22.063992 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee58859f-4360-46cd-a457-9673a4740b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:22.183647 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-ee58859f-4360-46cd-a457-9673a4740b18 None None] MFA Rules not processed for user `47a092fbe1334f7e9ae4ba9bdb5e9f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:22:22.185151 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-ee58859f-4360-46cd-a457-9673a4740b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:22.340680 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 709/1411] 10.222.0.91 () {58 vars in 1015 bytes} [Tue Aug 30 04:22:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:22:22.358540 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298d065-ba63-49e3-b23c-bc394bcff007 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:22.358819 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298d065-ba63-49e3-b23c-bc394bcff007 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:22.359138 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298d065-ba63-49e3-b23c-bc394bcff007 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:22.360662 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 703/1412] 10.222.0.91 () {54 vars in 918 bytes} [Tue Aug 30 04:22:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:22:22.367466 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ed5e0-6ce1-4693-9406-2e303bef8189 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:22.368016 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ed5e0-6ce1-4693-9406-2e303bef8189 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:22.368508 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ed5e0-6ce1-4693-9406-2e303bef8189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:22.490916 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:22.496145 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-f93ed5e0-6ce1-4693-9406-2e303bef8189 None None] MFA Rules not processed for user `d806295278ae4997b5c6968aa553290c`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:22:22.498180 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-f93ed5e0-6ce1-4693-9406-2e303bef8189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:22.660183 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 710/1413] 10.222.0.91 () {58 vars in 1015 bytes} [Tue Aug 30 04:22:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:22:25.470402 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca35a1-8c9c-4f58-92bb-e8a0bbba4cd2 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:25.471074 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca35a1-8c9c-4f58-92bb-e8a0bbba4cd2 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:25.471074 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca35a1-8c9c-4f58-92bb-e8a0bbba4cd2 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:25.472532 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 704/1414] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 04:22:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:22:25.479168 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95684ce-603d-4217-9945-4735f841bf51 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:25.479824 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95684ce-603d-4217-9945-4735f841bf51 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:25.479824 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95684ce-603d-4217-9945-4735f841bf51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:25.567232 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-c95684ce-603d-4217-9945-4735f841bf51 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:22:25.568540 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-c95684ce-603d-4217-9945-4735f841bf51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:25.643107 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:25.697808 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 711/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 04:22:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:22:26.002542 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca35a1-8c9c-4f58-92bb-e8a0bbba4cd2 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:26.004410 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-b7ca35a1-8c9c-4f58-92bb-e8a0bbba4cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:26.203406 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca35a1-8c9c-4f58-92bb-e8a0bbba4cd2 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:26.300002 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:26.354442 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b397b1-5610-417b-a4ba-6dd66bbfc83f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd806295278ae4997b5c6968aa553290c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:26.355190 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b397b1-5610-417b-a4ba-6dd66bbfc83f service nova] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:26.355518 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b397b1-5610-417b-a4ba-6dd66bbfc83f service nova] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:26.355836 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b397b1-5610-417b-a4ba-6dd66bbfc83f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:26.357712 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-d7b397b1-5610-417b-a4ba-6dd66bbfc83f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:26.482714 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b397b1-5610-417b-a4ba-6dd66bbfc83f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:26.484553 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b397b1-5610-417b-a4ba-6dd66bbfc83f service nova] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:26.507789 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 705/1416] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:22:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:22:27.508148 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae8aa8-4723-468c-8eaa-d01c6177c901 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:27.508805 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae8aa8-4723-468c-8eaa-d01c6177c901 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:27.508941 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae8aa8-4723-468c-8eaa-d01c6177c901 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:27.510511 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 712/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 04:22:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:22:27.516572 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79387729-7266-4706-a4b2-f7f11581b834 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:27.517345 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79387729-7266-4706-a4b2-f7f11581b834 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:27.517345 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79387729-7266-4706-a4b2-f7f11581b834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:27.619411 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-79387729-7266-4706-a4b2-f7f11581b834 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:22:27.620704 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-79387729-7266-4706-a4b2-f7f11581b834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:27.656345 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:27.763990 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 706/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 04:22:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:22:27.920629 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae8aa8-4723-468c-8eaa-d01c6177c901 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:27.922199 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-19ae8aa8-4723-468c-8eaa-d01c6177c901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:28.111745 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae8aa8-4723-468c-8eaa-d01c6177c901 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:28.162816 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:28.282679 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fdfe05-8a0c-45bf-9874-7df67ff1019f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd806295278ae4997b5c6968aa553290c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:28.283950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fdfe05-8a0c-45bf-9874-7df67ff1019f service nova] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:28.284442 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fdfe05-8a0c-45bf-9874-7df67ff1019f service nova] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:28.284906 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fdfe05-8a0c-45bf-9874-7df67ff1019f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:28.288145 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-48fdfe05-8a0c-45bf-9874-7df67ff1019f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:28.435573 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fdfe05-8a0c-45bf-9874-7df67ff1019f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:28.438581 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fdfe05-8a0c-45bf-9874-7df67ff1019f service nova] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:28.476179 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 713/1419] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:22:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:22:29.467189 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68662f35-0b15-45c2-b51f-8bb459f9cd19 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:29.467967 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68662f35-0b15-45c2-b51f-8bb459f9cd19 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:29.467967 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68662f35-0b15-45c2-b51f-8bb459f9cd19 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:29.469163 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 707/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 04:22:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:22:29.475290 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865c86a-cdd1-40e4-8d9e-e0ca9534c441 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:29.476181 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865c86a-cdd1-40e4-8d9e-e0ca9534c441 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:29.476341 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865c86a-cdd1-40e4-8d9e-e0ca9534c441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:29.548164 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:29.578667 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-8865c86a-cdd1-40e4-8d9e-e0ca9534c441 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:22:29.580326 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-8865c86a-cdd1-40e4-8d9e-e0ca9534c441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:29.705866 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 714/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 04:22:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:22:29.870382 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68662f35-0b15-45c2-b51f-8bb459f9cd19 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:29.871979 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-68662f35-0b15-45c2-b51f-8bb459f9cd19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:30.053451 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68662f35-0b15-45c2-b51f-8bb459f9cd19 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:30.068047 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:30.214313 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed0e5f0-bba7-4413-805a-09f7a1d10ad8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd806295278ae4997b5c6968aa553290c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:30.214821 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0e5f0-bba7-4413-805a-09f7a1d10ad8 service nova] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:30.215101 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0e5f0-bba7-4413-805a-09f7a1d10ad8 service nova] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:30.215382 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0e5f0-bba7-4413-805a-09f7a1d10ad8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:30.217151 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-0ed0e5f0-bba7-4413-805a-09f7a1d10ad8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:30.327415 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed0e5f0-bba7-4413-805a-09f7a1d10ad8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:30.329119 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed0e5f0-bba7-4413-805a-09f7a1d10ad8 service nova] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:30.351559 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 708/1422] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:22:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:22:31.318918 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15afea5a-bbf6-4da5-ae52-358e50cf9b0d None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:31.319876 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15afea5a-bbf6-4da5-ae52-358e50cf9b0d None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:31.319876 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15afea5a-bbf6-4da5-ae52-358e50cf9b0d None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:31.321417 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 715/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 04:22:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:22:31.330168 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3eb33-0b9a-4a77-a3e5-fbee4f55179d None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:31.330844 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3eb33-0b9a-4a77-a3e5-fbee4f55179d None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:31.331170 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3eb33-0b9a-4a77-a3e5-fbee4f55179d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:31.361414 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:31.441045 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-13d3eb33-0b9a-4a77-a3e5-fbee4f55179d None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:22:31.442378 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-13d3eb33-0b9a-4a77-a3e5-fbee4f55179d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:31.565326 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 709/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 04:22:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:22:31.754854 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15afea5a-bbf6-4da5-ae52-358e50cf9b0d None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:31.757807 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-15afea5a-bbf6-4da5-ae52-358e50cf9b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:31.899561 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:31.945795 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15afea5a-bbf6-4da5-ae52-358e50cf9b0d None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:32.088447 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e837b6a1-9ee0-49b0-8530-bda761739587 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd806295278ae4997b5c6968aa553290c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:32.089076 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e837b6a1-9ee0-49b0-8530-bda761739587 service nova] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:32.089345 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e837b6a1-9ee0-49b0-8530-bda761739587 service nova] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:32.089615 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e837b6a1-9ee0-49b0-8530-bda761739587 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:32.091313 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-e837b6a1-9ee0-49b0-8530-bda761739587 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:32.196106 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:32.216006 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e837b6a1-9ee0-49b0-8530-bda761739587 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:32.217831 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e837b6a1-9ee0-49b0-8530-bda761739587 service nova] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:32.241641 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 716/1425] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:22:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:22:33.192118 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f10aa2-daab-424a-83a4-cd7bfd146d17 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:33.193062 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f10aa2-daab-424a-83a4-cd7bfd146d17 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:33.193062 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f10aa2-daab-424a-83a4-cd7bfd146d17 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:33.195509 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 710/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 04:22:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:22:33.201924 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030636d1-9fac-4fdc-8c16-2d147212dc7d None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:33.202662 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030636d1-9fac-4fdc-8c16-2d147212dc7d None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:33.202662 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030636d1-9fac-4fdc-8c16-2d147212dc7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:33.310157 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-030636d1-9fac-4fdc-8c16-2d147212dc7d None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:22:33.312271 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-030636d1-9fac-4fdc-8c16-2d147212dc7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:33.451165 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 717/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 04:22:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:22:33.607616 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f10aa2-daab-424a-83a4-cd7bfd146d17 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:33.609276 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-08f10aa2-daab-424a-83a4-cd7bfd146d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:33.765356 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:33.861708 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f10aa2-daab-424a-83a4-cd7bfd146d17 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:34.014051 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913cee7d-dcbd-42e1-ae9f-fd2de659e61d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd806295278ae4997b5c6968aa553290c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:34.014747 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913cee7d-dcbd-42e1-ae9f-fd2de659e61d service nova] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:34.015022 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913cee7d-dcbd-42e1-ae9f-fd2de659e61d service nova] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:34.015294 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913cee7d-dcbd-42e1-ae9f-fd2de659e61d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:34.017143 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-913cee7d-dcbd-42e1-ae9f-fd2de659e61d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:34.090510 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:34.146875 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913cee7d-dcbd-42e1-ae9f-fd2de659e61d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:34.149353 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913cee7d-dcbd-42e1-ae9f-fd2de659e61d service nova] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:34.181954 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 711/1428] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:22:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:22:35.164504 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84eb458-fec3-465e-9ff3-f5c95002c5a8 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:35.165160 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84eb458-fec3-465e-9ff3-f5c95002c5a8 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:35.165160 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84eb458-fec3-465e-9ff3-f5c95002c5a8 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:35.167052 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 718/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 04:22:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:22:35.173547 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a4968-6207-4e12-aadc-a8d531fe44df None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:35.174401 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a4968-6207-4e12-aadc-a8d531fe44df None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:35.174401 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a4968-6207-4e12-aadc-a8d531fe44df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:35.271452 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-923a4968-6207-4e12-aadc-a8d531fe44df None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:22:35.273120 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-923a4968-6207-4e12-aadc-a8d531fe44df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:35.403303 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 712/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 04:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:22:35.567427 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84eb458-fec3-465e-9ff3-f5c95002c5a8 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:35.569159 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-d84eb458-fec3-465e-9ff3-f5c95002c5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:35.635296 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:35.763298 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84eb458-fec3-465e-9ff3-f5c95002c5a8 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:35.909579 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca6a85-9dc0-4a09-9620-eacaf36980de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd806295278ae4997b5c6968aa553290c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:35.910310 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca6a85-9dc0-4a09-9620-eacaf36980de service nova] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:35.910652 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca6a85-9dc0-4a09-9620-eacaf36980de service nova] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:35.910973 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca6a85-9dc0-4a09-9620-eacaf36980de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:35.913043 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-baca6a85-9dc0-4a09-9620-eacaf36980de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:35.922271 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:36.028808 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baca6a85-9dc0-4a09-9620-eacaf36980de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:36.030647 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baca6a85-9dc0-4a09-9620-eacaf36980de service nova] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:36.055766 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 719/1431] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:22:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:22:36.921173 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cbdaa0-e45b-4f54-a8d7-4137597e4541 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:36.921740 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cbdaa0-e45b-4f54-a8d7-4137597e4541 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:36.921740 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cbdaa0-e45b-4f54-a8d7-4137597e4541 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:36.923951 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 713/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 04:22:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:22:36.931477 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252c89e-8e05-4d2d-985a-21dcc5ea1740 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:36.932129 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252c89e-8e05-4d2d-985a-21dcc5ea1740 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:36.932288 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252c89e-8e05-4d2d-985a-21dcc5ea1740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:37.043335 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-f252c89e-8e05-4d2d-985a-21dcc5ea1740 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:22:37.044631 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-f252c89e-8e05-4d2d-985a-21dcc5ea1740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:37.137437 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:37.175276 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 720/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 04:22:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:22:37.448580 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cbdaa0-e45b-4f54-a8d7-4137597e4541 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:37.450100 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-b5cbdaa0-e45b-4f54-a8d7-4137597e4541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:37.471945 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:37.630332 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cbdaa0-e45b-4f54-a8d7-4137597e4541 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:37.749694 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:37.784119 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd18d052-78d2-40eb-b4bc-0ab85eadd5b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd806295278ae4997b5c6968aa553290c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:37.784751 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18d052-78d2-40eb-b4bc-0ab85eadd5b7 service nova] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:37.785032 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18d052-78d2-40eb-b4bc-0ab85eadd5b7 service nova] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:37.785302 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18d052-78d2-40eb-b4bc-0ab85eadd5b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:37.787063 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-fd18d052-78d2-40eb-b4bc-0ab85eadd5b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:37.907768 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd18d052-78d2-40eb-b4bc-0ab85eadd5b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:37.909520 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd18d052-78d2-40eb-b4bc-0ab85eadd5b7 service nova] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:37.932110 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 714/1434] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:22:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:22:38.795706 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e565bd-a8be-4ffe-afbf-7f99c7e8c21e None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:38.796380 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e565bd-a8be-4ffe-afbf-7f99c7e8c21e None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:38.796380 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e565bd-a8be-4ffe-afbf-7f99c7e8c21e None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:38.797849 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 721/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 04:22:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:22:38.804061 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b621c-0446-4e90-8a90-e33d2a0b77d2 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:38.804389 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b621c-0446-4e90-8a90-e33d2a0b77d2 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:38.804704 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b621c-0446-4e90-8a90-e33d2a0b77d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:38.904806 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-017b621c-0446-4e90-8a90-e33d2a0b77d2 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:22:38.906051 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-017b621c-0446-4e90-8a90-e33d2a0b77d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:38.962096 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:39.035869 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 715/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 04:22:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:22:39.190463 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e565bd-a8be-4ffe-afbf-7f99c7e8c21e None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:39.191956 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-58e565bd-a8be-4ffe-afbf-7f99c7e8c21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:39.367336 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e565bd-a8be-4ffe-afbf-7f99c7e8c21e None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:39.433182 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:39.514733 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46015bb3-6022-4917-83aa-b2fa14fb09a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd806295278ae4997b5c6968aa553290c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:39.515272 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46015bb3-6022-4917-83aa-b2fa14fb09a9 service nova] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:39.515552 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46015bb3-6022-4917-83aa-b2fa14fb09a9 service nova] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:39.515821 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46015bb3-6022-4917-83aa-b2fa14fb09a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:39.517562 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-46015bb3-6022-4917-83aa-b2fa14fb09a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:39.637360 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46015bb3-6022-4917-83aa-b2fa14fb09a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:39.640464 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46015bb3-6022-4917-83aa-b2fa14fb09a9 service nova] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:39.678516 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 722/1437] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:22:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:22:40.576132 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8978f21-cd70-4e61-b581-af0f19b3545c None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:40.576949 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8978f21-cd70-4e61-b581-af0f19b3545c None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:40.577183 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8978f21-cd70-4e61-b581-af0f19b3545c None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:40.579817 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 716/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 04:22:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:22:40.586099 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d51085-94b8-4a7a-9665-9f780e6af1b7 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:40.586950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d51085-94b8-4a7a-9665-9f780e6af1b7 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:40.586950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d51085-94b8-4a7a-9665-9f780e6af1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:40.695173 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-c4d51085-94b8-4a7a-9665-9f780e6af1b7 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:22:40.697299 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-c4d51085-94b8-4a7a-9665-9f780e6af1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:40.701414 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:40.821867 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 723/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 04:22:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:22:41.102907 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8978f21-cd70-4e61-b581-af0f19b3545c None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:41.104505 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-a8978f21-cd70-4e61-b581-af0f19b3545c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:41.305263 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8978f21-cd70-4e61-b581-af0f19b3545c None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:41.337266 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:41.471539 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370cdf2-80c3-4ea3-8564-437909366cd5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd806295278ae4997b5c6968aa553290c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:41.472635 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370cdf2-80c3-4ea3-8564-437909366cd5 service nova] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:41.473081 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370cdf2-80c3-4ea3-8564-437909366cd5 service nova] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:41.473557 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370cdf2-80c3-4ea3-8564-437909366cd5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:41.477058 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-4370cdf2-80c3-4ea3-8564-437909366cd5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:41.654771 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370cdf2-80c3-4ea3-8564-437909366cd5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:41.658045 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370cdf2-80c3-4ea3-8564-437909366cd5 service nova] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:41.696429 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 717/1440] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:22:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 594 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:22:44.233103 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc592f-88fe-4c36-8fcc-49be58ae5038 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:44.233785 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc592f-88fe-4c36-8fcc-49be58ae5038 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:44.233961 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc592f-88fe-4c36-8fcc-49be58ae5038 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:44.235671 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 724/1441] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 04:22:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:22:44.242854 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31406c0d-ebc9-4ad1-81a4-f92435c4fc25 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:44.243482 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31406c0d-ebc9-4ad1-81a4-f92435c4fc25 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:44.243482 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31406c0d-ebc9-4ad1-81a4-f92435c4fc25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:44.294478 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:44.341514 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-31406c0d-ebc9-4ad1-81a4-f92435c4fc25 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:22:44.342796 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-31406c0d-ebc9-4ad1-81a4-f92435c4fc25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:44.476976 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 718/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 04:22:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:22:44.776962 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc592f-88fe-4c36-8fcc-49be58ae5038 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:44.778630 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-f5dc592f-88fe-4c36-8fcc-49be58ae5038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:44.911459 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc592f-88fe-4c36-8fcc-49be58ae5038 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:44.954179 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:45.010929 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea64b7-e118-47e7-be6a-3027d3a7ac30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:45.011566 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea64b7-e118-47e7-be6a-3027d3a7ac30 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:45.011847 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea64b7-e118-47e7-be6a-3027d3a7ac30 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:45.012150 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea64b7-e118-47e7-be6a-3027d3a7ac30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:45.013889 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-75ea64b7-e118-47e7-be6a-3027d3a7ac30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:45.157856 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea64b7-e118-47e7-be6a-3027d3a7ac30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:45.159342 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea64b7-e118-47e7-be6a-3027d3a7ac30 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:45.184372 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 725/1443] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:22:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:22:47.401870 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14951765-471b-4f1c-92b7-afcfc9a0242f None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:47.402612 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14951765-471b-4f1c-92b7-afcfc9a0242f None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:47.402612 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14951765-471b-4f1c-92b7-afcfc9a0242f None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:47.404071 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 719/1444] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 04:22:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:22:47.410571 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a167fb-11ee-463e-ab35-3766b3390655 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:47.411200 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a167fb-11ee-463e-ab35-3766b3390655 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:47.411200 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a167fb-11ee-463e-ab35-3766b3390655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:47.495227 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-67a167fb-11ee-463e-ab35-3766b3390655 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:22:47.496591 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-67a167fb-11ee-463e-ab35-3766b3390655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:47.512171 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:47.618068 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 726/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 04:22:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:22:47.917346 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14951765-471b-4f1c-92b7-afcfc9a0242f None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:47.918984 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-14951765-471b-4f1c-92b7-afcfc9a0242f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:48.062266 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14951765-471b-4f1c-92b7-afcfc9a0242f None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:48.079159 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:48.167604 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb778108-bf08-4ab8-a69e-7cb70bf09f6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:48.168366 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb778108-bf08-4ab8-a69e-7cb70bf09f6f service neutron] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:48.168842 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb778108-bf08-4ab8-a69e-7cb70bf09f6f service neutron] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:48.169258 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb778108-bf08-4ab8-a69e-7cb70bf09f6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:48.171223 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-fb778108-bf08-4ab8-a69e-7cb70bf09f6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:48.336651 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb778108-bf08-4ab8-a69e-7cb70bf09f6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:48.338294 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb778108-bf08-4ab8-a69e-7cb70bf09f6f service neutron] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:48.360916 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 720/1446] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:22:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:22:51.048934 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ee2ea-122a-4a8d-a374-404fc5905ecc None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:51.049782 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ee2ea-122a-4a8d-a374-404fc5905ecc None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:51.049782 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ee2ea-122a-4a8d-a374-404fc5905ecc None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:51.051497 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 727/1447] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 04:22:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:22:51.060062 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65836a2f-604a-44ed-bab9-98d133b5bff5 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:51.060683 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65836a2f-604a-44ed-bab9-98d133b5bff5 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:51.060683 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65836a2f-604a-44ed-bab9-98d133b5bff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:51.126252 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:51.151517 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-65836a2f-604a-44ed-bab9-98d133b5bff5 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:22:51.153065 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-65836a2f-604a-44ed-bab9-98d133b5bff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:51.308104 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 721/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 04:22:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:22:51.610427 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9ee2ea-122a-4a8d-a374-404fc5905ecc None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:51.612078 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-4e9ee2ea-122a-4a8d-a374-404fc5905ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:51.749679 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9ee2ea-122a-4a8d-a374-404fc5905ecc None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:51.812373 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:51.874033 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75557b1-cbe2-4e48-ac95-cf1e4e543b1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:51.875083 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75557b1-cbe2-4e48-ac95-cf1e4e543b1f service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:51.875541 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75557b1-cbe2-4e48-ac95-cf1e4e543b1f service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:51.875890 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75557b1-cbe2-4e48-ac95-cf1e4e543b1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:51.885339 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-d75557b1-cbe2-4e48-ac95-cf1e4e543b1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:52.033116 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75557b1-cbe2-4e48-ac95-cf1e4e543b1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:52.034628 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75557b1-cbe2-4e48-ac95-cf1e4e543b1f service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:52.057054 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 728/1449] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:22:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:22:54.574864 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4bcd29-52bc-4f9c-a211-0f67a114f42d None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:54.575620 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4bcd29-52bc-4f9c-a211-0f67a114f42d None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:54.575620 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4bcd29-52bc-4f9c-a211-0f67a114f42d None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:54.576958 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 722/1450] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 04:22:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:22:54.583822 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e9e5e-ca6f-4e95-9036-0f9e380c09f1 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:54.584975 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e9e5e-ca6f-4e95-9036-0f9e380c09f1 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:54.585314 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e9e5e-ca6f-4e95-9036-0f9e380c09f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:54.675329 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-c06e9e5e-ca6f-4e95-9036-0f9e380c09f1 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:22:54.677409 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-c06e9e5e-ca6f-4e95-9036-0f9e380c09f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:54.706588 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:54.825154 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 729/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 04:22:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:22:55.134044 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4bcd29-52bc-4f9c-a211-0f67a114f42d None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:55.135899 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-7b4bcd29-52bc-4f9c-a211-0f67a114f42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:55.286814 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4bcd29-52bc-4f9c-a211-0f67a114f42d None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:55.314391 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:55.383222 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ab9761-99f5-4f4b-9043-c37354271994 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:55.384266 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab9761-99f5-4f4b-9043-c37354271994 service neutron] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:55.384960 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab9761-99f5-4f4b-9043-c37354271994 service neutron] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:55.385281 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab9761-99f5-4f4b-9043-c37354271994 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:55.387065 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-08ab9761-99f5-4f4b-9043-c37354271994 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:55.588669 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ab9761-99f5-4f4b-9043-c37354271994 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:55.590368 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ab9761-99f5-4f4b-9043-c37354271994 service neutron] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:55.612538 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 723/1452] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:22:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:22:58.223792 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c519f26-53c2-4daf-abc5-7bd199f21b78 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:58.224710 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c519f26-53c2-4daf-abc5-7bd199f21b78 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:58.224900 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c519f26-53c2-4daf-abc5-7bd199f21b78 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:58.226497 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 730/1453] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 04:22:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:22:58.236376 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d23b1c-cdf7-4f74-be3c-f7b6770dbcb5 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:58.237087 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d23b1c-cdf7-4f74-be3c-f7b6770dbcb5 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:58.237370 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d23b1c-cdf7-4f74-be3c-f7b6770dbcb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:58.354178 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:58.359208 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-29d23b1c-cdf7-4f74-be3c-f7b6770dbcb5 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:22:58.362267 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-29d23b1c-cdf7-4f74-be3c-f7b6770dbcb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:58.490653 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 724/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 04:22:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:22:58.782876 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c519f26-53c2-4daf-abc5-7bd199f21b78 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:58.784662 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-2c519f26-53c2-4daf-abc5-7bd199f21b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:58.935802 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c519f26-53c2-4daf-abc5-7bd199f21b78 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:59.012564 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:59.047155 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda87c73-831e-470a-b675-00f4f434ceea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:59.047660 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda87c73-831e-470a-b675-00f4f434ceea service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:59.047958 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda87c73-831e-470a-b675-00f4f434ceea service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:59.048229 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda87c73-831e-470a-b675-00f4f434ceea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:59.049945 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-eda87c73-831e-470a-b675-00f4f434ceea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:59.198307 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda87c73-831e-470a-b675-00f4f434ceea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:59.199835 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda87c73-831e-470a-b675-00f4f434ceea service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:59.224861 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 731/1455] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:22:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:23:01.383030 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c7b01-9d9c-436d-b11c-30ca6dc4b770 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:01.383789 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c7b01-9d9c-436d-b11c-30ca6dc4b770 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:01.383789 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c7b01-9d9c-436d-b11c-30ca6dc4b770 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:01.384998 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 725/1456] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 04:23:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:23:01.391295 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e4873-3072-4dc6-b2b9-5ad3cf79d84e None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:01.391958 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e4873-3072-4dc6-b2b9-5ad3cf79d84e None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:01.391958 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e4873-3072-4dc6-b2b9-5ad3cf79d84e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:01.473380 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-0b6e4873-3072-4dc6-b2b9-5ad3cf79d84e None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:01.474743 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-0b6e4873-3072-4dc6-b2b9-5ad3cf79d84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:01.514266 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:01.597816 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 732/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 04:23:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:23:01.889070 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197c7b01-9d9c-436d-b11c-30ca6dc4b770 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:01.889418 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-197c7b01-9d9c-436d-b11c-30ca6dc4b770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:02.046197 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197c7b01-9d9c-436d-b11c-30ca6dc4b770 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:02.096321 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:02.154645 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155b2939-9d15-42f4-b1c9-46020ed0d69c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:02.155259 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b2939-9d15-42f4-b1c9-46020ed0d69c service neutron] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:02.155532 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b2939-9d15-42f4-b1c9-46020ed0d69c service neutron] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:02.155793 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b2939-9d15-42f4-b1c9-46020ed0d69c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:02.157483 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-155b2939-9d15-42f4-b1c9-46020ed0d69c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:02.292446 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155b2939-9d15-42f4-b1c9-46020ed0d69c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:02.293941 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155b2939-9d15-42f4-b1c9-46020ed0d69c service neutron] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:02.315192 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 726/1458] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:23:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:23:04.582139 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c0eb5-7f4b-4a3b-a700-d5e41a40cc8b None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:04.582910 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c0eb5-7f4b-4a3b-a700-d5e41a40cc8b None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:04.582910 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c0eb5-7f4b-4a3b-a700-d5e41a40cc8b None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:04.585124 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 733/1459] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 04:23:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:23:04.591580 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ffdef7-85be-4efe-9c01-fa34c15c56bb None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:04.592295 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ffdef7-85be-4efe-9c01-fa34c15c56bb None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:04.592295 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ffdef7-85be-4efe-9c01-fa34c15c56bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:04.681873 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-a1ffdef7-85be-4efe-9c01-fa34c15c56bb None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:04.683152 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-a1ffdef7-85be-4efe-9c01-fa34c15c56bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:04.693825 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:04.835292 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 727/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 04:23:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:23:05.157345 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c0eb5-7f4b-4a3b-a700-d5e41a40cc8b None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:05.159012 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-ac3c0eb5-7f4b-4a3b-a700-d5e41a40cc8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:05.342163 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c0eb5-7f4b-4a3b-a700-d5e41a40cc8b None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:05.448194 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:05.481611 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a9717f-7546-4d17-ad06-a9eb22663b45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:05.482668 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9717f-7546-4d17-ad06-a9eb22663b45 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:05.483150 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9717f-7546-4d17-ad06-a9eb22663b45 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:05.483627 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9717f-7546-4d17-ad06-a9eb22663b45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:05.486826 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-86a9717f-7546-4d17-ad06-a9eb22663b45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:05.643175 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a9717f-7546-4d17-ad06-a9eb22663b45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:05.644695 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a9717f-7546-4d17-ad06-a9eb22663b45 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:05.667973 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 734/1461] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:23:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:23:07.882227 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed40e7-2ec4-46ae-b392-bd6938706a6b None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:07.882838 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed40e7-2ec4-46ae-b392-bd6938706a6b None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:07.883140 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed40e7-2ec4-46ae-b392-bd6938706a6b None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:07.885649 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 728/1462] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 04:23:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:23:07.893105 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d3ed4-1279-4d2b-80b6-deec9e74d881 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:07.893985 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d3ed4-1279-4d2b-80b6-deec9e74d881 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:07.893985 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d3ed4-1279-4d2b-80b6-deec9e74d881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:07.987407 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-fe5d3ed4-1279-4d2b-80b6-deec9e74d881 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:07.988694 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-fe5d3ed4-1279-4d2b-80b6-deec9e74d881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:08.055227 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:08.156057 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 735/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 04:23:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:23:08.679213 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed40e7-2ec4-46ae-b392-bd6938706a6b None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:08.680992 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-e6ed40e7-2ec4-46ae-b392-bd6938706a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:08.815327 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed40e7-2ec4-46ae-b392-bd6938706a6b None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:08.867443 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:08.913717 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c35922f-e519-41c9-b259-6322805b738d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:08.914902 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35922f-e519-41c9-b259-6322805b738d service neutron] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:08.915248 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35922f-e519-41c9-b259-6322805b738d service neutron] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:08.915565 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35922f-e519-41c9-b259-6322805b738d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:08.917941 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-9c35922f-e519-41c9-b259-6322805b738d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:09.061986 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c35922f-e519-41c9-b259-6322805b738d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:09.063516 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c35922f-e519-41c9-b259-6322805b738d service neutron] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:09.087305 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 729/1464] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:23:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:23:11.107849 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874dec8-789b-48a5-a622-fe7dba75e708 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:11.108807 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874dec8-789b-48a5-a622-fe7dba75e708 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:11.108807 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874dec8-789b-48a5-a622-fe7dba75e708 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:11.110480 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 736/1465] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 04:23:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:23:11.118151 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d2b78-0198-4d70-ba0e-02e77edbb3ce None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:11.118755 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d2b78-0198-4d70-ba0e-02e77edbb3ce None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:11.119036 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d2b78-0198-4d70-ba0e-02e77edbb3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:11.209826 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-396d2b78-0198-4d70-ba0e-02e77edbb3ce None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:11.211228 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-396d2b78-0198-4d70-ba0e-02e77edbb3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:11.234646 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:11.363642 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 730/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 04:23:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:23:11.667204 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2874dec8-789b-48a5-a622-fe7dba75e708 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:11.668869 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-2874dec8-789b-48a5-a622-fe7dba75e708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:11.814104 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2874dec8-789b-48a5-a622-fe7dba75e708 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:11.900556 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:11.909338 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee76166-e01e-45b4-ab90-b58f3c500341 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:11.910017 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee76166-e01e-45b4-ab90-b58f3c500341 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:11.910341 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee76166-e01e-45b4-ab90-b58f3c500341 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:11.910693 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee76166-e01e-45b4-ab90-b58f3c500341 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:11.913189 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-8ee76166-e01e-45b4-ab90-b58f3c500341 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:12.188536 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee76166-e01e-45b4-ab90-b58f3c500341 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:12.189968 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee76166-e01e-45b4-ab90-b58f3c500341 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:12.213032 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 737/1467] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:23:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:23:14.192133 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a855f2e-8873-4af7-85fa-93216d848791 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:14.192791 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a855f2e-8873-4af7-85fa-93216d848791 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:14.192791 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a855f2e-8873-4af7-85fa-93216d848791 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:14.194669 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 731/1468] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 04:23:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:23:14.200655 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f929a4d-d918-45e0-ae80-4f5a4f7feb7c None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:14.201553 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f929a4d-d918-45e0-ae80-4f5a4f7feb7c None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:14.201553 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f929a4d-d918-45e0-ae80-4f5a4f7feb7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:14.294378 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-3f929a4d-d918-45e0-ae80-4f5a4f7feb7c None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:14.295676 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-3f929a4d-d918-45e0-ae80-4f5a4f7feb7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:14.353025 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:14.413433 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 738/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 04:23:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:23:14.710437 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a855f2e-8873-4af7-85fa-93216d848791 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:14.712104 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-8a855f2e-8873-4af7-85fa-93216d848791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:14.834992 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a855f2e-8873-4af7-85fa-93216d848791 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:14.911487 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:14.963076 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bcfae1-9bc6-451f-9da0-d44c35e1860a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:14.963728 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bcfae1-9bc6-451f-9da0-d44c35e1860a service neutron] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:14.964076 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bcfae1-9bc6-451f-9da0-d44c35e1860a service neutron] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:14.964379 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bcfae1-9bc6-451f-9da0-d44c35e1860a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:14.966161 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-15bcfae1-9bc6-451f-9da0-d44c35e1860a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:15.107862 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bcfae1-9bc6-451f-9da0-d44c35e1860a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:15.109488 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bcfae1-9bc6-451f-9da0-d44c35e1860a service neutron] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:15.131618 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 732/1470] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:23:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:23:24.411155 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=22 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:25.129192 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=66 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:36.399757 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f64ccf4-7b3a-4a2c-8ef7-15790c40b9c4 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:36.400666 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f64ccf4-7b3a-4a2c-8ef7-15790c40b9c4 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:36.400666 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f64ccf4-7b3a-4a2c-8ef7-15790c40b9c4 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:36.402195 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 739/1471] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:23:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:23:36.409171 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217f334-84e5-4dac-a92f-5b7064ed6978 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:36.409796 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217f334-84e5-4dac-a92f-5b7064ed6978 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:36.409796 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217f334-84e5-4dac-a92f-5b7064ed6978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:36.492324 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-c217f334-84e5-4dac-a92f-5b7064ed6978 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:36.493623 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-c217f334-84e5-4dac-a92f-5b7064ed6978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:36.610740 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 733/1472] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:23:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:23:36.918703 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2eed1-7bf7-4e63-b9f1-33668c80642c None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:36.919028 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2eed1-7bf7-4e63-b9f1-33668c80642c None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:36.919381 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2eed1-7bf7-4e63-b9f1-33668c80642c None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:36.920998 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 740/1473] 10.222.0.91 () {54 vars in 967 bytes} [Tue Aug 30 04:23:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:23:36.927350 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a9415-06af-4293-9f6a-77ae888eeb44 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:36.927662 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a9415-06af-4293-9f6a-77ae888eeb44 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:36.928099 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a9415-06af-4293-9f6a-77ae888eeb44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:37.037468 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-7f9a9415-06af-4293-9f6a-77ae888eeb44 None None] MFA Rules not processed for user `2af2e1344bc54bf388e5ec025ab94c2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:37.039291 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-7f9a9415-06af-4293-9f6a-77ae888eeb44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:37.067280 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:37.153344 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 734/1474] 10.222.0.91 () {58 vars in 1064 bytes} [Tue Aug 30 04:23:36 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:23:37.165663 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c2eed1-7bf7-4e63-b9f1-33668c80642c None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:37.167388 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-13c2eed1-7bf7-4e63-b9f1-33668c80642c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:37.369295 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c2eed1-7bf7-4e63-b9f1-33668c80642c None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:37.498513 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d3d15-ad7f-4b0d-ab3f-b7a7409c9116 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2e1344bc54bf388e5ec025ab94c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:37.499612 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d3d15-ad7f-4b0d-ab3f-b7a7409c9116 service glance] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:37.499612 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d3d15-ad7f-4b0d-ab3f-b7a7409c9116 service glance] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:37.499612 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d3d15-ad7f-4b0d-ab3f-b7a7409c9116 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:37.501337 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-644d3d15-ad7f-4b0d-ab3f-b7a7409c9116 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:37.567668 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:37.658219 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d3d15-ad7f-4b0d-ab3f-b7a7409c9116 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:37.661124 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d3d15-ad7f-4b0d-ab3f-b7a7409c9116 service glance] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:37.700914 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 741/1475] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:23:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:23:39.941736 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e116b9-a0a0-4a65-82f4-bf3da08a6ab7 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:39.942326 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e116b9-a0a0-4a65-82f4-bf3da08a6ab7 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:39.942326 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e116b9-a0a0-4a65-82f4-bf3da08a6ab7 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:39.944090 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 735/1476] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:23:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:23:39.950770 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c6001-a053-4a1d-a9f6-36177ed44c01 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:39.951689 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c6001-a053-4a1d-a9f6-36177ed44c01 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:39.951689 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c6001-a053-4a1d-a9f6-36177ed44c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:40.031978 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-f37c6001-a053-4a1d-a9f6-36177ed44c01 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:40.033262 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-f37c6001-a053-4a1d-a9f6-36177ed44c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:40.158666 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 742/1477] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:23:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:23:40.435127 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e116b9-a0a0-4a65-82f4-bf3da08a6ab7 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:40.436779 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-65e116b9-a0a0-4a65-82f4-bf3da08a6ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:40.590772 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e116b9-a0a0-4a65-82f4-bf3da08a6ab7 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:40.657424 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:40.737094 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a57761d-e73c-42a2-8d20-ba65ac183d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:40.737678 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57761d-e73c-42a2-8d20-ba65ac183d84 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:40.738013 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57761d-e73c-42a2-8d20-ba65ac183d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:40.738320 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57761d-e73c-42a2-8d20-ba65ac183d84 admin admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:40.739079 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a57761d-e73c-42a2-8d20-ba65ac183d84 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:40.741658 dv-cinder-854265-2-smb devstack@keystone.service[81547]: WARNING py.warnings [None req-0a57761d-e73c-42a2-8d20-ba65ac183d84 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:23:40.741658 dv-cinder-854265-2-smb devstack@keystone.service[81547]: warnings.warn(msg) Aug 30 04:23:40.741658 dv-cinder-854265-2-smb devstack@keystone.service[81547]: Aug 30 04:23:40.742883 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a57761d-e73c-42a2-8d20-ba65ac183d84 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:40.766015 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 736/1478] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 30 04:23:40 2022] GET /identity/v3/projects => generated 2553 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:23:42.817731 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c20b8e-c8b3-4fe3-9bce-39696d38e4c4 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:42.818599 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c20b8e-c8b3-4fe3-9bce-39696d38e4c4 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:42.818788 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c20b8e-c8b3-4fe3-9bce-39696d38e4c4 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:42.820496 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 743/1479] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:23:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:23:42.827003 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca2b4c-d438-4862-b3ce-f058be552940 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:42.827624 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca2b4c-d438-4862-b3ce-f058be552940 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:42.827624 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca2b4c-d438-4862-b3ce-f058be552940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:42.921505 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-6bca2b4c-d438-4862-b3ce-f058be552940 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:42.922838 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-6bca2b4c-d438-4862-b3ce-f058be552940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:43.050184 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 737/1480] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:23:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:23:43.355864 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c20b8e-c8b3-4fe3-9bce-39696d38e4c4 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:43.357752 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-20c20b8e-c8b3-4fe3-9bce-39696d38e4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:43.369988 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:43.587237 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c20b8e-c8b3-4fe3-9bce-39696d38e4c4 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:43.721768 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:43.768893 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d48fc62-d21f-4d80-98a8-07518e85c118 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd806295278ae4997b5c6968aa553290c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:43.769595 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48fc62-d21f-4d80-98a8-07518e85c118 service nova] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:43.769858 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48fc62-d21f-4d80-98a8-07518e85c118 service nova] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:43.770120 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48fc62-d21f-4d80-98a8-07518e85c118 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:43.772153 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-6d48fc62-d21f-4d80-98a8-07518e85c118 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:43.894902 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d48fc62-d21f-4d80-98a8-07518e85c118 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:43.897190 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d48fc62-d21f-4d80-98a8-07518e85c118 service nova] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:43.920653 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 744/1481] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:23:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:23:46.261923 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea8e51-c90b-4c50-bff0-4fa72e4dfefe None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:46.262794 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea8e51-c90b-4c50-bff0-4fa72e4dfefe None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:46.262794 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea8e51-c90b-4c50-bff0-4fa72e4dfefe None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:46.263873 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 738/1482] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:23:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:23:46.270712 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdfdf1a-fc69-4391-a868-40b4f5ce882d None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:46.271432 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdfdf1a-fc69-4391-a868-40b4f5ce882d None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:46.271432 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdfdf1a-fc69-4391-a868-40b4f5ce882d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:46.360907 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-9cdfdf1a-fc69-4391-a868-40b4f5ce882d None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:46.362388 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-9cdfdf1a-fc69-4391-a868-40b4f5ce882d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:46.426308 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:46.511110 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 745/1483] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:23:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:23:46.882787 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea8e51-c90b-4c50-bff0-4fa72e4dfefe None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:46.884445 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-eaea8e51-c90b-4c50-bff0-4fa72e4dfefe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:46.915280 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:47.018710 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea8e51-c90b-4c50-bff0-4fa72e4dfefe None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:47.127692 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d067bd-4dfc-41f8-955c-21b374d47353 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:47.129009 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d067bd-4dfc-41f8-955c-21b374d47353 service neutron] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:47.129472 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d067bd-4dfc-41f8-955c-21b374d47353 service neutron] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:47.129959 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d067bd-4dfc-41f8-955c-21b374d47353 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:47.133262 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-45d067bd-4dfc-41f8-955c-21b374d47353 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:47.231320 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:47.280934 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d067bd-4dfc-41f8-955c-21b374d47353 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:47.282408 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d067bd-4dfc-41f8-955c-21b374d47353 service neutron] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:47.305052 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 739/1484] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:23:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:23:49.443877 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4352187-f4fb-495b-82ed-ca9362e84b5b None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:49.444833 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4352187-f4fb-495b-82ed-ca9362e84b5b None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:49.444833 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4352187-f4fb-495b-82ed-ca9362e84b5b None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:49.445957 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 746/1485] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:23:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:23:49.452164 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382bf1df-0022-4347-9e4c-68e08134a032 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:49.452771 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382bf1df-0022-4347-9e4c-68e08134a032 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:49.452771 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382bf1df-0022-4347-9e4c-68e08134a032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:49.533284 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-382bf1df-0022-4347-9e4c-68e08134a032 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:49.534537 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-382bf1df-0022-4347-9e4c-68e08134a032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:49.678283 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 740/1486] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:23:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:23:49.971520 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4352187-f4fb-495b-82ed-ca9362e84b5b None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:49.974493 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-a4352187-f4fb-495b-82ed-ca9362e84b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:50.169276 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4352187-f4fb-495b-82ed-ca9362e84b5b None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:50.296686 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:50.299476 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bb3642-61e3-4360-8038-4bb4342aafc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:50.300771 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb3642-61e3-4360-8038-4bb4342aafc8 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:50.301364 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb3642-61e3-4360-8038-4bb4342aafc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:50.301717 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb3642-61e3-4360-8038-4bb4342aafc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:50.304126 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-16bb3642-61e3-4360-8038-4bb4342aafc8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:50.453394 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bb3642-61e3-4360-8038-4bb4342aafc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:50.454863 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bb3642-61e3-4360-8038-4bb4342aafc8 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:50.477335 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 747/1487] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:23:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:23:52.634824 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee1f4a-2f82-4378-9959-c69742a44f67 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:52.635444 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee1f4a-2f82-4378-9959-c69742a44f67 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:52.635800 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee1f4a-2f82-4378-9959-c69742a44f67 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:52.638517 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 741/1488] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:23:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:23:52.647328 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9f8c53-9b1e-4981-9724-9e819000a6e9 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:52.648006 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9f8c53-9b1e-4981-9724-9e819000a6e9 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:52.648006 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9f8c53-9b1e-4981-9724-9e819000a6e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:52.736245 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-cf9f8c53-9b1e-4981-9724-9e819000a6e9 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:52.738260 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-cf9f8c53-9b1e-4981-9724-9e819000a6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:52.812642 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:52.865727 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 748/1489] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:23:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:23:53.161470 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aee1f4a-2f82-4378-9959-c69742a44f67 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:53.163040 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-1aee1f4a-2f82-4378-9959-c69742a44f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:53.206737 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:53.292119 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aee1f4a-2f82-4378-9959-c69742a44f67 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:53.386346 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec44d9-0a7a-41ea-b34a-379c93fcb51a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:53.386971 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec44d9-0a7a-41ea-b34a-379c93fcb51a service neutron] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:53.387243 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec44d9-0a7a-41ea-b34a-379c93fcb51a service neutron] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:53.387501 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec44d9-0a7a-41ea-b34a-379c93fcb51a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:53.389264 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-7cec44d9-0a7a-41ea-b34a-379c93fcb51a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:53.488439 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:53.524578 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec44d9-0a7a-41ea-b34a-379c93fcb51a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:53.526278 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec44d9-0a7a-41ea-b34a-379c93fcb51a service neutron] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:53.550012 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 742/1490] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:23:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:23:55.889519 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d14f3a-fcf2-497f-8099-3c3506147314 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:55.890147 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d14f3a-fcf2-497f-8099-3c3506147314 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:55.890905 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d14f3a-fcf2-497f-8099-3c3506147314 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:55.893526 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 749/1491] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 30 04:23:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:23:55.899883 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90abf4ee-abf1-4d81-a10d-d8d629acd734 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:55.900770 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90abf4ee-abf1-4d81-a10d-d8d629acd734 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:55.900770 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90abf4ee-abf1-4d81-a10d-d8d629acd734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:55.997318 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-90abf4ee-abf1-4d81-a10d-d8d629acd734 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:55.998815 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-90abf4ee-abf1-4d81-a10d-d8d629acd734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:56.115456 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 743/1492] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 30 04:23:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:23:56.410741 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d14f3a-fcf2-497f-8099-3c3506147314 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:56.412541 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-e7d14f3a-fcf2-497f-8099-3c3506147314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:56.534225 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d14f3a-fcf2-497f-8099-3c3506147314 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:56.623012 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd8276-91ed-4133-91dd-d096daa037dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:56.623644 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd8276-91ed-4133-91dd-d096daa037dc service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:56.623954 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd8276-91ed-4133-91dd-d096daa037dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:56.624214 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd8276-91ed-4133-91dd-d096daa037dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:56.625889 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-37cd8276-91ed-4133-91dd-d096daa037dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:56.637497 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:56.757786 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cd8276-91ed-4133-91dd-d096daa037dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:56.759229 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cd8276-91ed-4133-91dd-d096daa037dc service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:56.782696 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 750/1493] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:23:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:24:06.112915 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=82 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:06.779974 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=50 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:25:18.282005 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381ad41-12b0-4c02-82cb-7681c4aade75 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:18.282960 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381ad41-12b0-4c02-82cb-7681c4aade75 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:18.282960 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381ad41-12b0-4c02-82cb-7681c4aade75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:18.403378 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-6381ad41-12b0-4c02-82cb-7681c4aade75 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:25:18.404693 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-6381ad41-12b0-4c02-82cb-7681c4aade75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:25:18.546076 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 744/1494] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:25:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:25:18.555495 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ce894-545f-4e23-b190-2bbcc56f0f5f None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:18.556216 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ce894-545f-4e23-b190-2bbcc56f0f5f None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:18.556216 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ce894-545f-4e23-b190-2bbcc56f0f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:18.580589 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-ec9ce894-545f-4e23-b190-2bbcc56f0f5f None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:25:18.582274 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-ec9ce894-545f-4e23-b190-2bbcc56f0f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:25:18.592409 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 751/1495] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:25:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:25:18.598817 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6381ad41-12b0-4c02-82cb-7681c4aade75 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:25:18.609312 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6381ad41-12b0-4c02-82cb-7681c4aade75 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:25:18.615392 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81762191-719e-40aa-9e0e-560a7fce30c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:25:18.616455 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81762191-719e-40aa-9e0e-560a7fce30c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:18.616794 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81762191-719e-40aa-9e0e-560a7fce30c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:18.617128 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81762191-719e-40aa-9e0e-560a7fce30c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:18.617878 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81762191-719e-40aa-9e0e-560a7fce30c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:25:18.618233 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81762191-719e-40aa-9e0e-560a7fce30c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:25:18.620095 dv-cinder-854265-2-smb devstack@keystone.service[81547]: WARNING py.warnings [None req-81762191-719e-40aa-9e0e-560a7fce30c1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:25:18.620095 dv-cinder-854265-2-smb devstack@keystone.service[81547]: warnings.warn(msg) Aug 30 04:25:18.620095 dv-cinder-854265-2-smb devstack@keystone.service[81547]: Aug 30 04:25:18.621841 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81762191-719e-40aa-9e0e-560a7fce30c1 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:25:18.637122 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 745/1496] 10.222.0.91 () {58 vars in 1153 bytes} [Tue Aug 30 04:25:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:25:18.647223 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ce894-545f-4e23-b190-2bbcc56f0f5f None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:25:18.658217 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ce894-545f-4e23-b190-2bbcc56f0f5f None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:25:18.665038 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f5919b-2b27-4535-a6cf-da9fbe72e111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:25:18.665819 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5919b-2b27-4535-a6cf-da9fbe72e111 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:18.666271 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5919b-2b27-4535-a6cf-da9fbe72e111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:18.666731 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5919b-2b27-4535-a6cf-da9fbe72e111 admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:18.667521 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f5919b-2b27-4535-a6cf-da9fbe72e111 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:25:18.669504 dv-cinder-854265-2-smb devstack@keystone.service[81546]: WARNING py.warnings [None req-83f5919b-2b27-4535-a6cf-da9fbe72e111 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:25:18.669504 dv-cinder-854265-2-smb devstack@keystone.service[81546]: warnings.warn(msg) Aug 30 04:25:18.669504 dv-cinder-854265-2-smb devstack@keystone.service[81546]: Aug 30 04:25:18.670848 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f5919b-2b27-4535-a6cf-da9fbe72e111 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:25:18.723747 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 752/1497] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:25:18 2022] POST /identity/v3/projects => generated 377 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:25:18.728491 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81762191-719e-40aa-9e0e-560a7fce30c1 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:25:18.740030 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81762191-719e-40aa-9e0e-560a7fce30c1 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:25:18.801272 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:25:18.809477 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa785dc-27f8-4a05-89e1-51f928d85be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:25:18.810164 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa785dc-27f8-4a05-89e1-51f928d85be3 admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:18.810590 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa785dc-27f8-4a05-89e1-51f928d85be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:18.811046 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa785dc-27f8-4a05-89e1-51f928d85be3 admin admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:18.812213 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa785dc-27f8-4a05-89e1-51f928d85be3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:25:18.813390 dv-cinder-854265-2-smb devstack@keystone.service[81547]: WARNING py.warnings [None req-cfa785dc-27f8-4a05-89e1-51f928d85be3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:25:18.813390 dv-cinder-854265-2-smb devstack@keystone.service[81547]: warnings.warn(msg) Aug 30 04:25:18.813390 dv-cinder-854265-2-smb devstack@keystone.service[81547]: Aug 30 04:25:18.814755 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa785dc-27f8-4a05-89e1-51f928d85be3 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:25:18.841047 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 746/1498] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:25:18 2022] POST /identity/v3/users => generated 289 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:25:18.846447 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f5919b-2b27-4535-a6cf-da9fbe72e111 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:25:18.858984 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f5919b-2b27-4535-a6cf-da9fbe72e111 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:25:18.865288 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6293bbbe-9acd-4332-a347-bedc530e8626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:25:18.865940 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293bbbe-9acd-4332-a347-bedc530e8626 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:18.866195 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293bbbe-9acd-4332-a347-bedc530e8626 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:18.866462 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293bbbe-9acd-4332-a347-bedc530e8626 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:18.867189 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6293bbbe-9acd-4332-a347-bedc530e8626 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:25:18.868241 dv-cinder-854265-2-smb devstack@keystone.service[81546]: WARNING py.warnings [None req-6293bbbe-9acd-4332-a347-bedc530e8626 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:25:18.868241 dv-cinder-854265-2-smb devstack@keystone.service[81546]: warnings.warn(msg) Aug 30 04:25:18.868241 dv-cinder-854265-2-smb devstack@keystone.service[81546]: Aug 30 04:25:18.869145 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6293bbbe-9acd-4332-a347-bedc530e8626 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:25:18.887672 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 753/1499] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:25:18 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:25:18.892407 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa785dc-27f8-4a05-89e1-51f928d85be3 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:25:18.904054 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa785dc-27f8-4a05-89e1-51f928d85be3 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:25:18.909868 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae1a7ec-fe2d-4036-916c-ead34b5c6214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:25:18.910667 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1a7ec-fe2d-4036-916c-ead34b5c6214 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:18.910974 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1a7ec-fe2d-4036-916c-ead34b5c6214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:18.911388 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1a7ec-fe2d-4036-916c-ead34b5c6214 admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:18.912609 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae1a7ec-fe2d-4036-916c-ead34b5c6214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:25:18.913717 dv-cinder-854265-2-smb devstack@keystone.service[81547]: WARNING py.warnings [None req-aae1a7ec-fe2d-4036-916c-ead34b5c6214 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:25:18.913717 dv-cinder-854265-2-smb devstack@keystone.service[81547]: warnings.warn(msg) Aug 30 04:25:18.913717 dv-cinder-854265-2-smb devstack@keystone.service[81547]: Aug 30 04:25:18.914772 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae1a7ec-fe2d-4036-916c-ead34b5c6214 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:25:18.931749 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 747/1500] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:25:18 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:25:18.938822 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6293bbbe-9acd-4332-a347-bedc530e8626 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:25:18.956922 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6293bbbe-9acd-4332-a347-bedc530e8626 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:25:18.965343 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b293b-9c44-4b00-8630-6bb8064bcb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:25:18.966497 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b293b-9c44-4b00-8630-6bb8064bcb2e admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:18.966976 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b293b-9c44-4b00-8630-6bb8064bcb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:18.967454 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b293b-9c44-4b00-8630-6bb8064bcb2e admin admin] PATH_INFO: `/v3/projects/125affeb98474407b6fe5da889417159/users/b4c4944601d84e65ad023d5d29a64794/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:18.996058 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48b293b-9c44-4b00-8630-6bb8064bcb2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=125affeb98474407b6fe5da889417159, user_id=b4c4944601d84e65ad023d5d29a64794, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:25:18.998054 dv-cinder-854265-2-smb devstack@keystone.service[81546]: WARNING py.warnings [None req-c48b293b-9c44-4b00-8630-6bb8064bcb2e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:25:18.998054 dv-cinder-854265-2-smb devstack@keystone.service[81546]: warnings.warn(msg) Aug 30 04:25:18.998054 dv-cinder-854265-2-smb devstack@keystone.service[81546]: Aug 30 04:25:19.002073 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48b293b-9c44-4b00-8630-6bb8064bcb2e admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:25:19.023100 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 754/1501] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:25:18 2022] PUT /identity/v3/projects/125affeb98474407b6fe5da889417159/users/b4c4944601d84e65ad023d5d29a64794/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:25:19.036847 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee62f58-3aaa-4d35-b28d-c5c349697ca4 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:19.037624 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee62f58-3aaa-4d35-b28d-c5c349697ca4 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:19.038109 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee62f58-3aaa-4d35-b28d-c5c349697ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:19.076047 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-bee62f58-3aaa-4d35-b28d-c5c349697ca4 None None] MFA Rules not processed for user `b4c4944601d84e65ad023d5d29a64794`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:25:19.077313 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-bee62f58-3aaa-4d35-b28d-c5c349697ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:25:19.186219 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 748/1502] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:25:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:25:19.202093 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae8f10-1c59-4df8-89c0-73806519c2d2 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:19.202385 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae8f10-1c59-4df8-89c0-73806519c2d2 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:19.202738 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae8f10-1c59-4df8-89c0-73806519c2d2 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:19.204373 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 755/1503] 10.222.0.91 () {54 vars in 964 bytes} [Tue Aug 30 04:25:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:25:19.210936 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d640b6d-fdec-4aec-b95e-d7fe9b163f0a None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:19.211391 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d640b6d-fdec-4aec-b95e-d7fe9b163f0a None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:19.211755 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d640b6d-fdec-4aec-b95e-d7fe9b163f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:19.290360 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-4d640b6d-fdec-4aec-b95e-d7fe9b163f0a None None] MFA Rules not processed for user `812abdd745f149e6a0166cd9040f28e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:25:19.291669 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-4d640b6d-fdec-4aec-b95e-d7fe9b163f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:25:19.422459 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 749/1504] 10.222.0.91 () {58 vars in 1061 bytes} [Tue Aug 30 04:25:19 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:25:19.437063 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afae8f10-1c59-4df8-89c0-73806519c2d2 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:25:19.450320 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afae8f10-1c59-4df8-89c0-73806519c2d2 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:25:19.454737 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba99f0f3-149b-4158-8903-84e1c0365084 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:25:19.455360 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99f0f3-149b-4158-8903-84e1c0365084 service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:19.455631 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99f0f3-149b-4158-8903-84e1c0365084 service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:19.455897 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99f0f3-149b-4158-8903-84e1c0365084 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:19.466362 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba99f0f3-149b-4158-8903-84e1c0365084 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:25:19.467834 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba99f0f3-149b-4158-8903-84e1c0365084 service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:25:19.478946 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 756/1505] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:25:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:25:19.539069 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b4334-b9cf-4a98-bd00-09d74de8d9d7 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:19.539442 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b4334-b9cf-4a98-bd00-09d74de8d9d7 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:19.539700 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b4334-b9cf-4a98-bd00-09d74de8d9d7 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:19.541285 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 750/1506] 10.222.0.91 () {52 vars in 830 bytes} [Tue Aug 30 04:25:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:25:19.545694 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba99f0f3-149b-4158-8903-84e1c0365084 service cinder] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:25:19.625778 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba99f0f3-149b-4158-8903-84e1c0365084 service cinder] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:25:19.632138 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755d2530-132f-4884-9162-6836a04d87ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:25:19.632939 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d2530-132f-4884-9162-6836a04d87ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:19.633258 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d2530-132f-4884-9162-6836a04d87ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:19.633566 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d2530-132f-4884-9162-6836a04d87ce admin admin] PATH_INFO: `/v3/users/b4c4944601d84e65ad023d5d29a64794` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:19.634919 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755d2530-132f-4884-9162-6836a04d87ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4c4944601d84e65ad023d5d29a64794)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:25:19.636432 dv-cinder-854265-2-smb devstack@keystone.service[81546]: WARNING py.warnings [None req-755d2530-132f-4884-9162-6836a04d87ce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:25:19.636432 dv-cinder-854265-2-smb devstack@keystone.service[81546]: warnings.warn(msg) Aug 30 04:25:19.636432 dv-cinder-854265-2-smb devstack@keystone.service[81546]: Aug 30 04:25:19.638004 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755d2530-132f-4884-9162-6836a04d87ce admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:25:19.737859 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-755d2530-132f-4884-9162-6836a04d87ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4c4944601d84e65ad023d5d29a64794'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:25:19.761936 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-755d2530-132f-4884-9162-6836a04d87ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4c4944601d84e65ad023d5d29a64794'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:25:19.775161 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-755d2530-132f-4884-9162-6836a04d87ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4c4944601d84e65ad023d5d29a64794'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:25:19.775851 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-755d2530-132f-4884-9162-6836a04d87ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4c4944601d84e65ad023d5d29a64794'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:25:19.804368 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:25:19.808338 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-755d2530-132f-4884-9162-6836a04d87ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4c4944601d84e65ad023d5d29a64794'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:25:19.817999 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 757/1507] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:25:19 2022] DELETE /identity/v3/users/b4c4944601d84e65ad023d5d29a64794 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:25:19.823230 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4280e0df-41b9-436a-abd2-b8c0d2bd3405 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:19.823659 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4280e0df-41b9-436a-abd2-b8c0d2bd3405 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:19.824108 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4280e0df-41b9-436a-abd2-b8c0d2bd3405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:19.846368 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-4280e0df-41b9-436a-abd2-b8c0d2bd3405 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:25:19.847759 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-4280e0df-41b9-436a-abd2-b8c0d2bd3405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:25:19.859480 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:25:19.930454 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 751/1508] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:25:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:25:19.941394 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755d2530-132f-4884-9162-6836a04d87ce admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:25:19.942961 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-755d2530-132f-4884-9162-6836a04d87ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:25:20.056026 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755d2530-132f-4884-9162-6836a04d87ce admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:25:20.060061 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5e8f9e-5cca-4e70-be22-dcf6b03c956e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:25:20.060806 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e8f9e-5cca-4e70-be22-dcf6b03c956e service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:20.061116 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e8f9e-5cca-4e70-be22-dcf6b03c956e service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:20.061431 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e8f9e-5cca-4e70-be22-dcf6b03c956e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:20.074969 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5e8f9e-5cca-4e70-be22-dcf6b03c956e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:25:20.076497 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5e8f9e-5cca-4e70-be22-dcf6b03c956e service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:25:20.087625 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 758/1509] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:25:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:25:20.769883 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4280e0df-41b9-436a-abd2-b8c0d2bd3405 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:25:20.774769 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-4280e0df-41b9-436a-abd2-b8c0d2bd3405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:25:20.801680 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4280e0df-41b9-436a-abd2-b8c0d2bd3405 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:25:20.810238 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb17cb05-c080-4987-b215-d15412c52c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:25:20.811341 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17cb05-c080-4987-b215-d15412c52c21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:20.811832 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17cb05-c080-4987-b215-d15412c52c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:20.812782 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17cb05-c080-4987-b215-d15412c52c21 admin admin] PATH_INFO: `/v3/projects/125affeb98474407b6fe5da889417159` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:20.816097 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb17cb05-c080-4987-b215-d15412c52c21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=125affeb98474407b6fe5da889417159)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:25:20.818464 dv-cinder-854265-2-smb devstack@keystone.service[81547]: WARNING py.warnings [None req-cb17cb05-c080-4987-b215-d15412c52c21 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:25:20.818464 dv-cinder-854265-2-smb devstack@keystone.service[81547]: warnings.warn(msg) Aug 30 04:25:20.818464 dv-cinder-854265-2-smb devstack@keystone.service[81547]: Aug 30 04:25:20.822316 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb17cb05-c080-4987-b215-d15412c52c21 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:25:20.933993 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-cb17cb05-c080-4987-b215-d15412c52c21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '125affeb98474407b6fe5da889417159', 'request_id': 'req-cb17cb05-c080-4987-b215-d15412c52c21'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:25:21.088468 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-cb17cb05-c080-4987-b215-d15412c52c21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '125affeb98474407b6fe5da889417159', 'request_id': 'req-cb17cb05-c080-4987-b215-d15412c52c21'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:25:21.102399 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-cb17cb05-c080-4987-b215-d15412c52c21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '125affeb98474407b6fe5da889417159', 'request_id': 'req-cb17cb05-c080-4987-b215-d15412c52c21'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:25:21.118802 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-cb17cb05-c080-4987-b215-d15412c52c21 admin admin] The token cache is being invalidate because project 125affeb98474407b6fe5da889417159 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:25:21.119097 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-cb17cb05-c080-4987-b215-d15412c52c21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:25:21.119875 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-cb17cb05-c080-4987-b215-d15412c52c21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:25:21.121935 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 752/1510] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:25:20 2022] DELETE /identity/v3/projects/125affeb98474407b6fe5da889417159 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:25:30.082886 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:DELETE=1,keystone:SELECT=37 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:25:31.114534 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:01.711418 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f331017-c0b6-4431-aaf1-8ec0be4b446a None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:01.712085 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f331017-c0b6-4431-aaf1-8ec0be4b446a None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:01.712085 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f331017-c0b6-4431-aaf1-8ec0be4b446a None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:01.713534 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 759/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 04:27:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:27:01.719200 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08d09d-b016-42f5-9a97-62e6b7396531 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:01.719781 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08d09d-b016-42f5-9a97-62e6b7396531 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:01.719781 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08d09d-b016-42f5-9a97-62e6b7396531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:01.741436 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-1b08d09d-b016-42f5-9a97-62e6b7396531 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:27:01.742791 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-1b08d09d-b016-42f5-9a97-62e6b7396531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:01.824768 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 753/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 04:27:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:27:01.982030 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f331017-c0b6-4431-aaf1-8ec0be4b446a None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:01.983833 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-1f331017-c0b6-4431-aaf1-8ec0be4b446a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:02.102989 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f331017-c0b6-4431-aaf1-8ec0be4b446a None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:02.109643 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd17906-07bf-4794-a4c9-3560d04c794e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd806295278ae4997b5c6968aa553290c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:02.110442 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd17906-07bf-4794-a4c9-3560d04c794e service nova] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:02.110810 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd17906-07bf-4794-a4c9-3560d04c794e service nova] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:02.111173 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd17906-07bf-4794-a4c9-3560d04c794e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:02.122869 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd17906-07bf-4794-a4c9-3560d04c794e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:02.124738 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd17906-07bf-4794-a4c9-3560d04c794e service nova] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:02.136581 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 760/1513] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:27:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:27:03.068683 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef8ae0-8726-4448-9b40-ccf318f55c18 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:03.069275 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef8ae0-8726-4448-9b40-ccf318f55c18 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:03.069275 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef8ae0-8726-4448-9b40-ccf318f55c18 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:03.070894 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 754/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 04:27:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:27:03.079348 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca3e77c-1d3f-4322-b251-ebceb2190145 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:03.080066 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca3e77c-1d3f-4322-b251-ebceb2190145 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:03.080290 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca3e77c-1d3f-4322-b251-ebceb2190145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:03.109823 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-dca3e77c-1d3f-4322-b251-ebceb2190145 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:27:03.111989 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-dca3e77c-1d3f-4322-b251-ebceb2190145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:03.124792 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 761/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 04:27:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:27:03.298517 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ef8ae0-8726-4448-9b40-ccf318f55c18 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:03.324354 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ef8ae0-8726-4448-9b40-ccf318f55c18 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:03.334123 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df60b5a4-3e08-43f0-a2a4-9bf34028c045 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd806295278ae4997b5c6968aa553290c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:03.334815 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df60b5a4-3e08-43f0-a2a4-9bf34028c045 service nova] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:03.335088 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df60b5a4-3e08-43f0-a2a4-9bf34028c045 service nova] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:03.335350 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df60b5a4-3e08-43f0-a2a4-9bf34028c045 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:03.346976 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df60b5a4-3e08-43f0-a2a4-9bf34028c045 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:03.348754 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df60b5a4-3e08-43f0-a2a4-9bf34028c045 service nova] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:03.360211 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 755/1516] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:27:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:27:03.436234 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08ff4a-59a2-4478-b69b-c1d3a5dfc49d None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:03.436522 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08ff4a-59a2-4478-b69b-c1d3a5dfc49d None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:03.436853 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08ff4a-59a2-4478-b69b-c1d3a5dfc49d None None] PATH_INFO: `/v3` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:03.438207 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 762/1517] 10.222.0.83 () {54 vars in 925 bytes} [Tue Aug 30 04:27:03 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:27:03.446896 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493249e7-3fa1-4ff6-8aea-2581c278db30 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:03.447516 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493249e7-3fa1-4ff6-8aea-2581c278db30 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:03.448088 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493249e7-3fa1-4ff6-8aea-2581c278db30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:03.515161 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-493249e7-3fa1-4ff6-8aea-2581c278db30 None None] MFA Rules not processed for user `47a092fbe1334f7e9ae4ba9bdb5e9f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:27:03.516433 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-493249e7-3fa1-4ff6-8aea-2581c278db30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:03.621074 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 756/1518] 10.222.0.83 () {58 vars in 1015 bytes} [Tue Aug 30 04:27:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:27:12.813862 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8e67c-60c4-4768-8c14-804065b5a4b5 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:12.814455 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8e67c-60c4-4768-8c14-804065b5a4b5 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:12.814455 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8e67c-60c4-4768-8c14-804065b5a4b5 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:12.816163 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 763/1519] 10.222.0.91 () {54 vars in 961 bytes} [Tue Aug 30 04:27:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:27:12.822039 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99afcd8-02b1-4ba1-91a8-178d2c192259 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:12.822585 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99afcd8-02b1-4ba1-91a8-178d2c192259 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:12.822585 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99afcd8-02b1-4ba1-91a8-178d2c192259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:12.852570 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-b99afcd8-02b1-4ba1-91a8-178d2c192259 None None] MFA Rules not processed for user `47a092fbe1334f7e9ae4ba9bdb5e9f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:27:12.854682 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-b99afcd8-02b1-4ba1-91a8-178d2c192259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:12.869202 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 757/1520] 10.222.0.91 () {58 vars in 1058 bytes} [Tue Aug 30 04:27:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:27:12.877093 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b8e67c-60c4-4768-8c14-804065b5a4b5 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:12.895208 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b8e67c-60c4-4768-8c14-804065b5a4b5 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:12.911050 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec4d0b0-40a1-4c59-858a-635b934dd09f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47a092fbe1334f7e9ae4ba9bdb5e9f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:12.912186 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4d0b0-40a1-4c59-858a-635b934dd09f service placement] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:12.912440 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4d0b0-40a1-4c59-858a-635b934dd09f service placement] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:12.912736 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4d0b0-40a1-4c59-858a-635b934dd09f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:12.922721 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec4d0b0-40a1-4c59-858a-635b934dd09f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:12.925013 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec4d0b0-40a1-4c59-858a-635b934dd09f service placement] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:12.937849 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 764/1521] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:27:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:27:14.696492 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186862f-b577-4ff0-9dc1-c720b66915f3 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:14.697187 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186862f-b577-4ff0-9dc1-c720b66915f3 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:14.697187 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186862f-b577-4ff0-9dc1-c720b66915f3 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:14.698439 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 758/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 04:27:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:27:14.704125 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7182a35-9980-498c-8424-53bea42aa55d None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:14.704683 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7182a35-9980-498c-8424-53bea42aa55d None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:14.704683 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7182a35-9980-498c-8424-53bea42aa55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:14.724977 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-b7182a35-9980-498c-8424-53bea42aa55d None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:27:14.726198 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-b7182a35-9980-498c-8424-53bea42aa55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:14.734355 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 765/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 04:27:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:27:14.899058 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4186862f-b577-4ff0-9dc1-c720b66915f3 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:14.915075 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4186862f-b577-4ff0-9dc1-c720b66915f3 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:14.920905 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bdbd29-d037-449b-87e6-e5a1fccbf4bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd806295278ae4997b5c6968aa553290c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:14.921568 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdbd29-d037-449b-87e6-e5a1fccbf4bd service nova] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:14.921825 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdbd29-d037-449b-87e6-e5a1fccbf4bd service nova] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:14.922070 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdbd29-d037-449b-87e6-e5a1fccbf4bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:14.931544 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bdbd29-d037-449b-87e6-e5a1fccbf4bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:14.933443 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bdbd29-d037-449b-87e6-e5a1fccbf4bd service nova] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:14.945801 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 759/1524] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:27:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:27:15.788359 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6cd0c-f8dc-4f1f-8bd8-1c307a71bedf None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:15.788990 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6cd0c-f8dc-4f1f-8bd8-1c307a71bedf None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:15.788990 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6cd0c-f8dc-4f1f-8bd8-1c307a71bedf None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:15.790295 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 766/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 04:27:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:27:15.795793 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a368d-40d5-4179-ab2c-4962fd8f868e None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:15.796387 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a368d-40d5-4179-ab2c-4962fd8f868e None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:15.796387 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a368d-40d5-4179-ab2c-4962fd8f868e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:15.817450 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-6d4a368d-40d5-4179-ab2c-4962fd8f868e None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:27:15.818685 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-6d4a368d-40d5-4179-ab2c-4962fd8f868e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:15.827115 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 760/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 04:27:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:27:15.983446 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f6cd0c-f8dc-4f1f-8bd8-1c307a71bedf None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:16.003373 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f6cd0c-f8dc-4f1f-8bd8-1c307a71bedf None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:16.010040 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c63db1-68cb-49ad-ad5f-de79f21bb3af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd806295278ae4997b5c6968aa553290c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:16.010659 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c63db1-68cb-49ad-ad5f-de79f21bb3af service nova] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:16.010935 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c63db1-68cb-49ad-ad5f-de79f21bb3af service nova] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:16.011178 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c63db1-68cb-49ad-ad5f-de79f21bb3af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:16.021181 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c63db1-68cb-49ad-ad5f-de79f21bb3af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:16.022787 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c63db1-68cb-49ad-ad5f-de79f21bb3af service nova] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:16.033082 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 767/1527] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:27:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:27:20.154806 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e84b6-dc8c-4a3d-b621-f1fc2cf7560f None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:20.155503 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e84b6-dc8c-4a3d-b621-f1fc2cf7560f None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:20.155503 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e84b6-dc8c-4a3d-b621-f1fc2cf7560f None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:20.156783 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 761/1528] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 04:27:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:27:20.166793 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd90d37-2bd1-4ab4-8462-df7ea1c7f557 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:20.167390 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd90d37-2bd1-4ab4-8462-df7ea1c7f557 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:20.167754 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd90d37-2bd1-4ab4-8462-df7ea1c7f557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:20.198014 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-7cd90d37-2bd1-4ab4-8462-df7ea1c7f557 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:27:20.199384 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-7cd90d37-2bd1-4ab4-8462-df7ea1c7f557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:20.208323 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 768/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 04:27:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:27:20.502968 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071e84b6-dc8c-4a3d-b621-f1fc2cf7560f None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:20.505433 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-071e84b6-dc8c-4a3d-b621-f1fc2cf7560f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:20.554783 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:20.608949 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071e84b6-dc8c-4a3d-b621-f1fc2cf7560f None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:20.615592 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a215cb2-b077-4b3a-bc86-7b7850e4b328 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:20.616631 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a215cb2-b077-4b3a-bc86-7b7850e4b328 service neutron] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:20.617031 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a215cb2-b077-4b3a-bc86-7b7850e4b328 service neutron] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:20.617426 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a215cb2-b077-4b3a-bc86-7b7850e4b328 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:20.634069 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a215cb2-b077-4b3a-bc86-7b7850e4b328 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:20.636885 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a215cb2-b077-4b3a-bc86-7b7850e4b328 service neutron] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:20.655329 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 762/1530] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:27:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:27:22.716854 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab95e0-aa4b-44ce-be3c-09613e832028 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:22.717861 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab95e0-aa4b-44ce-be3c-09613e832028 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:22.717861 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab95e0-aa4b-44ce-be3c-09613e832028 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:22.718898 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 769/1531] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 04:27:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:27:22.725552 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f65fd-0fe0-48d5-bc42-9f660affe9e7 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:22.726253 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f65fd-0fe0-48d5-bc42-9f660affe9e7 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:22.726253 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f65fd-0fe0-48d5-bc42-9f660affe9e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:22.748399 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-e40f65fd-0fe0-48d5-bc42-9f660affe9e7 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:27:22.749669 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-e40f65fd-0fe0-48d5-bc42-9f660affe9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:22.759447 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 763/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 04:27:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:27:23.061204 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab95e0-aa4b-44ce-be3c-09613e832028 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:23.080339 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab95e0-aa4b-44ce-be3c-09613e832028 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:23.086514 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e452a1d0-3ad7-4393-b8eb-8ce6a2048ba8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:23.087564 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452a1d0-3ad7-4393-b8eb-8ce6a2048ba8 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:23.088078 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452a1d0-3ad7-4393-b8eb-8ce6a2048ba8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:23.088549 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452a1d0-3ad7-4393-b8eb-8ce6a2048ba8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:23.105118 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e452a1d0-3ad7-4393-b8eb-8ce6a2048ba8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:23.107959 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e452a1d0-3ad7-4393-b8eb-8ce6a2048ba8 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:23.126582 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 770/1533] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:27:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:27:27.100421 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a2568-7458-479b-a841-8ebbec9a08d8 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:27.101132 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a2568-7458-479b-a841-8ebbec9a08d8 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:27.101132 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a2568-7458-479b-a841-8ebbec9a08d8 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:27.102358 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 764/1534] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 04:27:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:27:27.111850 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd6324-0f74-4f40-9198-460f169c8c40 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:27.112563 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd6324-0f74-4f40-9198-460f169c8c40 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:27.113001 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd6324-0f74-4f40-9198-460f169c8c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:27.148036 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-05cd6324-0f74-4f40-9198-460f169c8c40 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:27:27.150379 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-05cd6324-0f74-4f40-9198-460f169c8c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:27.165279 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 771/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 04:27:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:27:27.790940 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a2568-7458-479b-a841-8ebbec9a08d8 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:27.792982 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-181a2568-7458-479b-a841-8ebbec9a08d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:27.866533 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a2568-7458-479b-a841-8ebbec9a08d8 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:27.870529 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d9babc-9635-4de3-a5f3-4839baf5bc16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:27.871225 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9babc-9635-4de3-a5f3-4839baf5bc16 service cinder] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:27.871513 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9babc-9635-4de3-a5f3-4839baf5bc16 service cinder] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:27.871777 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9babc-9635-4de3-a5f3-4839baf5bc16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:27.882879 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d9babc-9635-4de3-a5f3-4839baf5bc16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:27.884406 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d9babc-9635-4de3-a5f3-4839baf5bc16 service cinder] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:27.895082 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 765/1536] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:27:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:27:30.049476 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b1145a-9fab-4b28-92a8-dabe3b1ff374 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:30.050312 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b1145a-9fab-4b28-92a8-dabe3b1ff374 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:30.050312 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b1145a-9fab-4b28-92a8-dabe3b1ff374 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:30.051407 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 772/1537] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 04:27:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:27:30.057553 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442cf4b1-d835-41a1-a9e0-9c0e21e044e6 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:30.058180 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442cf4b1-d835-41a1-a9e0-9c0e21e044e6 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:30.058180 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442cf4b1-d835-41a1-a9e0-9c0e21e044e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:30.081261 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-442cf4b1-d835-41a1-a9e0-9c0e21e044e6 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:27:30.083103 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-442cf4b1-d835-41a1-a9e0-9c0e21e044e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:30.096793 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 766/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 04:27:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:27:30.861112 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b1145a-9fab-4b28-92a8-dabe3b1ff374 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:30.863992 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-41b1145a-9fab-4b28-92a8-dabe3b1ff374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:30.876136 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=77 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:30.886777 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b1145a-9fab-4b28-92a8-dabe3b1ff374 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:30.892994 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69d1751-fafe-47e8-bcd4-5fd69e7cc029 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:30.894034 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d1751-fafe-47e8-bcd4-5fd69e7cc029 service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:30.894542 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d1751-fafe-47e8-bcd4-5fd69e7cc029 service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:30.895087 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d1751-fafe-47e8-bcd4-5fd69e7cc029 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:30.912600 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69d1751-fafe-47e8-bcd4-5fd69e7cc029 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:30.915492 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69d1751-fafe-47e8-bcd4-5fd69e7cc029 service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:30.934454 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 773/1539] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:27:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:27:40.074981 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=47 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:40.925998 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=5 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:05.735136 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916ef9f-317a-4c76-b07e-de20235dfa27 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:05.735792 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916ef9f-317a-4c76-b07e-de20235dfa27 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:05.736107 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916ef9f-317a-4c76-b07e-de20235dfa27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:05.790537 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-f916ef9f-317a-4c76-b07e-de20235dfa27 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:05.793044 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-f916ef9f-317a-4c76-b07e-de20235dfa27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:05.815424 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 767/1540] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:29:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:05.829888 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8983da5-f25f-40fd-a470-4c5ab99cf0d9 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:05.830519 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8983da5-f25f-40fd-a470-4c5ab99cf0d9 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:05.830519 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8983da5-f25f-40fd-a470-4c5ab99cf0d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:05.866713 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-a8983da5-f25f-40fd-a470-4c5ab99cf0d9 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:05.868130 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-a8983da5-f25f-40fd-a470-4c5ab99cf0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:05.875064 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463f567-2a38-4c5b-afa0-e94b47549f57 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:05.875531 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463f567-2a38-4c5b-afa0-e94b47549f57 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:05.876031 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463f567-2a38-4c5b-afa0-e94b47549f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:05.887901 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 774/1541] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:29:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:05.894149 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8983da5-f25f-40fd-a470-4c5ab99cf0d9 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:05.919197 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8983da5-f25f-40fd-a470-4c5ab99cf0d9 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:05.934013 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5484ea1a-a0bb-400f-acc8-541dc782cf93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:05.934822 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484ea1a-a0bb-400f-acc8-541dc782cf93 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:05.935134 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484ea1a-a0bb-400f-acc8-541dc782cf93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:05.935582 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484ea1a-a0bb-400f-acc8-541dc782cf93 admin admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:05.936643 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5484ea1a-a0bb-400f-acc8-541dc782cf93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:29:05.937060 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5484ea1a-a0bb-400f-acc8-541dc782cf93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:05.938564 dv-cinder-854265-2-smb devstack@keystone.service[81546]: WARNING py.warnings [None req-5484ea1a-a0bb-400f-acc8-541dc782cf93 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:29:05.938564 dv-cinder-854265-2-smb devstack@keystone.service[81546]: warnings.warn(msg) Aug 30 04:29:05.938564 dv-cinder-854265-2-smb devstack@keystone.service[81546]: Aug 30 04:29:05.939477 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5484ea1a-a0bb-400f-acc8-541dc782cf93 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:05.942417 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-f463f567-2a38-4c5b-afa0-e94b47549f57 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:05.944475 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-f463f567-2a38-4c5b-afa0-e94b47549f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:05.971297 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 775/1542] 10.222.0.91 () {58 vars in 1153 bytes} [Tue Aug 30 04:29:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:29:05.976624 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 768/1543] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:29:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:29:05.987897 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5484ea1a-a0bb-400f-acc8-541dc782cf93 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:05.995300 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd199963-d787-4994-96a7-d6ff16c33aa5 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:05.995789 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd199963-d787-4994-96a7-d6ff16c33aa5 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:05.996327 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd199963-d787-4994-96a7-d6ff16c33aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:06.014471 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5484ea1a-a0bb-400f-acc8-541dc782cf93 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:06.038237 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef1163b-f33a-4a6d-b4ea-0823b029df2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:06.039228 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1163b-f33a-4a6d-b4ea-0823b029df2c admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:06.039507 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1163b-f33a-4a6d-b4ea-0823b029df2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:06.039779 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1163b-f33a-4a6d-b4ea-0823b029df2c admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:06.040634 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef1163b-f33a-4a6d-b4ea-0823b029df2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:06.042609 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef1163b-f33a-4a6d-b4ea-0823b029df2c admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:06.062270 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-cd199963-d787-4994-96a7-d6ff16c33aa5 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:06.063836 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-cd199963-d787-4994-96a7-d6ff16c33aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:06.091174 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 769/1544] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:29:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:29:06.095556 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd199963-d787-4994-96a7-d6ff16c33aa5 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:06.113070 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd199963-d787-4994-96a7-d6ff16c33aa5 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:06.129640 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d41d57-7dec-4220-a4fa-e1d120d2abaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:06.130294 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d41d57-7dec-4220-a4fa-e1d120d2abaf admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:06.130573 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d41d57-7dec-4220-a4fa-e1d120d2abaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:06.130838 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d41d57-7dec-4220-a4fa-e1d120d2abaf admin admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:06.131633 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d41d57-7dec-4220-a4fa-e1d120d2abaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:29:06.131966 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d41d57-7dec-4220-a4fa-e1d120d2abaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:06.134248 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d41d57-7dec-4220-a4fa-e1d120d2abaf admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:06.152724 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 776/1545] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:29:05 2022] POST /identity/v3/projects => generated 377 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:29:06.163002 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 770/1546] 10.222.0.91 () {58 vars in 1153 bytes} [Tue Aug 30 04:29:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:29:06.164015 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef1163b-f33a-4a6d-b4ea-0823b029df2c admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:06.180075 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d41d57-7dec-4220-a4fa-e1d120d2abaf admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:06.195153 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d41d57-7dec-4220-a4fa-e1d120d2abaf admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:06.327231 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef1163b-f33a-4a6d-b4ea-0823b029df2c admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:06.343848 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a28e86-b418-42e1-ab48-d4f50e197867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:06.344657 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a28e86-b418-42e1-ab48-d4f50e197867 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:06.344948 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a28e86-b418-42e1-ab48-d4f50e197867 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:06.345212 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a28e86-b418-42e1-ab48-d4f50e197867 admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:06.345870 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a28e86-b418-42e1-ab48-d4f50e197867 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:06.346940 dv-cinder-854265-2-smb devstack@keystone.service[81546]: WARNING py.warnings [None req-e4a28e86-b418-42e1-ab48-d4f50e197867 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:29:06.346940 dv-cinder-854265-2-smb devstack@keystone.service[81546]: warnings.warn(msg) Aug 30 04:29:06.346940 dv-cinder-854265-2-smb devstack@keystone.service[81546]: Aug 30 04:29:06.348907 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a28e86-b418-42e1-ab48-d4f50e197867 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:06.358091 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c385c188-b497-4516-aaf9-0570aa18e011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:06.358769 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385c188-b497-4516-aaf9-0570aa18e011 admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:06.359035 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385c188-b497-4516-aaf9-0570aa18e011 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:06.359298 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385c188-b497-4516-aaf9-0570aa18e011 admin admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:06.360003 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c385c188-b497-4516-aaf9-0570aa18e011 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:06.361688 dv-cinder-854265-2-smb devstack@keystone.service[81547]: WARNING py.warnings [None req-c385c188-b497-4516-aaf9-0570aa18e011 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:29:06.361688 dv-cinder-854265-2-smb devstack@keystone.service[81547]: warnings.warn(msg) Aug 30 04:29:06.361688 dv-cinder-854265-2-smb devstack@keystone.service[81547]: Aug 30 04:29:06.363860 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c385c188-b497-4516-aaf9-0570aa18e011 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:06.394524 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 777/1547] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:29:06 2022] POST /identity/v3/users => generated 289 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:29:06.401257 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a28e86-b418-42e1-ab48-d4f50e197867 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:06.421718 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a28e86-b418-42e1-ab48-d4f50e197867 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:06.438107 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1455410f-8333-4e46-bece-0bf2ef576d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:06.438701 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455410f-8333-4e46-bece-0bf2ef576d1e admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:06.439399 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455410f-8333-4e46-bece-0bf2ef576d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:06.439399 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455410f-8333-4e46-bece-0bf2ef576d1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:06.440058 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1455410f-8333-4e46-bece-0bf2ef576d1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:06.442962 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1455410f-8333-4e46-bece-0bf2ef576d1e admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:06.447596 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 771/1548] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:29:06 2022] POST /identity/v3/projects => generated 371 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:29:06.454792 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c385c188-b497-4516-aaf9-0570aa18e011 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:06.456588 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 778/1549] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:29:06.462678 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1455410f-8333-4e46-bece-0bf2ef576d1e admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:06.479884 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1455410f-8333-4e46-bece-0bf2ef576d1e admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:06.623372 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c385c188-b497-4516-aaf9-0570aa18e011 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:06.645796 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e12e7e-98d8-4135-bace-5aaf2a22cd0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:06.646868 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e12e7e-98d8-4135-bace-5aaf2a22cd0d admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:06.647366 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e12e7e-98d8-4135-bace-5aaf2a22cd0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:06.647829 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e12e7e-98d8-4135-bace-5aaf2a22cd0d admin admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:06.649084 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e12e7e-98d8-4135-bace-5aaf2a22cd0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:06.649862 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4befa21-7524-463e-ad84-dead517c0700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:06.651299 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4befa21-7524-463e-ad84-dead517c0700 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:06.652977 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e12e7e-98d8-4135-bace-5aaf2a22cd0d admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:06.653389 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4befa21-7524-463e-ad84-dead517c0700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:06.654183 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4befa21-7524-463e-ad84-dead517c0700 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:06.655444 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4befa21-7524-463e-ad84-dead517c0700 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:06.662403 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4befa21-7524-463e-ad84-dead517c0700 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:06.678947 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 779/1550] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:29:06.683459 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4befa21-7524-463e-ad84-dead517c0700 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:06.707471 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4befa21-7524-463e-ad84-dead517c0700 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:06.712117 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 772/1551] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:29:06 2022] POST /identity/v3/users => generated 286 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:29:06.718419 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e12e7e-98d8-4135-bace-5aaf2a22cd0d admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:06.719450 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edcfb1d-b005-493a-8d69-60fdcd20307a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:06.720521 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcfb1d-b005-493a-8d69-60fdcd20307a admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:06.721048 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcfb1d-b005-493a-8d69-60fdcd20307a admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:06.721644 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcfb1d-b005-493a-8d69-60fdcd20307a admin admin] PATH_INFO: `/v3/projects/0a8ee9d47bc94efca1f8c216349b0809/users/364abb1a054f45c3b95ac2f5714763a0/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:06.743963 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e12e7e-98d8-4135-bace-5aaf2a22cd0d admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:06.760279 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edcfb1d-b005-493a-8d69-60fdcd20307a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a8ee9d47bc94efca1f8c216349b0809, user_id=364abb1a054f45c3b95ac2f5714763a0, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:06.760543 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e619f403-cafc-4807-8366-fd7f0283b4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:06.761001 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e619f403-cafc-4807-8366-fd7f0283b4b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:06.761326 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e619f403-cafc-4807-8366-fd7f0283b4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:06.762007 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e619f403-cafc-4807-8366-fd7f0283b4b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:06.762950 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e619f403-cafc-4807-8366-fd7f0283b4b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:06.764896 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e619f403-cafc-4807-8366-fd7f0283b4b4 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:06.765516 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edcfb1d-b005-493a-8d69-60fdcd20307a admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:06.802037 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 773/1552] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:29:06.808675 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e619f403-cafc-4807-8366-fd7f0283b4b4 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:06.809124 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 780/1553] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:29:06 2022] PUT /identity/v3/projects/0a8ee9d47bc94efca1f8c216349b0809/users/364abb1a054f45c3b95ac2f5714763a0/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:29:06.813723 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9c989-ac1a-4b3e-a79c-3cfa5f208262 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:06.814378 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9c989-ac1a-4b3e-a79c-3cfa5f208262 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:06.814885 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9c989-ac1a-4b3e-a79c-3cfa5f208262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:06.837113 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e619f403-cafc-4807-8366-fd7f0283b4b4 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:06.847445 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-f7a9c989-ac1a-4b3e-a79c-3cfa5f208262 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:06.851140 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-f7a9c989-ac1a-4b3e-a79c-3cfa5f208262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:06.883584 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:06.959864 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:07.069530 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61624492-0504-4dbc-a0b6-5744378d3ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:07.073199 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61624492-0504-4dbc-a0b6-5744378d3ac3 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:07.075252 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61624492-0504-4dbc-a0b6-5744378d3ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:07.075796 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61624492-0504-4dbc-a0b6-5744378d3ac3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:07.076692 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61624492-0504-4dbc-a0b6-5744378d3ac3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:07.090917 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61624492-0504-4dbc-a0b6-5744378d3ac3 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:07.126312 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 774/1554] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:29:07.133044 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 781/1555] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:29:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:07.134190 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e36d1-74a9-4f1d-abcc-c80b4c17bb65 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:07.134678 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e36d1-74a9-4f1d-abcc-c80b4c17bb65 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:07.135012 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e36d1-74a9-4f1d-abcc-c80b4c17bb65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:07.142820 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a9c989-ac1a-4b3e-a79c-3cfa5f208262 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:07.171279 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a9c989-ac1a-4b3e-a79c-3cfa5f208262 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:07.197871 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4c9c5-f644-412f-996c-092c0017cbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:07.199047 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4c9c5-f644-412f-996c-092c0017cbc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:07.199492 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4c9c5-f644-412f-996c-092c0017cbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:07.200956 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4c9c5-f644-412f-996c-092c0017cbc9 admin admin] PATH_INFO: `/v3/projects/4e3490dfe4a640cfbe39a1071ea4e38a/users/b54289a9e0bc4e26a7e1ce9b94ee69ed/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:07.203371 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-5a7e36d1-74a9-4f1d-abcc-c80b4c17bb65 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:07.203371 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-5a7e36d1-74a9-4f1d-abcc-c80b4c17bb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:07.228781 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 775/1556] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:29:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:07.230221 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee22e10-9aad-450e-95e1-6bf9dbfa0ee1 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:07.231062 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee22e10-9aad-450e-95e1-6bf9dbfa0ee1 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:07.231455 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee22e10-9aad-450e-95e1-6bf9dbfa0ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:07.238761 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a4c9c5-f644-412f-996c-092c0017cbc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e3490dfe4a640cfbe39a1071ea4e38a, user_id=b54289a9e0bc4e26a7e1ce9b94ee69ed, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:07.243207 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a4c9c5-f644-412f-996c-092c0017cbc9 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:07.274590 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 782/1557] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:29:07 2022] PUT /identity/v3/projects/4e3490dfe4a640cfbe39a1071ea4e38a/users/b54289a9e0bc4e26a7e1ce9b94ee69ed/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:29:07.278416 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4c9c5-f644-412f-996c-092c0017cbc9 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:07.281484 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-4ee22e10-9aad-450e-95e1-6bf9dbfa0ee1 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:07.287625 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-4ee22e10-9aad-450e-95e1-6bf9dbfa0ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:07.393211 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 776/1558] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:29:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:07.395560 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b2668-cd14-44f6-9430-8de58b86d5cc None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:07.395834 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b2668-cd14-44f6-9430-8de58b86d5cc None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:07.396161 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b2668-cd14-44f6-9430-8de58b86d5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:07.399290 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4c9c5-f644-412f-996c-092c0017cbc9 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:07.404061 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af53c27b-79fc-481c-9d32-0271eb80bdec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:07.405102 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53c27b-79fc-481c-9d32-0271eb80bdec service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:07.405579 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53c27b-79fc-481c-9d32-0271eb80bdec service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:07.406376 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53c27b-79fc-481c-9d32-0271eb80bdec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:07.420468 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af53c27b-79fc-481c-9d32-0271eb80bdec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:07.422394 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af53c27b-79fc-481c-9d32-0271eb80bdec service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:07.428649 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-548b2668-cd14-44f6-9430-8de58b86d5cc None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:07.430557 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-548b2668-cd14-44f6-9430-8de58b86d5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:07.437526 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 783/1559] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:29:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:29:07.439587 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 777/1560] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:29:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:07.439817 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ca665-b15a-4e17-9cc2-b8645fd7dcb6 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:07.440277 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ca665-b15a-4e17-9cc2-b8645fd7dcb6 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:07.440739 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ca665-b15a-4e17-9cc2-b8645fd7dcb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:07.440888 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eebf34-dc4b-48b4-b26f-40a70cd22c6f None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:07.441122 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eebf34-dc4b-48b4-b26f-40a70cd22c6f None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:07.441416 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eebf34-dc4b-48b4-b26f-40a70cd22c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:07.472064 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-976ca665-b15a-4e17-9cc2-b8645fd7dcb6 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:07.475970 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-37eebf34-dc4b-48b4-b26f-40a70cd22c6f None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:07.476256 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-976ca665-b15a-4e17-9cc2-b8645fd7dcb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:07.476420 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-37eebf34-dc4b-48b4-b26f-40a70cd22c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:07.489567 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 778/1561] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:29:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:07.491639 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ec522-8173-4b19-a405-5bfcd4074ddf None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:07.492176 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ec522-8173-4b19-a405-5bfcd4074ddf None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:07.492669 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ec522-8173-4b19-a405-5bfcd4074ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:07.505540 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 784/1562] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:29:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:07.506986 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b98832-3e14-4ae2-a715-1d329024ef8f None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:07.507441 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b98832-3e14-4ae2-a715-1d329024ef8f None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:07.507982 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b98832-3e14-4ae2-a715-1d329024ef8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:07.541315 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-f03ec522-8173-4b19-a405-5bfcd4074ddf None None] MFA Rules not processed for user `b54289a9e0bc4e26a7e1ce9b94ee69ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:07.543014 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-f03ec522-8173-4b19-a405-5bfcd4074ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:07.551556 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-67b98832-3e14-4ae2-a715-1d329024ef8f None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:07.554217 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-67b98832-3e14-4ae2-a715-1d329024ef8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:07.568973 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 785/1563] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:29:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:07.580394 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c86304-a2cc-4bc0-8532-080a8c64942a None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:07.580394 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c86304-a2cc-4bc0-8532-080a8c64942a None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:07.580394 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c86304-a2cc-4bc0-8532-080a8c64942a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:07.620098 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-37c86304-a2cc-4bc0-8532-080a8c64942a None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:07.622812 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-37c86304-a2cc-4bc0-8532-080a8c64942a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:07.633918 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 786/1564] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:29:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:07.636553 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d69d8-0ec1-4c3d-bf6d-b3bbb285bab8 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:07.637411 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d69d8-0ec1-4c3d-bf6d-b3bbb285bab8 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:07.638085 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d69d8-0ec1-4c3d-bf6d-b3bbb285bab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:07.678328 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-705d69d8-0ec1-4c3d-bf6d-b3bbb285bab8 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:07.680430 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-705d69d8-0ec1-4c3d-bf6d-b3bbb285bab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:07.684299 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 779/1565] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:29:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:07.687557 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a662b3-83f5-4eb6-9517-c4b2de9cca22 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:07.690317 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a662b3-83f5-4eb6-9517-c4b2de9cca22 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:07.690784 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a662b3-83f5-4eb6-9517-c4b2de9cca22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:07.699993 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 787/1566] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:29:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:07.707382 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8904c-cf03-408b-8a09-b86b8269b717 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:07.707807 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8904c-cf03-408b-8a09-b86b8269b717 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:07.708279 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8904c-cf03-408b-8a09-b86b8269b717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:07.737211 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-02a662b3-83f5-4eb6-9517-c4b2de9cca22 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:07.739481 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-86b8904c-cf03-408b-8a09-b86b8269b717 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:07.741553 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-86b8904c-cf03-408b-8a09-b86b8269b717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:07.746012 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-02a662b3-83f5-4eb6-9517-c4b2de9cca22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:07.754884 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 788/1567] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:29:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:07.756326 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b8904c-cf03-408b-8a09-b86b8269b717 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:07.771023 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 780/1568] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:29:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:07.771023 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21dad86-7312-462b-ab52-ce1976eb2d43 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:07.771023 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21dad86-7312-462b-ab52-ce1976eb2d43 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:07.771023 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21dad86-7312-462b-ab52-ce1976eb2d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:07.787983 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b8904c-cf03-408b-8a09-b86b8269b717 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:07.811709 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2ff22-b310-492b-bd97-98d9489e6608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:07.813220 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2ff22-b310-492b-bd97-98d9489e6608 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:07.813833 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2ff22-b310-492b-bd97-98d9489e6608 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:07.815400 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2ff22-b310-492b-bd97-98d9489e6608 admin admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:07.817525 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c2ff22-b310-492b-bd97-98d9489e6608 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:29:07.818055 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c2ff22-b310-492b-bd97-98d9489e6608 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:07.821572 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c2ff22-b310-492b-bd97-98d9489e6608 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:07.822044 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-b21dad86-7312-462b-ab52-ce1976eb2d43 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:07.823033 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-b21dad86-7312-462b-ab52-ce1976eb2d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:07.834779 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 781/1569] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:29:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:07.841293 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538100e-b3a6-4472-9feb-4fa0f000eaad None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:07.841293 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538100e-b3a6-4472-9feb-4fa0f000eaad None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:07.841293 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538100e-b3a6-4472-9feb-4fa0f000eaad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:07.860029 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 789/1570] 10.222.0.91 () {58 vars in 1153 bytes} [Tue Aug 30 04:29:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:29:07.860029 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2ff22-b310-492b-bd97-98d9489e6608 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:07.867849 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-7538100e-b3a6-4472-9feb-4fa0f000eaad None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:07.870147 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-7538100e-b3a6-4472-9feb-4fa0f000eaad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:07.886046 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 782/1571] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:29:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:07.887462 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2ff22-b310-492b-bd97-98d9489e6608 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:07.887693 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7538100e-b3a6-4472-9feb-4fa0f000eaad None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:07.899214 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b266a3d0-e255-4990-bf84-2165c994fbec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:07.901638 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b266a3d0-e255-4990-bf84-2165c994fbec admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:07.902103 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b266a3d0-e255-4990-bf84-2165c994fbec admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:07.902557 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b266a3d0-e255-4990-bf84-2165c994fbec admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:07.903744 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b266a3d0-e255-4990-bf84-2165c994fbec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:07.907331 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b266a3d0-e255-4990-bf84-2165c994fbec admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:07.909255 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7538100e-b3a6-4472-9feb-4fa0f000eaad None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:07.917047 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ac8477-92dd-4c36-9f34-1414167102e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:07.918243 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac8477-92dd-4c36-9f34-1414167102e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:07.919051 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac8477-92dd-4c36-9f34-1414167102e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:07.919289 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac8477-92dd-4c36-9f34-1414167102e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:07.920425 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ac8477-92dd-4c36-9f34-1414167102e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:29:07.921086 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ac8477-92dd-4c36-9f34-1414167102e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:07.923264 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ac8477-92dd-4c36-9f34-1414167102e6 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:07.946437 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 783/1572] 10.222.0.91 () {58 vars in 1153 bytes} [Tue Aug 30 04:29:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:29:07.947698 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ac8477-92dd-4c36-9f34-1414167102e6 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:07.959754 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:07.966024 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ac8477-92dd-4c36-9f34-1414167102e6 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:07.972317 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 790/1573] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:29:07 2022] POST /identity/v3/projects => generated 371 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:29:07.977533 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b266a3d0-e255-4990-bf84-2165c994fbec admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:07.981114 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71026c1d-3147-4c62-bcfc-0f3063e57c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:07.982820 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71026c1d-3147-4c62-bcfc-0f3063e57c5c admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:07.982820 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71026c1d-3147-4c62-bcfc-0f3063e57c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:07.983600 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71026c1d-3147-4c62-bcfc-0f3063e57c5c admin admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:07.985306 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71026c1d-3147-4c62-bcfc-0f3063e57c5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:29:07.985803 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71026c1d-3147-4c62-bcfc-0f3063e57c5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:07.988815 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71026c1d-3147-4c62-bcfc-0f3063e57c5c admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:08.011564 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 784/1574] 10.222.0.91 () {58 vars in 1153 bytes} [Tue Aug 30 04:29:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:29:08.013443 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71026c1d-3147-4c62-bcfc-0f3063e57c5c admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:08.024329 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:08.027766 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71026c1d-3147-4c62-bcfc-0f3063e57c5c admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:08.125761 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b266a3d0-e255-4990-bf84-2165c994fbec admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:08.131836 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0af857-bdb2-44a9-951b-fa0d34e6e021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:08.132543 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0af857-bdb2-44a9-951b-fa0d34e6e021 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:08.132806 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0af857-bdb2-44a9-951b-fa0d34e6e021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:08.133211 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0af857-bdb2-44a9-951b-fa0d34e6e021 admin admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:08.133754 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0af857-bdb2-44a9-951b-fa0d34e6e021 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:29:08.134076 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0af857-bdb2-44a9-951b-fa0d34e6e021 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:08.135715 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0af857-bdb2-44a9-951b-fa0d34e6e021 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:08.143185 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126dea9a-b161-4474-ac9c-776936ae3008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:08.146092 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126dea9a-b161-4474-ac9c-776936ae3008 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:08.146605 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126dea9a-b161-4474-ac9c-776936ae3008 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:08.147029 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126dea9a-b161-4474-ac9c-776936ae3008 admin admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:08.149252 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126dea9a-b161-4474-ac9c-776936ae3008 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:29:08.150229 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126dea9a-b161-4474-ac9c-776936ae3008 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:08.161862 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 791/1575] 10.222.0.91 () {58 vars in 1153 bytes} [Tue Aug 30 04:29:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:29:08.161862 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0af857-bdb2-44a9-951b-fa0d34e6e021 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:08.162195 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126dea9a-b161-4474-ac9c-776936ae3008 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:08.180276 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0af857-bdb2-44a9-951b-fa0d34e6e021 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:08.180849 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 785/1576] 10.222.0.91 () {58 vars in 1153 bytes} [Tue Aug 30 04:29:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:29:08.182495 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126dea9a-b161-4474-ac9c-776936ae3008 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:08.188366 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d3b71-4ffb-4ab9-9c0d-d1c3d2c7fb15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:08.189382 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d3b71-4ffb-4ab9-9c0d-d1c3d2c7fb15 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:08.189832 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d3b71-4ffb-4ab9-9c0d-d1c3d2c7fb15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:08.190269 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d3b71-4ffb-4ab9-9c0d-d1c3d2c7fb15 admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:08.191600 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9d3b71-4ffb-4ab9-9c0d-d1c3d2c7fb15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:08.195008 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9d3b71-4ffb-4ab9-9c0d-d1c3d2c7fb15 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:08.206668 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126dea9a-b161-4474-ac9c-776936ae3008 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:08.214912 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5861dc-23d4-4a4c-b9bc-fdc3df547aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:08.216368 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5861dc-23d4-4a4c-b9bc-fdc3df547aaf admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:08.216970 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5861dc-23d4-4a4c-b9bc-fdc3df547aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:08.217376 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5861dc-23d4-4a4c-b9bc-fdc3df547aaf admin admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:08.219358 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5861dc-23d4-4a4c-b9bc-fdc3df547aaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:29:08.219689 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5861dc-23d4-4a4c-b9bc-fdc3df547aaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:08.224066 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5861dc-23d4-4a4c-b9bc-fdc3df547aaf admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:08.250738 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 792/1577] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:29:08 2022] POST /identity/v3/projects => generated 405 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:29:08.250738 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d3b71-4ffb-4ab9-9c0d-d1c3d2c7fb15 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:08.269451 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 786/1578] 10.222.0.91 () {58 vars in 1153 bytes} [Tue Aug 30 04:29:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:29:08.270847 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5861dc-23d4-4a4c-b9bc-fdc3df547aaf admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:08.284969 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5861dc-23d4-4a4c-b9bc-fdc3df547aaf admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:08.364555 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d3b71-4ffb-4ab9-9c0d-d1c3d2c7fb15 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:08.369910 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9dc0cb-e38f-43e1-b652-9589ca858b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:08.370922 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9dc0cb-e38f-43e1-b652-9589ca858b67 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:08.371183 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9dc0cb-e38f-43e1-b652-9589ca858b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:08.371459 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9dc0cb-e38f-43e1-b652-9589ca858b67 admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:08.372620 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9dc0cb-e38f-43e1-b652-9589ca858b67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:08.376117 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9dc0cb-e38f-43e1-b652-9589ca858b67 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:08.398752 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0368813e-5ec2-4145-a514-dc34b31ae12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:08.399436 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368813e-5ec2-4145-a514-dc34b31ae12a admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:08.399714 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368813e-5ec2-4145-a514-dc34b31ae12a admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:08.400024 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368813e-5ec2-4145-a514-dc34b31ae12a admin admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:08.400785 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0368813e-5ec2-4145-a514-dc34b31ae12a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:08.403168 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0368813e-5ec2-4145-a514-dc34b31ae12a admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:08.433390 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 793/1579] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:29:08 2022] POST /identity/v3/projects => generated 377 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:29:08.435069 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9dc0cb-e38f-43e1-b652-9589ca858b67 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:08.450418 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 787/1580] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:29:08 2022] POST /identity/v3/users => generated 292 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:29:08.452829 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0368813e-5ec2-4145-a514-dc34b31ae12a admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:08.475541 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0368813e-5ec2-4145-a514-dc34b31ae12a admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:08.577994 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098128c9-8731-4474-923e-4952efde7e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:08.578967 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098128c9-8731-4474-923e-4952efde7e6b admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:08.579424 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098128c9-8731-4474-923e-4952efde7e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:08.579628 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9dc0cb-e38f-43e1-b652-9589ca858b67 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:08.579810 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098128c9-8731-4474-923e-4952efde7e6b admin admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:08.580373 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098128c9-8731-4474-923e-4952efde7e6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:08.583659 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098128c9-8731-4474-923e-4952efde7e6b admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:08.588379 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d774b1e0-65b7-4585-9034-5b860e4abc4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:08.589433 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d774b1e0-65b7-4585-9034-5b860e4abc4f admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:08.589910 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d774b1e0-65b7-4585-9034-5b860e4abc4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:08.590616 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d774b1e0-65b7-4585-9034-5b860e4abc4f admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:08.591699 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d774b1e0-65b7-4585-9034-5b860e4abc4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:08.592512 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:08.595955 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d774b1e0-65b7-4585-9034-5b860e4abc4f admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:08.641169 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 794/1581] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:29:08 2022] POST /identity/v3/projects => generated 375 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:29:08.642203 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d774b1e0-65b7-4585-9034-5b860e4abc4f admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:08.654213 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:08.661472 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 788/1582] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:29:08 2022] POST /identity/v3/projects => generated 385 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:29:08.662357 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098128c9-8731-4474-923e-4952efde7e6b admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:08.776221 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d774b1e0-65b7-4585-9034-5b860e4abc4f admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:08.782572 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086ad27-5667-4517-821b-39b83a8b8fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:08.782877 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086ad27-5667-4517-821b-39b83a8b8fa7 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:08.783263 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086ad27-5667-4517-821b-39b83a8b8fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:08.783472 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086ad27-5667-4517-821b-39b83a8b8fa7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:08.784136 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1086ad27-5667-4517-821b-39b83a8b8fa7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:08.786443 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098128c9-8731-4474-923e-4952efde7e6b admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:08.787130 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1086ad27-5667-4517-821b-39b83a8b8fa7 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:08.795565 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1917efce-3145-4ef9-9caf-4f78cb66dfdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:08.796761 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917efce-3145-4ef9-9caf-4f78cb66dfdb admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:08.797245 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917efce-3145-4ef9-9caf-4f78cb66dfdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:08.798078 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917efce-3145-4ef9-9caf-4f78cb66dfdb admin admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:08.799039 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1917efce-3145-4ef9-9caf-4f78cb66dfdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:08.803554 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1917efce-3145-4ef9-9caf-4f78cb66dfdb admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:08.849774 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 795/1583] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:29:08 2022] POST /identity/v3/projects => generated 389 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:29:08.851165 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086ad27-5667-4517-821b-39b83a8b8fa7 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:08.872260 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 789/1584] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:29:08 2022] POST /identity/v3/users => generated 303 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:29:08.874427 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1917efce-3145-4ef9-9caf-4f78cb66dfdb admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:08.905687 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1917efce-3145-4ef9-9caf-4f78cb66dfdb admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:08.987530 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086ad27-5667-4517-821b-39b83a8b8fa7 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:08.993837 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78becf3c-0440-4c98-9e6b-1a12e1bd8feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:08.994677 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78becf3c-0440-4c98-9e6b-1a12e1bd8feb admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:08.995058 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78becf3c-0440-4c98-9e6b-1a12e1bd8feb admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:08.995432 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78becf3c-0440-4c98-9e6b-1a12e1bd8feb admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:08.996244 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78becf3c-0440-4c98-9e6b-1a12e1bd8feb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:08.998603 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78becf3c-0440-4c98-9e6b-1a12e1bd8feb admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:09.054223 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 796/1585] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:29:08 2022] POST /identity/v3/projects => generated 387 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:29:09.055245 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78becf3c-0440-4c98-9e6b-1a12e1bd8feb admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:09.060185 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8168f258-6c56-4440-b64b-b91d9f90cbf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:09.062267 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168f258-6c56-4440-b64b-b91d9f90cbf6 admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:09.063059 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168f258-6c56-4440-b64b-b91d9f90cbf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:09.064006 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168f258-6c56-4440-b64b-b91d9f90cbf6 admin admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:09.065357 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8168f258-6c56-4440-b64b-b91d9f90cbf6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:09.073342 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8168f258-6c56-4440-b64b-b91d9f90cbf6 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:09.129239 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 790/1586] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:29:08 2022] POST /identity/v3/users => generated 289 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:29:09.131620 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8168f258-6c56-4440-b64b-b91d9f90cbf6 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:09.153995 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8168f258-6c56-4440-b64b-b91d9f90cbf6 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:09.156879 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78becf3c-0440-4c98-9e6b-1a12e1bd8feb admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:09.165038 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a86266d-cf26-4d26-b8b9-5bb827786cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:09.167161 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86266d-cf26-4d26-b8b9-5bb827786cd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:09.167443 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a8fcc8-9efc-4ae6-ba16-376c327c60be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:09.168288 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86266d-cf26-4d26-b8b9-5bb827786cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:09.168988 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8fcc8-9efc-4ae6-ba16-376c327c60be admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:09.169485 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86266d-cf26-4d26-b8b9-5bb827786cd9 admin admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:09.169678 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8fcc8-9efc-4ae6-ba16-376c327c60be admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:09.170130 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8fcc8-9efc-4ae6-ba16-376c327c60be admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:09.171661 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a8fcc8-9efc-4ae6-ba16-376c327c60be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:09.171964 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a86266d-cf26-4d26-b8b9-5bb827786cd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:09.175294 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a8fcc8-9efc-4ae6-ba16-376c327c60be admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:09.177964 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a86266d-cf26-4d26-b8b9-5bb827786cd9 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:09.204298 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 797/1587] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:29:09.209114 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a8fcc8-9efc-4ae6-ba16-376c327c60be admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:09.226030 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a8fcc8-9efc-4ae6-ba16-376c327c60be admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:09.236587 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 791/1588] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:29:09 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:29:09.236934 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555c17db-0691-46da-9563-9d1245161786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:09.236934 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c17db-0691-46da-9563-9d1245161786 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:09.236934 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c17db-0691-46da-9563-9d1245161786 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:09.236934 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c17db-0691-46da-9563-9d1245161786 admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:09.237509 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a86266d-cf26-4d26-b8b9-5bb827786cd9 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:09.237650 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555c17db-0691-46da-9563-9d1245161786 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:09.237650 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555c17db-0691-46da-9563-9d1245161786 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:09.250786 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:09.253254 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a86266d-cf26-4d26-b8b9-5bb827786cd9 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:09.279726 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c79dd5-6e87-41e1-8a5b-3d035a3dae03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:09.280795 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c79dd5-6e87-41e1-8a5b-3d035a3dae03 admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:09.281179 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c79dd5-6e87-41e1-8a5b-3d035a3dae03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:09.281681 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c79dd5-6e87-41e1-8a5b-3d035a3dae03 admin admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:09.282692 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c79dd5-6e87-41e1-8a5b-3d035a3dae03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:09.287754 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 798/1589] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:29:09 2022] POST /identity/v3/users => generated 293 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:29:09.287754 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555c17db-0691-46da-9563-9d1245161786 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:09.288173 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c79dd5-6e87-41e1-8a5b-3d035a3dae03 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:09.303656 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555c17db-0691-46da-9563-9d1245161786 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:09.310013 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd3936-a3c8-4d33-8562-7d360aae63fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:09.310626 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd3936-a3c8-4d33-8562-7d360aae63fa admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:09.310969 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd3936-a3c8-4d33-8562-7d360aae63fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:09.311245 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd3936-a3c8-4d33-8562-7d360aae63fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:09.312090 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cd3936-a3c8-4d33-8562-7d360aae63fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:09.313948 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cd3936-a3c8-4d33-8562-7d360aae63fa admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:09.331390 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 792/1590] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:29:09 2022] POST /identity/v3/users => generated 295 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:29:09.333281 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c79dd5-6e87-41e1-8a5b-3d035a3dae03 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:09.337433 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 799/1591] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:29:09.338816 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd3936-a3c8-4d33-8562-7d360aae63fa admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:09.346841 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c79dd5-6e87-41e1-8a5b-3d035a3dae03 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:09.353899 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd3936-a3c8-4d33-8562-7d360aae63fa admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:09.356353 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6905a430-a8bf-45eb-b766-3253e7a42794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:09.357433 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905a430-a8bf-45eb-b766-3253e7a42794 admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:09.358270 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905a430-a8bf-45eb-b766-3253e7a42794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:09.359002 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905a430-a8bf-45eb-b766-3253e7a42794 admin admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:09.360497 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6905a430-a8bf-45eb-b766-3253e7a42794 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:09.361909 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac0da33-8862-4eb8-a08f-652da511202c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:09.363071 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac0da33-8862-4eb8-a08f-652da511202c admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:09.363559 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac0da33-8862-4eb8-a08f-652da511202c admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:09.364196 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac0da33-8862-4eb8-a08f-652da511202c admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:09.365794 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac0da33-8862-4eb8-a08f-652da511202c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:09.366113 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6905a430-a8bf-45eb-b766-3253e7a42794 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:09.369623 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac0da33-8862-4eb8-a08f-652da511202c admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:09.393550 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 800/1592] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:29:09.394899 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac0da33-8862-4eb8-a08f-652da511202c admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:09.408998 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 793/1593] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:29:09 2022] POST /identity/v3/users => generated 294 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:29:09.408998 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6905a430-a8bf-45eb-b766-3253e7a42794 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:09.416772 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac0da33-8862-4eb8-a08f-652da511202c admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:09.420338 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6905a430-a8bf-45eb-b766-3253e7a42794 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:09.425390 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955fc0af-e257-4703-80a6-239c4a667823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:09.426743 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955fc0af-e257-4703-80a6-239c4a667823 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:09.427323 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955fc0af-e257-4703-80a6-239c4a667823 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:09.427560 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884af26c-0fa8-4936-96e7-5ed28218ada5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:09.427753 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955fc0af-e257-4703-80a6-239c4a667823 admin admin] PATH_INFO: `/v3/projects/f98bc2887d6e4833b657d99fd0691046/users/34337cf10266409b88b30fa1fbde8cce/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:09.428450 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884af26c-0fa8-4936-96e7-5ed28218ada5 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:09.428815 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884af26c-0fa8-4936-96e7-5ed28218ada5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:09.429179 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884af26c-0fa8-4936-96e7-5ed28218ada5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:09.430114 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884af26c-0fa8-4936-96e7-5ed28218ada5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:09.432332 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884af26c-0fa8-4936-96e7-5ed28218ada5 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:09.450838 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 794/1594] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:29:09.458149 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884af26c-0fa8-4936-96e7-5ed28218ada5 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:09.464638 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=84,keystone:INSERT=16 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:09.472890 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884af26c-0fa8-4936-96e7-5ed28218ada5 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:09.476376 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955fc0af-e257-4703-80a6-239c4a667823 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f98bc2887d6e4833b657d99fd0691046, user_id=34337cf10266409b88b30fa1fbde8cce, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:09.484167 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b48d2-c845-4d9e-a67a-0534aff840ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:09.485547 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955fc0af-e257-4703-80a6-239c4a667823 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:09.486058 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b48d2-c845-4d9e-a67a-0534aff840ae admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:09.486822 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b48d2-c845-4d9e-a67a-0534aff840ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:09.487589 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b48d2-c845-4d9e-a67a-0534aff840ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:09.488794 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934b48d2-c845-4d9e-a67a-0534aff840ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:09.491694 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934b48d2-c845-4d9e-a67a-0534aff840ae admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:09.521166 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 801/1595] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:29:09 2022] PUT /identity/v3/projects/f98bc2887d6e4833b657d99fd0691046/users/34337cf10266409b88b30fa1fbde8cce/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:29:09.523014 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955fc0af-e257-4703-80a6-239c4a667823 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:09.524293 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 795/1596] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:29:09.527832 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b48d2-c845-4d9e-a67a-0534aff840ae admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:09.541694 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b48d2-c845-4d9e-a67a-0534aff840ae admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:09.641848 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955fc0af-e257-4703-80a6-239c4a667823 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:09.648253 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239d3d3e-b942-4ea7-9d18-7be044f925c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:09.649250 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d3d3e-b942-4ea7-9d18-7be044f925c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:09.649759 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d3d3e-b942-4ea7-9d18-7be044f925c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:09.650192 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d3d3e-b942-4ea7-9d18-7be044f925c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:09.651018 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239d3d3e-b942-4ea7-9d18-7be044f925c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:09.653479 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239d3d3e-b942-4ea7-9d18-7be044f925c7 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:09.668336 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c429f370-5837-4962-a652-6be4f265e26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:09.668883 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 802/1597] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:29:09.669396 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c429f370-5837-4962-a652-6be4f265e26c admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:09.669878 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c429f370-5837-4962-a652-6be4f265e26c admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:09.670357 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c429f370-5837-4962-a652-6be4f265e26c admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:09.671746 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c429f370-5837-4962-a652-6be4f265e26c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:09.673062 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239d3d3e-b942-4ea7-9d18-7be044f925c7 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:09.674884 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c429f370-5837-4962-a652-6be4f265e26c admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:09.692443 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239d3d3e-b942-4ea7-9d18-7be044f925c7 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:09.700588 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 796/1598] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:29:09.700588 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c429f370-5837-4962-a652-6be4f265e26c admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:09.711178 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc2b60-61d1-403b-b267-bdba48e3725e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:09.711178 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc2b60-61d1-403b-b267-bdba48e3725e admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:09.711178 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc2b60-61d1-403b-b267-bdba48e3725e admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:09.711178 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc2b60-61d1-403b-b267-bdba48e3725e admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:09.711594 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfc2b60-61d1-403b-b267-bdba48e3725e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:09.715258 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfc2b60-61d1-403b-b267-bdba48e3725e admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:09.720254 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c429f370-5837-4962-a652-6be4f265e26c admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:09.729244 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f4a535-34ad-46cd-818f-2c0117cd8168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:09.730400 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f4a535-34ad-46cd-818f-2c0117cd8168 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:09.730978 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f4a535-34ad-46cd-818f-2c0117cd8168 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:09.731503 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f4a535-34ad-46cd-818f-2c0117cd8168 admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:09.732843 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f4a535-34ad-46cd-818f-2c0117cd8168 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:09.735784 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f4a535-34ad-46cd-818f-2c0117cd8168 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:09.753171 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 803/1599] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:29:09.755041 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc2b60-61d1-403b-b267-bdba48e3725e admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:09.764730 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 797/1600] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:29:09.765563 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f4a535-34ad-46cd-818f-2c0117cd8168 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:09.772835 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc2b60-61d1-403b-b267-bdba48e3725e admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:09.782107 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2412dc4d-f382-4a86-a260-784b2c4989eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:09.784674 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412dc4d-f382-4a86-a260-784b2c4989eb admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:09.785302 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f4a535-34ad-46cd-818f-2c0117cd8168 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:09.786451 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412dc4d-f382-4a86-a260-784b2c4989eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:09.786990 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412dc4d-f382-4a86-a260-784b2c4989eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:09.788817 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2412dc4d-f382-4a86-a260-784b2c4989eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:09.791757 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2412dc4d-f382-4a86-a260-784b2c4989eb admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:09.795243 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63945f6f-2279-4978-bf5a-8188d5e13c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:09.796340 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63945f6f-2279-4978-bf5a-8188d5e13c13 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:09.796831 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63945f6f-2279-4978-bf5a-8188d5e13c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:09.797308 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63945f6f-2279-4978-bf5a-8188d5e13c13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:09.798473 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63945f6f-2279-4978-bf5a-8188d5e13c13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:09.803542 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63945f6f-2279-4978-bf5a-8188d5e13c13 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:09.825273 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 804/1601] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:29:09.828071 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 798/1602] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:29:09.828305 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2412dc4d-f382-4a86-a260-784b2c4989eb admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:09.828446 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63945f6f-2279-4978-bf5a-8188d5e13c13 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:09.842127 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2412dc4d-f382-4a86-a260-784b2c4989eb admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:09.847881 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c1ad2e-5475-40de-9caf-ebeff192d55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:09.848914 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63945f6f-2279-4978-bf5a-8188d5e13c13 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:09.849110 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1ad2e-5475-40de-9caf-ebeff192d55c admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:09.849488 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1ad2e-5475-40de-9caf-ebeff192d55c admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:09.849855 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1ad2e-5475-40de-9caf-ebeff192d55c admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:09.850727 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c1ad2e-5475-40de-9caf-ebeff192d55c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:09.852817 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c1ad2e-5475-40de-9caf-ebeff192d55c admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:09.858193 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ab447-6a5b-4acc-aca9-007de81c615e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:09.859570 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ab447-6a5b-4acc-aca9-007de81c615e admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:09.860320 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ab447-6a5b-4acc-aca9-007de81c615e admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:09.861021 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ab447-6a5b-4acc-aca9-007de81c615e admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:09.862398 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6ab447-6a5b-4acc-aca9-007de81c615e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:09.865967 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6ab447-6a5b-4acc-aca9-007de81c615e admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:09.867155 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 805/1603] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:29:09.867892 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c1ad2e-5475-40de-9caf-ebeff192d55c admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:09.881521 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c1ad2e-5475-40de-9caf-ebeff192d55c admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:09.887441 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcdfbce-76ad-4052-9067-bd0fcc826581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:09.888770 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcdfbce-76ad-4052-9067-bd0fcc826581 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:09.888770 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcdfbce-76ad-4052-9067-bd0fcc826581 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:09.889575 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcdfbce-76ad-4052-9067-bd0fcc826581 admin admin] PATH_INFO: `/v3/projects/10968ce0611c4e9da11df8f03fb640d1/users/d39debd8004b4500bb812cd28ee3af94/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:09.900924 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 799/1604] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:29:09.902717 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ab447-6a5b-4acc-aca9-007de81c615e admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:09.927802 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ab447-6a5b-4acc-aca9-007de81c615e admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:09.933281 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcdfbce-76ad-4052-9067-bd0fcc826581 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10968ce0611c4e9da11df8f03fb640d1, user_id=d39debd8004b4500bb812cd28ee3af94, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:09.937925 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c570a75-4e01-42cb-b25e-a62205d443cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:09.938341 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcdfbce-76ad-4052-9067-bd0fcc826581 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:09.939646 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c570a75-4e01-42cb-b25e-a62205d443cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:09.940337 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c570a75-4e01-42cb-b25e-a62205d443cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:09.941043 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c570a75-4e01-42cb-b25e-a62205d443cc admin admin] PATH_INFO: `/v3/projects/1638b6f183134b83b87ce6f2eb995d7a/users/9a872454622d41ce9462890af418182d/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:09.970087 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c570a75-4e01-42cb-b25e-a62205d443cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1638b6f183134b83b87ce6f2eb995d7a, user_id=9a872454622d41ce9462890af418182d, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:09.971408 dv-cinder-854265-2-smb devstack@keystone.service[81547]: WARNING py.warnings [None req-0c570a75-4e01-42cb-b25e-a62205d443cc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:29:09.971408 dv-cinder-854265-2-smb devstack@keystone.service[81547]: warnings.warn(msg) Aug 30 04:29:09.971408 dv-cinder-854265-2-smb devstack@keystone.service[81547]: Aug 30 04:29:09.975488 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c570a75-4e01-42cb-b25e-a62205d443cc admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:09.979775 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 806/1605] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:29:09 2022] PUT /identity/v3/projects/10968ce0611c4e9da11df8f03fb640d1/users/d39debd8004b4500bb812cd28ee3af94/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:29:09.984611 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcdfbce-76ad-4052-9067-bd0fcc826581 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:10.012237 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 800/1606] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:29:09 2022] PUT /identity/v3/projects/1638b6f183134b83b87ce6f2eb995d7a/users/9a872454622d41ce9462890af418182d/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:29:10.013661 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c570a75-4e01-42cb-b25e-a62205d443cc admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:10.093581 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:10.132735 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcdfbce-76ad-4052-9067-bd0fcc826581 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:10.157012 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c570a75-4e01-42cb-b25e-a62205d443cc admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:10.164829 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ac886-7699-4d71-ae99-28fdf9edfd47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:10.165705 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ac886-7699-4d71-ae99-28fdf9edfd47 admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:10.165986 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ac886-7699-4d71-ae99-28fdf9edfd47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:10.166262 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ac886-7699-4d71-ae99-28fdf9edfd47 admin admin] PATH_INFO: `/v3/projects/eba9fe072ea34323bbebbc34c646cd3f/users/368463f2e7464a068e2585471246c4b5/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:10.202265 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0ac886-7699-4d71-ae99-28fdf9edfd47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eba9fe072ea34323bbebbc34c646cd3f, user_id=368463f2e7464a068e2585471246c4b5, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:10.205515 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0ac886-7699-4d71-ae99-28fdf9edfd47 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:10.236732 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 801/1607] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:29:10 2022] PUT /identity/v3/projects/eba9fe072ea34323bbebbc34c646cd3f/users/368463f2e7464a068e2585471246c4b5/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:29:10.249542 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ac886-7699-4d71-ae99-28fdf9edfd47 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:10.271496 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e221e1cf-de2e-4e91-9097-c8c96138debb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:10.272702 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e221e1cf-de2e-4e91-9097-c8c96138debb admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:10.273278 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e221e1cf-de2e-4e91-9097-c8c96138debb admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:10.273846 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e221e1cf-de2e-4e91-9097-c8c96138debb admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:10.275351 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e221e1cf-de2e-4e91-9097-c8c96138debb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:10.277290 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:10.278724 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e221e1cf-de2e-4e91-9097-c8c96138debb admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:10.303622 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 807/1608] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:29:10.305941 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e221e1cf-de2e-4e91-9097-c8c96138debb admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:10.325653 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e221e1cf-de2e-4e91-9097-c8c96138debb admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:10.382582 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ac886-7699-4d71-ae99-28fdf9edfd47 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:10.390443 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81751875-bebf-4858-b583-531d697db222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:10.391249 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81751875-bebf-4858-b583-531d697db222 admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:10.391528 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81751875-bebf-4858-b583-531d697db222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:10.392728 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81751875-bebf-4858-b583-531d697db222 admin admin] PATH_INFO: `/v3/projects/13f8a3965e8d4b0ab2dc90fb59cd5916/users/b66e74b0f3a84d3b90c81a6ae587ba85/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:10.423176 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81751875-bebf-4858-b583-531d697db222 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13f8a3965e8d4b0ab2dc90fb59cd5916, user_id=b66e74b0f3a84d3b90c81a6ae587ba85, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:10.426579 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81751875-bebf-4858-b583-531d697db222 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:10.450090 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 802/1609] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:29:10 2022] PUT /identity/v3/projects/13f8a3965e8d4b0ab2dc90fb59cd5916/users/b66e74b0f3a84d3b90c81a6ae587ba85/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:29:10.451209 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81751875-bebf-4858-b583-531d697db222 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:10.483850 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c192766d-01f4-42f2-a63e-7134b3f1f34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:10.484525 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192766d-01f4-42f2-a63e-7134b3f1f34e admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:10.484808 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192766d-01f4-42f2-a63e-7134b3f1f34e admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:10.485059 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192766d-01f4-42f2-a63e-7134b3f1f34e admin admin] PATH_INFO: `/v3/projects/f98bc2887d6e4833b657d99fd0691046/users/34337cf10266409b88b30fa1fbde8cce/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:10.488082 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c192766d-01f4-42f2-a63e-7134b3f1f34e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f98bc2887d6e4833b657d99fd0691046, user_id=34337cf10266409b88b30fa1fbde8cce, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:10.490444 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c192766d-01f4-42f2-a63e-7134b3f1f34e admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:10.556967 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 808/1610] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:29:10 2022] PUT /identity/v3/projects/f98bc2887d6e4833b657d99fd0691046/users/34337cf10266409b88b30fa1fbde8cce/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:29:10.556967 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae59e2-d4b5-4bac-8b0e-7cb04a3cadfc None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:10.556967 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae59e2-d4b5-4bac-8b0e-7cb04a3cadfc None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:10.556967 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae59e2-d4b5-4bac-8b0e-7cb04a3cadfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:10.577646 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-98ae59e2-d4b5-4bac-8b0e-7cb04a3cadfc None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:10.577646 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-98ae59e2-d4b5-4bac-8b0e-7cb04a3cadfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:10.665577 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81751875-bebf-4858-b583-531d697db222 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:10.717314 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 809/1611] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:29:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:10.719056 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035eed9-abe1-4f95-ac24-0f26b841ea4f None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:10.719564 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035eed9-abe1-4f95-ac24-0f26b841ea4f None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:10.719889 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035eed9-abe1-4f95-ac24-0f26b841ea4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:10.745788 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-2035eed9-abe1-4f95-ac24-0f26b841ea4f None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:10.747565 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-2035eed9-abe1-4f95-ac24-0f26b841ea4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:10.759444 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 810/1612] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:29:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:10.761127 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f3401f-6d8f-4cbe-ac1d-9239bbd4f420 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:10.761414 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f3401f-6d8f-4cbe-ac1d-9239bbd4f420 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:10.761686 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f3401f-6d8f-4cbe-ac1d-9239bbd4f420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:10.793815 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348a91f2-1806-41a3-aac8-eee9dfc391f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:10.794487 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a91f2-1806-41a3-aac8-eee9dfc391f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:10.794952 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a91f2-1806-41a3-aac8-eee9dfc391f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:10.795412 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a91f2-1806-41a3-aac8-eee9dfc391f5 admin admin] PATH_INFO: `/v3/projects/b09f049bcfa64015bf7495ae9ec2924a/users/589bd91dbf434099b15ed7a8680f93bb/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:10.806787 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-22f3401f-6d8f-4cbe-ac1d-9239bbd4f420 None None] MFA Rules not processed for user `368463f2e7464a068e2585471246c4b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:10.808113 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-22f3401f-6d8f-4cbe-ac1d-9239bbd4f420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:10.813129 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:10.819336 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348a91f2-1806-41a3-aac8-eee9dfc391f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b09f049bcfa64015bf7495ae9ec2924a, user_id=589bd91dbf434099b15ed7a8680f93bb, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:10.823048 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348a91f2-1806-41a3-aac8-eee9dfc391f5 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:10.858827 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 803/1613] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:29:10 2022] PUT /identity/v3/projects/b09f049bcfa64015bf7495ae9ec2924a/users/589bd91dbf434099b15ed7a8680f93bb/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:29:10.859827 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348a91f2-1806-41a3-aac8-eee9dfc391f5 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:10.901491 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:10.930331 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 811/1614] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:29:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:10.932530 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab6d62-d1a1-435f-ae88-5857bcdb3fc2 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:10.933003 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab6d62-d1a1-435f-ae88-5857bcdb3fc2 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:10.933677 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab6d62-d1a1-435f-ae88-5857bcdb3fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:10.971149 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348a91f2-1806-41a3-aac8-eee9dfc391f5 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:10.987091 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70cef83-424f-4b6e-a65d-aa33348a7ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:10.988068 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70cef83-424f-4b6e-a65d-aa33348a7ca2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:10.988491 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70cef83-424f-4b6e-a65d-aa33348a7ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:10.988844 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70cef83-424f-4b6e-a65d-aa33348a7ca2 admin admin] PATH_INFO: `/v3/projects/cf24ec2c8bd74974932690a583961691/users/91067603d9c549278cdc2d97b54cca88/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:11.002584 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-20ab6d62-d1a1-435f-ae88-5857bcdb3fc2 None None] MFA Rules not processed for user `b66e74b0f3a84d3b90c81a6ae587ba85`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:11.005284 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-20ab6d62-d1a1-435f-ae88-5857bcdb3fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:11.016301 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70cef83-424f-4b6e-a65d-aa33348a7ca2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf24ec2c8bd74974932690a583961691, user_id=91067603d9c549278cdc2d97b54cca88, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:11.021044 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70cef83-424f-4b6e-a65d-aa33348a7ca2 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:11.042582 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 804/1615] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:29:10 2022] PUT /identity/v3/projects/cf24ec2c8bd74974932690a583961691/users/91067603d9c549278cdc2d97b54cca88/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:29:11.044298 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70361597-d097-4eda-9b67-90ab2d2847b3 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:11.044656 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70361597-d097-4eda-9b67-90ab2d2847b3 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:11.045000 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70361597-d097-4eda-9b67-90ab2d2847b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:11.091669 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-70361597-d097-4eda-9b67-90ab2d2847b3 None None] MFA Rules not processed for user `34337cf10266409b88b30fa1fbde8cce`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:11.093711 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-70361597-d097-4eda-9b67-90ab2d2847b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:11.118732 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 812/1616] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:29:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:11.124410 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab6d62-d1a1-435f-ae88-5857bcdb3fc2 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:11.240517 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab6d62-d1a1-435f-ae88-5857bcdb3fc2 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:11.324536 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 805/1617] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:29:11 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:11.326654 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70361597-d097-4eda-9b67-90ab2d2847b3 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:11.393384 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fad3d1-76d6-4087-af93-f0ed8d226976 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:11.395435 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fad3d1-76d6-4087-af93-f0ed8d226976 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:11.395435 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fad3d1-76d6-4087-af93-f0ed8d226976 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:11.396895 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fad3d1-76d6-4087-af93-f0ed8d226976 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:11.421120 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:11.495203 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70361597-d097-4eda-9b67-90ab2d2847b3 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:11.501218 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df5ec16-e00e-41d2-abbe-dd5f883f328b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:11.502081 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5ec16-e00e-41d2-abbe-dd5f883f328b service neutron] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:11.502363 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5ec16-e00e-41d2-abbe-dd5f883f328b service neutron] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:11.502664 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5ec16-e00e-41d2-abbe-dd5f883f328b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:11.522463 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fad3d1-76d6-4087-af93-f0ed8d226976 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:11.524462 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fad3d1-76d6-4087-af93-f0ed8d226976 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:11.527139 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df5ec16-e00e-41d2-abbe-dd5f883f328b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:11.528773 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df5ec16-e00e-41d2-abbe-dd5f883f328b service neutron] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:11.552203 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 813/1618] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:29:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:29:11.553746 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2932aa1f-2e1b-4a0e-b650-9b403df58443 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:11.554028 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2932aa1f-2e1b-4a0e-b650-9b403df58443 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:11.554298 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2932aa1f-2e1b-4a0e-b650-9b403df58443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:11.559688 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 806/1619] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:29:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:29:11.561193 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68fb5b2-1d82-4a43-b4c4-f252149a019d None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:11.561463 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68fb5b2-1d82-4a43-b4c4-f252149a019d None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:11.561739 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68fb5b2-1d82-4a43-b4c4-f252149a019d None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:11.564647 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 807/1620] 10.222.0.91 () {54 vars in 962 bytes} [Tue Aug 30 04:29:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:29:11.567888 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eabfeb7-af4e-46e4-8a21-300e3dada56c None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:11.568174 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eabfeb7-af4e-46e4-8a21-300e3dada56c None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:11.568451 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eabfeb7-af4e-46e4-8a21-300e3dada56c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:11.599181 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-2932aa1f-2e1b-4a0e-b650-9b403df58443 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:11.603525 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-2932aa1f-2e1b-4a0e-b650-9b403df58443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:11.610653 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-1eabfeb7-af4e-46e4-8a21-300e3dada56c None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:11.613491 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-1eabfeb7-af4e-46e4-8a21-300e3dada56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:11.629781 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 814/1621] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:29:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:11.632625 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b17d9ae-7281-464f-8921-cdec3104627f None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:11.632908 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b17d9ae-7281-464f-8921-cdec3104627f None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:11.633227 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b17d9ae-7281-464f-8921-cdec3104627f None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:11.646227 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 815/1622] 10.222.0.91 () {54 vars in 962 bytes} [Tue Aug 30 04:29:11 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:29:11.647349 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b17d9ae-7281-464f-8921-cdec3104627f None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:11.654944 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 808/1623] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:29:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:11.654944 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebafdbd-e2a3-40ec-a571-798c852abf3a None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:11.654944 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebafdbd-e2a3-40ec-a571-798c852abf3a None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:11.654944 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebafdbd-e2a3-40ec-a571-798c852abf3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:11.773932 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-3ebafdbd-e2a3-40ec-a571-798c852abf3a None None] MFA Rules not processed for user `d806295278ae4997b5c6968aa553290c`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:11.775681 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-3ebafdbd-e2a3-40ec-a571-798c852abf3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:11.803443 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b17d9ae-7281-464f-8921-cdec3104627f None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:11.813743 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:11.817998 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e134994-28b7-4b13-a951-12373011473f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:11.819101 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e134994-28b7-4b13-a951-12373011473f service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:11.819595 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e134994-28b7-4b13-a951-12373011473f service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:11.822830 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e134994-28b7-4b13-a951-12373011473f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:11.867423 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e134994-28b7-4b13-a951-12373011473f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:11.878072 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e134994-28b7-4b13-a951-12373011473f service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:11.915588 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 816/1624] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:29:11 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:29:11.918144 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be18d0-c5c1-4b1c-87c8-e18e0c4cc213 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:11.918628 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be18d0-c5c1-4b1c-87c8-e18e0c4cc213 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:11.919086 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be18d0-c5c1-4b1c-87c8-e18e0c4cc213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:11.976529 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 809/1625] 10.222.0.91 () {58 vars in 1059 bytes} [Tue Aug 30 04:29:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:11.982318 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebafdbd-e2a3-40ec-a571-798c852abf3a None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:11.992136 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-e7be18d0-c5c1-4b1c-87c8-e18e0c4cc213 None None] MFA Rules not processed for user `d806295278ae4997b5c6968aa553290c`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:11.994462 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-e7be18d0-c5c1-4b1c-87c8-e18e0c4cc213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:12.027246 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 817/1626] 10.222.0.91 () {58 vars in 1059 bytes} [Tue Aug 30 04:29:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:12.041597 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7be18d0-c5c1-4b1c-87c8-e18e0c4cc213 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:12.060008 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebafdbd-e2a3-40ec-a571-798c852abf3a None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:12.069713 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7be18d0-c5c1-4b1c-87c8-e18e0c4cc213 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:12.088413 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489cdf77-9051-4af7-a609-8b2d20059926 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd806295278ae4997b5c6968aa553290c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:12.091094 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489cdf77-9051-4af7-a609-8b2d20059926 service nova] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:12.091094 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489cdf77-9051-4af7-a609-8b2d20059926 service nova] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:12.091429 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489cdf77-9051-4af7-a609-8b2d20059926 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:12.105720 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ea78d-f295-4ec0-85a8-de979a96b8fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd806295278ae4997b5c6968aa553290c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:12.107037 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ea78d-f295-4ec0-85a8-de979a96b8fa service nova] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:12.107657 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ea78d-f295-4ec0-85a8-de979a96b8fa service nova] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:12.108332 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ea78d-f295-4ec0-85a8-de979a96b8fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:12.267585 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126ea78d-f295-4ec0-85a8-de979a96b8fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:12.270875 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126ea78d-f295-4ec0-85a8-de979a96b8fa service nova] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:12.291101 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 818/1627] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:29:12 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:29:12.292828 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ea78d-f295-4ec0-85a8-de979a96b8fa service nova] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:12.311533 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489cdf77-9051-4af7-a609-8b2d20059926 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:12.313269 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ea78d-f295-4ec0-85a8-de979a96b8fa service nova] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:12.315065 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489cdf77-9051-4af7-a609-8b2d20059926 service nova] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:12.320510 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c726d415-af98-45fb-b6d8-e58382272a35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:12.321270 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726d415-af98-45fb-b6d8-e58382272a35 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:12.321794 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726d415-af98-45fb-b6d8-e58382272a35 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:12.322459 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726d415-af98-45fb-b6d8-e58382272a35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:12.340457 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c726d415-af98-45fb-b6d8-e58382272a35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:12.343272 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c726d415-af98-45fb-b6d8-e58382272a35 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:12.347841 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 810/1628] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:29:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:29:12.349858 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489cdf77-9051-4af7-a609-8b2d20059926 service nova] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:12.364187 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 819/1629] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:29:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:29:12.366124 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c726d415-af98-45fb-b6d8-e58382272a35 service neutron] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:12.384491 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c726d415-af98-45fb-b6d8-e58382272a35 service neutron] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:12.392302 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a142537-b1c9-4d74-8aa5-8013c8d937b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:12.393514 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a142537-b1c9-4d74-8aa5-8013c8d937b0 service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:12.393652 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489cdf77-9051-4af7-a609-8b2d20059926 service nova] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:12.394291 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a142537-b1c9-4d74-8aa5-8013c8d937b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:12.394896 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a142537-b1c9-4d74-8aa5-8013c8d937b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:12.409263 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7379751c-cd01-40ad-958b-6115513d7463 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:12.410408 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379751c-cd01-40ad-958b-6115513d7463 service neutron] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:12.410927 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379751c-cd01-40ad-958b-6115513d7463 service neutron] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:12.411799 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379751c-cd01-40ad-958b-6115513d7463 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:12.421764 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:12.457666 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7379751c-cd01-40ad-958b-6115513d7463 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:12.460687 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7379751c-cd01-40ad-958b-6115513d7463 service neutron] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:12.501805 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 811/1630] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:29:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:29:12.517585 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a142537-b1c9-4d74-8aa5-8013c8d937b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:12.520880 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a142537-b1c9-4d74-8aa5-8013c8d937b0 service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:12.552647 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 820/1631] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:29:12 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:29:12.943353 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523dd17a-1fc9-43f7-bccc-a0bf3cc496ba None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:12.943353 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523dd17a-1fc9-43f7-bccc-a0bf3cc496ba None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:12.943353 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523dd17a-1fc9-43f7-bccc-a0bf3cc496ba None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:12.945206 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 812/1632] 10.222.0.91 () {54 vars in 912 bytes} [Tue Aug 30 04:29:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:29:12.951385 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32692424-0f97-440f-aae8-1805709e672f None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:12.951647 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32692424-0f97-440f-aae8-1805709e672f None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:12.952051 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32692424-0f97-440f-aae8-1805709e672f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:12.992646 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-32692424-0f97-440f-aae8-1805709e672f None None] MFA Rules not processed for user `d806295278ae4997b5c6968aa553290c`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:12.998451 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-32692424-0f97-440f-aae8-1805709e672f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:13.022261 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 821/1633] 10.222.0.91 () {58 vars in 1009 bytes} [Tue Aug 30 04:29:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:29:13.053586 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523dd17a-1fc9-43f7-bccc-a0bf3cc496ba None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:13.087961 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523dd17a-1fc9-43f7-bccc-a0bf3cc496ba None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:13.093675 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0720b226-e347-467f-b5f2-a025295cf7d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:13.095061 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720b226-e347-467f-b5f2-a025295cf7d4 service cinder] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:13.095667 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720b226-e347-467f-b5f2-a025295cf7d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:13.096184 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720b226-e347-467f-b5f2-a025295cf7d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:13.134775 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0720b226-e347-467f-b5f2-a025295cf7d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:13.136799 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0720b226-e347-467f-b5f2-a025295cf7d4 service cinder] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:13.178641 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 813/1634] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:29:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:29:13.313971 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3309b-5e01-4de9-9286-64a5b680e967 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:13.313971 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3309b-5e01-4de9-9286-64a5b680e967 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:13.313971 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3309b-5e01-4de9-9286-64a5b680e967 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:13.315951 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 822/1635] 10.222.0.91 () {54 vars in 912 bytes} [Tue Aug 30 04:29:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:29:13.327659 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cfe9cc-998c-42ad-96a0-82c60d99660f None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:13.328061 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cfe9cc-998c-42ad-96a0-82c60d99660f None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:13.328348 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cfe9cc-998c-42ad-96a0-82c60d99660f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:13.391552 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-26cfe9cc-998c-42ad-96a0-82c60d99660f None None] MFA Rules not processed for user `d806295278ae4997b5c6968aa553290c`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:13.397845 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-26cfe9cc-998c-42ad-96a0-82c60d99660f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:13.436785 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 814/1636] 10.222.0.91 () {58 vars in 1009 bytes} [Tue Aug 30 04:29:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:13.591391 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c3309b-5e01-4de9-9286-64a5b680e967 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:13.651656 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c3309b-5e01-4de9-9286-64a5b680e967 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:13.673643 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2746e39c-202f-478a-ac35-5f9aa41d011e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:13.682072 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2746e39c-202f-478a-ac35-5f9aa41d011e service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:13.684098 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2746e39c-202f-478a-ac35-5f9aa41d011e service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:13.684957 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2746e39c-202f-478a-ac35-5f9aa41d011e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:13.739348 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2746e39c-202f-478a-ac35-5f9aa41d011e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:13.745575 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2746e39c-202f-478a-ac35-5f9aa41d011e service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:13.806712 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 823/1637] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:29:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:29:14.553047 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cfe9cc-998c-42ad-96a0-82c60d99660f None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:14.622417 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cfe9cc-998c-42ad-96a0-82c60d99660f None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:14.643856 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21074922-8eab-4a31-ad6a-85d539ce419d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:14.645282 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21074922-8eab-4a31-ad6a-85d539ce419d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:14.647266 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21074922-8eab-4a31-ad6a-85d539ce419d admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:14.648127 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21074922-8eab-4a31-ad6a-85d539ce419d admin admin] PATH_INFO: `/v3/users/368463f2e7464a068e2585471246c4b5` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:14.652099 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21074922-8eab-4a31-ad6a-85d539ce419d admin admin] RBAC: Authorizing `identity:delete_user(user_id=368463f2e7464a068e2585471246c4b5)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:14.657837 dv-cinder-854265-2-smb devstack@keystone.service[81547]: WARNING py.warnings [None req-21074922-8eab-4a31-ad6a-85d539ce419d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:29:14.657837 dv-cinder-854265-2-smb devstack@keystone.service[81547]: warnings.warn(msg) Aug 30 04:29:14.657837 dv-cinder-854265-2-smb devstack@keystone.service[81547]: Aug 30 04:29:14.660962 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21074922-8eab-4a31-ad6a-85d539ce419d admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:14.968451 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-21074922-8eab-4a31-ad6a-85d539ce419d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '368463f2e7464a068e2585471246c4b5'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:14.972828 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-21074922-8eab-4a31-ad6a-85d539ce419d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '368463f2e7464a068e2585471246c4b5'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:14.975198 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-21074922-8eab-4a31-ad6a-85d539ce419d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '368463f2e7464a068e2585471246c4b5'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:15.012380 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-21074922-8eab-4a31-ad6a-85d539ce419d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '368463f2e7464a068e2585471246c4b5'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:15.109367 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:15.124029 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-21074922-8eab-4a31-ad6a-85d539ce419d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '368463f2e7464a068e2585471246c4b5'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:15.185707 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 815/1638] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:29:14 2022] DELETE /identity/v3/users/368463f2e7464a068e2585471246c4b5 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:29:15.191971 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16066efc-1b7a-4a65-b466-0c12c2d9964e None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:15.192920 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16066efc-1b7a-4a65-b466-0c12c2d9964e None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:15.193382 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16066efc-1b7a-4a65-b466-0c12c2d9964e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:15.237820 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-16066efc-1b7a-4a65-b466-0c12c2d9964e None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:15.241614 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-16066efc-1b7a-4a65-b466-0c12c2d9964e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:15.377414 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35be32-e778-4155-b5b5-bab706a37333 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:15.382001 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35be32-e778-4155-b5b5-bab706a37333 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:15.382903 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35be32-e778-4155-b5b5-bab706a37333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:15.425788 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 824/1639] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:29:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:15.482507 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16066efc-1b7a-4a65-b466-0c12c2d9964e None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:15.484845 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-16066efc-1b7a-4a65-b466-0c12c2d9964e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:15.488576 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-df35be32-e778-4155-b5b5-bab706a37333 None None] MFA Rules not processed for user `d39debd8004b4500bb812cd28ee3af94`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:15.499407 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-df35be32-e778-4155-b5b5-bab706a37333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:15.716965 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16066efc-1b7a-4a65-b466-0c12c2d9964e None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:15.730355 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef5ba93-cd71-41ba-b4ad-d2b915907ade service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:15.731682 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5ba93-cd71-41ba-b4ad-d2b915907ade service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:15.732378 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5ba93-cd71-41ba-b4ad-d2b915907ade service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:15.734233 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5ba93-cd71-41ba-b4ad-d2b915907ade service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:15.778355 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef5ba93-cd71-41ba-b4ad-d2b915907ade service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:15.785254 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef5ba93-cd71-41ba-b4ad-d2b915907ade service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:15.829381 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 825/1640] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:29:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:29:15.860905 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 816/1641] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:29:15 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 481 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:15.861874 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef5ba93-cd71-41ba-b4ad-d2b915907ade service neutron] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:15.864725 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-2ef5ba93-cd71-41ba-b4ad-d2b915907ade service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:15.905042 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef5ba93-cd71-41ba-b4ad-d2b915907ade service neutron] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:15.924595 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a63f9-2868-4ab4-b6d8-10aaf822f724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:15.926747 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a63f9-2868-4ab4-b6d8-10aaf822f724 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:15.927571 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a63f9-2868-4ab4-b6d8-10aaf822f724 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:15.928455 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a63f9-2868-4ab4-b6d8-10aaf822f724 admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:15.930137 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705a63f9-2868-4ab4-b6d8-10aaf822f724 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:15.935807 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705a63f9-2868-4ab4-b6d8-10aaf822f724 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:16.058965 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35be32-e778-4155-b5b5-bab706a37333 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:16.088060 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 826/1642] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:29:15 2022] POST /identity/v3/projects => generated 403 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:29:16.119319 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35be32-e778-4155-b5b5-bab706a37333 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:16.494263 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08621e4d-96ab-490c-adb4-d9f63389ce4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:16.495593 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08621e4d-96ab-490c-adb4-d9f63389ce4c admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:16.501692 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08621e4d-96ab-490c-adb4-d9f63389ce4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:16.502114 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08621e4d-96ab-490c-adb4-d9f63389ce4c admin admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:16.502957 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08621e4d-96ab-490c-adb4-d9f63389ce4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:16.505510 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08621e4d-96ab-490c-adb4-d9f63389ce4c admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:16.560958 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a63f9-2868-4ab4-b6d8-10aaf822f724 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:16.562181 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 817/1643] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:29:16 2022] POST /identity/v3/users => generated 308 bytes in 504 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:29:16.605517 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a63f9-2868-4ab4-b6d8-10aaf822f724 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:16.662447 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091cbd97-545a-45ea-a304-c69c97dfc8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:16.663170 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091cbd97-545a-45ea-a304-c69c97dfc8d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:16.663364 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091cbd97-545a-45ea-a304-c69c97dfc8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:16.663636 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091cbd97-545a-45ea-a304-c69c97dfc8d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:16.664411 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091cbd97-545a-45ea-a304-c69c97dfc8d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:16.666249 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091cbd97-545a-45ea-a304-c69c97dfc8d7 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:16.682128 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 827/1644] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:29:16 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:29:16.689382 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08621e4d-96ab-490c-adb4-d9f63389ce4c admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:16.710507 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08621e4d-96ab-490c-adb4-d9f63389ce4c admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:16.718714 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77236e-40a4-416c-bd91-8278767316e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:16.722587 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77236e-40a4-416c-bd91-8278767316e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:16.723582 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77236e-40a4-416c-bd91-8278767316e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:16.724482 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77236e-40a4-416c-bd91-8278767316e0 admin admin] PATH_INFO: `/v3/projects/d3545a9bd9a14de998a60c368027e005/users/fdbdd2b7bd38484a9b474c793f84c563/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:16.749015 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac77236e-40a4-416c-bd91-8278767316e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3545a9bd9a14de998a60c368027e005, user_id=fdbdd2b7bd38484a9b474c793f84c563, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:16.752995 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac77236e-40a4-416c-bd91-8278767316e0 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:16.777306 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 818/1645] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:29:16 2022] PUT /identity/v3/projects/d3545a9bd9a14de998a60c368027e005/users/fdbdd2b7bd38484a9b474c793f84c563/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:29:16.784948 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091cbd97-545a-45ea-a304-c69c97dfc8d7 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:16.799364 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:16.809891 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091cbd97-545a-45ea-a304-c69c97dfc8d7 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:16.958575 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65d7374-2cc0-4b2d-b0c4-934e7512f3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:16.963136 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d7374-2cc0-4b2d-b0c4-934e7512f3a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:16.963499 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d7374-2cc0-4b2d-b0c4-934e7512f3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:16.963838 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d7374-2cc0-4b2d-b0c4-934e7512f3a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:16.964838 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65d7374-2cc0-4b2d-b0c4-934e7512f3a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:16.967269 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65d7374-2cc0-4b2d-b0c4-934e7512f3a6 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:16.981590 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 828/1646] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:29:16 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:29:16.987755 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77236e-40a4-416c-bd91-8278767316e0 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:17.014305 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77236e-40a4-416c-bd91-8278767316e0 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:17.020181 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e6fe06-37f6-45a4-9619-91b1ae7b8e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:17.021217 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e6fe06-37f6-45a4-9619-91b1ae7b8e44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:17.021619 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e6fe06-37f6-45a4-9619-91b1ae7b8e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:17.021964 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e6fe06-37f6-45a4-9619-91b1ae7b8e44 admin admin] PATH_INFO: `/v3/projects/d3545a9bd9a14de998a60c368027e005/users/fdbdd2b7bd38484a9b474c793f84c563/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:17.024787 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e6fe06-37f6-45a4-9619-91b1ae7b8e44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3545a9bd9a14de998a60c368027e005, user_id=fdbdd2b7bd38484a9b474c793f84c563, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:17.030244 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e6fe06-37f6-45a4-9619-91b1ae7b8e44 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:17.139152 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 819/1647] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:29:16 2022] PUT /identity/v3/projects/d3545a9bd9a14de998a60c368027e005/users/fdbdd2b7bd38484a9b474c793f84c563/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:29:18.425653 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65d7374-2cc0-4b2d-b0c4-934e7512f3a6 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:18.430787 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-c65d7374-2cc0-4b2d-b0c4-934e7512f3a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:18.525924 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65d7374-2cc0-4b2d-b0c4-934e7512f3a6 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:18.789594 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5bcf9a-30ae-439d-820c-cdc09536d401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:18.790393 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5bcf9a-30ae-439d-820c-cdc09536d401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:18.791768 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5bcf9a-30ae-439d-820c-cdc09536d401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:18.792169 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5bcf9a-30ae-439d-820c-cdc09536d401 admin admin] PATH_INFO: `/v3/projects/eba9fe072ea34323bbebbc34c646cd3f` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:18.794026 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5bcf9a-30ae-439d-820c-cdc09536d401 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eba9fe072ea34323bbebbc34c646cd3f)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:18.795273 dv-cinder-854265-2-smb devstack@keystone.service[81546]: WARNING py.warnings [None req-7c5bcf9a-30ae-439d-820c-cdc09536d401 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:29:18.795273 dv-cinder-854265-2-smb devstack@keystone.service[81546]: warnings.warn(msg) Aug 30 04:29:18.795273 dv-cinder-854265-2-smb devstack@keystone.service[81546]: Aug 30 04:29:18.797116 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5bcf9a-30ae-439d-820c-cdc09536d401 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:18.907622 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-7c5bcf9a-30ae-439d-820c-cdc09536d401 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eba9fe072ea34323bbebbc34c646cd3f', 'request_id': 'req-7c5bcf9a-30ae-439d-820c-cdc09536d401'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:18.962183 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-7c5bcf9a-30ae-439d-820c-cdc09536d401 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eba9fe072ea34323bbebbc34c646cd3f', 'request_id': 'req-7c5bcf9a-30ae-439d-820c-cdc09536d401'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:18.973869 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-7c5bcf9a-30ae-439d-820c-cdc09536d401 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eba9fe072ea34323bbebbc34c646cd3f', 'request_id': 'req-7c5bcf9a-30ae-439d-820c-cdc09536d401'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:18.996793 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-7c5bcf9a-30ae-439d-820c-cdc09536d401 admin admin] The token cache is being invalidate because project eba9fe072ea34323bbebbc34c646cd3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:29:18.997252 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-7c5bcf9a-30ae-439d-820c-cdc09536d401 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:18.998388 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-7c5bcf9a-30ae-439d-820c-cdc09536d401 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:19.007345 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 829/1648] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:29:18 2022] DELETE /identity/v3/projects/eba9fe072ea34323bbebbc34c646cd3f => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:29:19.014780 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899b103-58e1-4ddc-8bbe-8b86797e42cb None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:19.015514 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899b103-58e1-4ddc-8bbe-8b86797e42cb None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:19.015514 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899b103-58e1-4ddc-8bbe-8b86797e42cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:19.048519 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-0899b103-58e1-4ddc-8bbe-8b86797e42cb None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:19.050346 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-0899b103-58e1-4ddc-8bbe-8b86797e42cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:19.086353 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:19.287854 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 820/1649] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:29:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:29:19.303300 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc01ea02-54e7-4673-b1a0-b4c1515298cc None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:19.304536 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc01ea02-54e7-4673-b1a0-b4c1515298cc None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:19.305345 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc01ea02-54e7-4673-b1a0-b4c1515298cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:19.383838 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-bc01ea02-54e7-4673-b1a0-b4c1515298cc None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:19.390183 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-bc01ea02-54e7-4673-b1a0-b4c1515298cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:19.418305 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 830/1650] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:29:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:19.425014 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0899b103-58e1-4ddc-8bbe-8b86797e42cb None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:19.449029 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0899b103-58e1-4ddc-8bbe-8b86797e42cb None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:19.472289 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d49c0e6-c767-4f18-a041-bd52b37af747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:19.473126 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49c0e6-c767-4f18-a041-bd52b37af747 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:19.473494 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49c0e6-c767-4f18-a041-bd52b37af747 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:19.474080 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49c0e6-c767-4f18-a041-bd52b37af747 admin admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:19.474378 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d49c0e6-c767-4f18-a041-bd52b37af747 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:29:19.474685 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d49c0e6-c767-4f18-a041-bd52b37af747 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:19.476782 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d49c0e6-c767-4f18-a041-bd52b37af747 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:19.526936 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 821/1651] 10.222.0.91 () {58 vars in 1153 bytes} [Tue Aug 30 04:29:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:29:19.531686 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc01ea02-54e7-4673-b1a0-b4c1515298cc None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:19.624197 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc01ea02-54e7-4673-b1a0-b4c1515298cc None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:19.665712 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc88cf62-ca59-42dc-a75c-57e25ba9d30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:19.670275 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc88cf62-ca59-42dc-a75c-57e25ba9d30e admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:19.671265 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc88cf62-ca59-42dc-a75c-57e25ba9d30e admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:19.673073 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc88cf62-ca59-42dc-a75c-57e25ba9d30e admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:19.675823 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc88cf62-ca59-42dc-a75c-57e25ba9d30e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:19.681875 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc88cf62-ca59-42dc-a75c-57e25ba9d30e admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:19.776867 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 831/1652] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:29:19 2022] POST /identity/v3/projects => generated 365 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:29:19.779698 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d49c0e6-c767-4f18-a041-bd52b37af747 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:19.822635 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d49c0e6-c767-4f18-a041-bd52b37af747 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:20.158413 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c386f04-3d9a-4296-b6f4-cf2c79fcdec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:20.162075 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c386f04-3d9a-4296-b6f4-cf2c79fcdec5 admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:20.162585 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c386f04-3d9a-4296-b6f4-cf2c79fcdec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:20.163191 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c386f04-3d9a-4296-b6f4-cf2c79fcdec5 admin admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:20.164417 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c386f04-3d9a-4296-b6f4-cf2c79fcdec5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:20.167051 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c386f04-3d9a-4296-b6f4-cf2c79fcdec5 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:20.220610 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 822/1653] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:29:19 2022] POST /identity/v3/users => generated 283 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:29:20.226382 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc88cf62-ca59-42dc-a75c-57e25ba9d30e admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:20.234049 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:20.243740 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc88cf62-ca59-42dc-a75c-57e25ba9d30e admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:20.254331 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22cb56-5230-445a-abbd-db4480fad083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:20.255460 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22cb56-5230-445a-abbd-db4480fad083 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:20.256260 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22cb56-5230-445a-abbd-db4480fad083 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:20.257393 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22cb56-5230-445a-abbd-db4480fad083 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:20.259143 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f22cb56-5230-445a-abbd-db4480fad083 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:20.262278 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f22cb56-5230-445a-abbd-db4480fad083 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:20.295709 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c386f04-3d9a-4296-b6f4-cf2c79fcdec5 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:20.296200 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 832/1654] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:29:20.311734 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c386f04-3d9a-4296-b6f4-cf2c79fcdec5 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:20.319831 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1a8530-b5c5-43d8-b29c-5e5254b3ea7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:20.320970 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a8530-b5c5-43d8-b29c-5e5254b3ea7d admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:20.321415 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a8530-b5c5-43d8-b29c-5e5254b3ea7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:20.321847 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a8530-b5c5-43d8-b29c-5e5254b3ea7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:20.322827 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1a8530-b5c5-43d8-b29c-5e5254b3ea7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:20.324793 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1a8530-b5c5-43d8-b29c-5e5254b3ea7d admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:20.352303 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22cb56-5230-445a-abbd-db4480fad083 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:20.357428 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 823/1655] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:29:20.375241 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22cb56-5230-445a-abbd-db4480fad083 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:20.398522 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e3968-c417-465d-be50-c8f814714795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:20.399507 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e3968-c417-465d-be50-c8f814714795 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:20.400095 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e3968-c417-465d-be50-c8f814714795 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:20.400531 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e3968-c417-465d-be50-c8f814714795 admin admin] PATH_INFO: `/v3/projects/100239fde42b4375a17c1395b26c20d4/users/ed60126ecfae42caa30d13e8f037608b/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:20.423414 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e3968-c417-465d-be50-c8f814714795 admin admin] RBAC: Authorizing `identity:create_grant(project_id=100239fde42b4375a17c1395b26c20d4, user_id=ed60126ecfae42caa30d13e8f037608b, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:20.429245 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e3968-c417-465d-be50-c8f814714795 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:20.459971 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 833/1656] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:29:20 2022] PUT /identity/v3/projects/100239fde42b4375a17c1395b26c20d4/users/ed60126ecfae42caa30d13e8f037608b/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:29:20.475139 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24301574-5c40-4353-bd14-a0eba0f404db None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:20.475787 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24301574-5c40-4353-bd14-a0eba0f404db None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:20.476628 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24301574-5c40-4353-bd14-a0eba0f404db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:20.533770 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-24301574-5c40-4353-bd14-a0eba0f404db None None] MFA Rules not processed for user `ed60126ecfae42caa30d13e8f037608b`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:20.538881 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-24301574-5c40-4353-bd14-a0eba0f404db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:20.683711 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e3968-c417-465d-be50-c8f814714795 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:20.685184 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 824/1657] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:29:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:20.910854 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e3968-c417-465d-be50-c8f814714795 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:20.967595 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d82a0-b048-47cf-9d7c-6fdd0b92e734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:20.969382 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d82a0-b048-47cf-9d7c-6fdd0b92e734 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:20.970261 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d82a0-b048-47cf-9d7c-6fdd0b92e734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:20.971055 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d82a0-b048-47cf-9d7c-6fdd0b92e734 admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:20.979659 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1d82a0-b048-47cf-9d7c-6fdd0b92e734 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:20.982359 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1d82a0-b048-47cf-9d7c-6fdd0b92e734 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:21.062781 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 834/1658] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:29:20 2022] POST /identity/v3/projects => generated 369 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:29:21.067796 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24301574-5c40-4353-bd14-a0eba0f404db None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:21.087315 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24301574-5c40-4353-bd14-a0eba0f404db None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:21.142759 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce076a-bdb7-49ca-9d1f-e237aba39350 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:21.143197 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce076a-bdb7-49ca-9d1f-e237aba39350 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:21.143663 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce076a-bdb7-49ca-9d1f-e237aba39350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:21.211137 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:21.247043 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-c8ce076a-bdb7-49ca-9d1f-e237aba39350 None None] MFA Rules not processed for user `fdbdd2b7bd38484a9b474c793f84c563`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:21.248456 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-c8ce076a-bdb7-49ca-9d1f-e237aba39350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:21.318279 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a031db-8211-47bf-aa13-aadd26abbb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:21.319345 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a031db-8211-47bf-aa13-aadd26abbb68 admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:21.323578 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a031db-8211-47bf-aa13-aadd26abbb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:21.324197 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a031db-8211-47bf-aa13-aadd26abbb68 admin admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:21.327127 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a031db-8211-47bf-aa13-aadd26abbb68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:21.335127 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a031db-8211-47bf-aa13-aadd26abbb68 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:21.415564 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 825/1659] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:29:21 2022] POST /identity/v3/users => generated 291 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:29:21.415564 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a8f9d-06ec-48e1-ac0a-da0862069e94 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:21.415564 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a8f9d-06ec-48e1-ac0a-da0862069e94 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:21.415564 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a8f9d-06ec-48e1-ac0a-da0862069e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:21.522975 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 835/1660] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:29:21 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:21.523886 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce076a-bdb7-49ca-9d1f-e237aba39350 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:21.526554 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-b77a8f9d-06ec-48e1-ac0a-da0862069e94 None None] MFA Rules not processed for user `364abb1a054f45c3b95ac2f5714763a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:21.527845 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-b77a8f9d-06ec-48e1-ac0a-da0862069e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:21.542350 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce076a-bdb7-49ca-9d1f-e237aba39350 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:21.565279 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3aed2a-9fbb-425a-b07b-0b5b009cc849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:21.565562 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3aed2a-9fbb-425a-b07b-0b5b009cc849 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:21.565718 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3aed2a-9fbb-425a-b07b-0b5b009cc849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:21.566066 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3aed2a-9fbb-425a-b07b-0b5b009cc849 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:21.566703 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3aed2a-9fbb-425a-b07b-0b5b009cc849 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:21.568636 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3aed2a-9fbb-425a-b07b-0b5b009cc849 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:21.583997 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 836/1661] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:29:21 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:29:21.589556 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3aed2a-9fbb-425a-b07b-0b5b009cc849 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:21.594850 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-0a3aed2a-9fbb-425a-b07b-0b5b009cc849 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:21.644522 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3aed2a-9fbb-425a-b07b-0b5b009cc849 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:21.656257 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505d231a-6ca5-4af1-a48c-ff39c68d215c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:21.659883 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d231a-6ca5-4af1-a48c-ff39c68d215c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:21.660202 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d231a-6ca5-4af1-a48c-ff39c68d215c admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:21.660478 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d231a-6ca5-4af1-a48c-ff39c68d215c admin admin] PATH_INFO: `/v3/users/b66e74b0f3a84d3b90c81a6ae587ba85` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:21.664271 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505d231a-6ca5-4af1-a48c-ff39c68d215c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b66e74b0f3a84d3b90c81a6ae587ba85)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:21.671520 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505d231a-6ca5-4af1-a48c-ff39c68d215c admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:21.743386 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:21.812103 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-505d231a-6ca5-4af1-a48c-ff39c68d215c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b66e74b0f3a84d3b90c81a6ae587ba85'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:21.828272 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-505d231a-6ca5-4af1-a48c-ff39c68d215c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b66e74b0f3a84d3b90c81a6ae587ba85'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:21.844410 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 826/1662] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:29:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 433 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:21.845375 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a8f9d-06ec-48e1-ac0a-da0862069e94 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:21.857892 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-505d231a-6ca5-4af1-a48c-ff39c68d215c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b66e74b0f3a84d3b90c81a6ae587ba85'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:21.858758 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-505d231a-6ca5-4af1-a48c-ff39c68d215c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b66e74b0f3a84d3b90c81a6ae587ba85'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:21.872324 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a8f9d-06ec-48e1-ac0a-da0862069e94 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:21.884706 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1ce10f-f9ac-48cd-9389-35527f9f81bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:21.885246 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-505d231a-6ca5-4af1-a48c-ff39c68d215c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b66e74b0f3a84d3b90c81a6ae587ba85'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:21.885435 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ce10f-f9ac-48cd-9389-35527f9f81bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:21.885679 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ce10f-f9ac-48cd-9389-35527f9f81bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:21.886057 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ce10f-f9ac-48cd-9389-35527f9f81bf admin admin] PATH_INFO: `/v3/projects/e4cbb49e912a4c4d8572f86168831266/users/bbf6a0a487d44d3e9b06106c14979b60/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:21.895490 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 837/1663] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:29:21 2022] DELETE /identity/v3/users/b66e74b0f3a84d3b90c81a6ae587ba85 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:29:21.896896 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b60f4-6bf7-4a44-a987-cba24382a719 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:21.897180 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b60f4-6bf7-4a44-a987-cba24382a719 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:21.897452 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b60f4-6bf7-4a44-a987-cba24382a719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:21.923578 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1ce10f-f9ac-48cd-9389-35527f9f81bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4cbb49e912a4c4d8572f86168831266, user_id=bbf6a0a487d44d3e9b06106c14979b60, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:21.926447 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1ce10f-f9ac-48cd-9389-35527f9f81bf admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:21.950610 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-0a0b60f4-6bf7-4a44-a987-cba24382a719 None None] MFA Rules not processed for user `364abb1a054f45c3b95ac2f5714763a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:21.962648 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-0a0b60f4-6bf7-4a44-a987-cba24382a719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:21.967459 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 827/1664] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:29:21 2022] PUT /identity/v3/projects/e4cbb49e912a4c4d8572f86168831266/users/bbf6a0a487d44d3e9b06106c14979b60/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:29:21.968743 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c90497-d6c5-4528-b040-5256bebe4bf6 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:21.969664 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c90497-d6c5-4528-b040-5256bebe4bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:21.970589 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c90497-d6c5-4528-b040-5256bebe4bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:22.024462 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-d5c90497-d6c5-4528-b040-5256bebe4bf6 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:22.026216 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-d5c90497-d6c5-4528-b040-5256bebe4bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:22.148533 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 838/1665] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:29:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:22.150964 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0b60f4-6bf7-4a44-a987-cba24382a719 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:22.154620 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-0a0b60f4-6bf7-4a44-a987-cba24382a719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:22.192475 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 828/1666] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:29:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:22.193780 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c90497-d6c5-4528-b040-5256bebe4bf6 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:22.198205 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-d5c90497-d6c5-4528-b040-5256bebe4bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:22.254135 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:22.289547 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0b60f4-6bf7-4a44-a987-cba24382a719 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:22.297627 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a48064-646b-4bc5-b981-945390894b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:22.298280 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a48064-646b-4bc5-b981-945390894b87 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:22.298554 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a48064-646b-4bc5-b981-945390894b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:22.298876 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a48064-646b-4bc5-b981-945390894b87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:22.300242 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a48064-646b-4bc5-b981-945390894b87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:22.301808 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a48064-646b-4bc5-b981-945390894b87 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:22.315383 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 839/1667] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:29:22.317335 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a48064-646b-4bc5-b981-945390894b87 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:22.319184 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-15a48064-646b-4bc5-b981-945390894b87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:22.393385 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c90497-d6c5-4528-b040-5256bebe4bf6 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:22.406314 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28de57e-0a0b-4aee-a57b-e6c69d2ec75b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd806295278ae4997b5c6968aa553290c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:22.406984 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28de57e-0a0b-4aee-a57b-e6c69d2ec75b service nova] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:22.407338 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28de57e-0a0b-4aee-a57b-e6c69d2ec75b service nova] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:22.407616 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28de57e-0a0b-4aee-a57b-e6c69d2ec75b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:22.409751 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-c28de57e-0a0b-4aee-a57b-e6c69d2ec75b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:22.413273 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:22.432267 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28de57e-0a0b-4aee-a57b-e6c69d2ec75b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:22.440910 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28de57e-0a0b-4aee-a57b-e6c69d2ec75b service nova] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:22.464881 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a48064-646b-4bc5-b981-945390894b87 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:22.476526 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 829/1668] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:29:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:29:22.477627 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9eafd-1677-443f-a7a7-945b7d1e1225 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:22.478296 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28de57e-0a0b-4aee-a57b-e6c69d2ec75b service nova] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:22.478872 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9eafd-1677-443f-a7a7-945b7d1e1225 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:22.479163 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9eafd-1677-443f-a7a7-945b7d1e1225 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:22.480612 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9eafd-1677-443f-a7a7-945b7d1e1225 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:22.509159 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc9eafd-1677-443f-a7a7-945b7d1e1225 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:22.514488 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc9eafd-1677-443f-a7a7-945b7d1e1225 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:22.514974 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28de57e-0a0b-4aee-a57b-e6c69d2ec75b service nova] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:22.538834 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 840/1669] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:29:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:29:22.542587 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45071507-f8bd-422a-b46f-d6df2985563e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:22.545827 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45071507-f8bd-422a-b46f-d6df2985563e admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:22.546950 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45071507-f8bd-422a-b46f-d6df2985563e admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:22.548592 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45071507-f8bd-422a-b46f-d6df2985563e admin admin] PATH_INFO: `/v3/projects/e4cbb49e912a4c4d8572f86168831266/users/bbf6a0a487d44d3e9b06106c14979b60/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:22.557988 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45071507-f8bd-422a-b46f-d6df2985563e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4cbb49e912a4c4d8572f86168831266, user_id=bbf6a0a487d44d3e9b06106c14979b60, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:22.563739 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45071507-f8bd-422a-b46f-d6df2985563e admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:22.605335 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 830/1670] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:29:22 2022] PUT /identity/v3/projects/e4cbb49e912a4c4d8572f86168831266/users/bbf6a0a487d44d3e9b06106c14979b60/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:29:22.618493 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2df42-bb1d-4a67-83f5-35254ee2fdf5 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:22.619744 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2df42-bb1d-4a67-83f5-35254ee2fdf5 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:22.620431 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2df42-bb1d-4a67-83f5-35254ee2fdf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:22.755087 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-e0f2df42-bb1d-4a67-83f5-35254ee2fdf5 None None] MFA Rules not processed for user `bbf6a0a487d44d3e9b06106c14979b60`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:22.760375 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-e0f2df42-bb1d-4a67-83f5-35254ee2fdf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:23.042033 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 841/1671] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:29:22 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 425 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:23.056785 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45071507-f8bd-422a-b46f-d6df2985563e admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:23.068124 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-45071507-f8bd-422a-b46f-d6df2985563e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:23.227629 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45071507-f8bd-422a-b46f-d6df2985563e admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:23.236173 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f0895d-a89c-444b-9e02-842d241a1626 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:23.236920 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0895d-a89c-444b-9e02-842d241a1626 service cinder] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:23.237411 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0895d-a89c-444b-9e02-842d241a1626 service cinder] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:23.237756 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0895d-a89c-444b-9e02-842d241a1626 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:23.289322 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f0895d-a89c-444b-9e02-842d241a1626 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:23.293938 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f0895d-a89c-444b-9e02-842d241a1626 service cinder] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:23.310222 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ae954-c894-4534-a082-7e460f356e67 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:23.310759 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ae954-c894-4534-a082-7e460f356e67 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:23.311063 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ae954-c894-4534-a082-7e460f356e67 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:23.313283 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 842/1672] 10.222.0.91 () {54 vars in 921 bytes} [Tue Aug 30 04:29:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:29:23.331802 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92187f4-688e-4824-a9a3-fe172be4334d None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:23.332615 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92187f4-688e-4824-a9a3-fe172be4334d None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:23.332756 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92187f4-688e-4824-a9a3-fe172be4334d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:23.360221 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 831/1673] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:29:23 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:29:23.435424 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-f92187f4-688e-4824-a9a3-fe172be4334d None None] MFA Rules not processed for user `47a092fbe1334f7e9ae4ba9bdb5e9f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:23.443958 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-f92187f4-688e-4824-a9a3-fe172be4334d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:23.800302 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 843/1674] 10.222.0.91 () {58 vars in 1018 bytes} [Tue Aug 30 04:29:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 470 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:23.966935 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f0895d-a89c-444b-9e02-842d241a1626 service cinder] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:23.968496 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-69f0895d-a89c-444b-9e02-842d241a1626 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:23.997360 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f0895d-a89c-444b-9e02-842d241a1626 service cinder] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:24.049230 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd152c-4881-4768-aaba-05ea77573a5e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47a092fbe1334f7e9ae4ba9bdb5e9f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:24.049885 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd152c-4881-4768-aaba-05ea77573a5e service placement] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:24.050163 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd152c-4881-4768-aaba-05ea77573a5e service placement] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:24.050463 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd152c-4881-4768-aaba-05ea77573a5e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:24.075749 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbd152c-4881-4768-aaba-05ea77573a5e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:24.077497 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbd152c-4881-4768-aaba-05ea77573a5e service placement] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:24.126727 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 832/1675] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:29:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:29:25.210249 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc56f7a-7260-40da-b675-12dade248c94 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:25.210784 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc56f7a-7260-40da-b675-12dade248c94 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:25.211447 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc56f7a-7260-40da-b675-12dade248c94 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:25.225138 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 844/1676] 10.222.0.91 () {54 vars in 912 bytes} [Tue Aug 30 04:29:25 2022] GET /identity => generated 270 bytes in 21 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:29:25.248549 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48af646-b488-4361-98bf-bf97f626efa9 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:25.250485 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48af646-b488-4361-98bf-bf97f626efa9 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:25.252430 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48af646-b488-4361-98bf-bf97f626efa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:25.420713 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-d48af646-b488-4361-98bf-bf97f626efa9 None None] MFA Rules not processed for user `1c05f49ae42b4f9583ff10b2cfce52a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:25.422432 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-d48af646-b488-4361-98bf-bf97f626efa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:25.579723 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 833/1677] 10.222.0.91 () {58 vars in 1009 bytes} [Tue Aug 30 04:29:25 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:25.673790 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc56f7a-7260-40da-b675-12dade248c94 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:25.692461 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc56f7a-7260-40da-b675-12dade248c94 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:25.704054 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a32e2-d261-4d2d-b45a-439a2e78e194 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:25.705103 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a32e2-d261-4d2d-b45a-439a2e78e194 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:25.705694 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a32e2-d261-4d2d-b45a-439a2e78e194 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:25.706265 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a32e2-d261-4d2d-b45a-439a2e78e194 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:25.731443 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233a32e2-d261-4d2d-b45a-439a2e78e194 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:25.733406 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233a32e2-d261-4d2d-b45a-439a2e78e194 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:25.749848 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 845/1678] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:29:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:29:26.702461 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48af646-b488-4361-98bf-bf97f626efa9 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:26.704515 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-d48af646-b488-4361-98bf-bf97f626efa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:26.756758 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:26.899060 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48af646-b488-4361-98bf-bf97f626efa9 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:26.908286 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5944f5c8-c0ef-409b-a86f-b5d2548596b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:26.909415 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944f5c8-c0ef-409b-a86f-b5d2548596b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:26.910136 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944f5c8-c0ef-409b-a86f-b5d2548596b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:26.910656 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944f5c8-c0ef-409b-a86f-b5d2548596b3 admin admin] PATH_INFO: `/v3/users/d39debd8004b4500bb812cd28ee3af94` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:26.914508 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5944f5c8-c0ef-409b-a86f-b5d2548596b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d39debd8004b4500bb812cd28ee3af94)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:26.917699 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5944f5c8-c0ef-409b-a86f-b5d2548596b3 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:27.019263 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-5944f5c8-c0ef-409b-a86f-b5d2548596b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd39debd8004b4500bb812cd28ee3af94'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:27.020102 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-5944f5c8-c0ef-409b-a86f-b5d2548596b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd39debd8004b4500bb812cd28ee3af94'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:27.020786 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-5944f5c8-c0ef-409b-a86f-b5d2548596b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd39debd8004b4500bb812cd28ee3af94'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:27.041341 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-5944f5c8-c0ef-409b-a86f-b5d2548596b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd39debd8004b4500bb812cd28ee3af94'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:27.096836 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-5944f5c8-c0ef-409b-a86f-b5d2548596b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd39debd8004b4500bb812cd28ee3af94'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:27.162788 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 834/1679] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:29:26 2022] DELETE /identity/v3/users/d39debd8004b4500bb812cd28ee3af94 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:29:27.304038 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a32e2-d261-4d2d-b45a-439a2e78e194 service neutron] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:27.311125 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-233a32e2-d261-4d2d-b45a-439a2e78e194 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:27.411625 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a32e2-d261-4d2d-b45a-439a2e78e194 service neutron] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:27.586231 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:27.623714 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b5ae81-bfc7-4d97-8bd0-99c20fe1e922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:27.624730 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5ae81-bfc7-4d97-8bd0-99c20fe1e922 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:27.625186 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5ae81-bfc7-4d97-8bd0-99c20fe1e922 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:27.625633 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5ae81-bfc7-4d97-8bd0-99c20fe1e922 admin admin] PATH_INFO: `/v3/projects/13f8a3965e8d4b0ab2dc90fb59cd5916` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:27.628466 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b5ae81-bfc7-4d97-8bd0-99c20fe1e922 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13f8a3965e8d4b0ab2dc90fb59cd5916)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:27.630811 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b5ae81-bfc7-4d97-8bd0-99c20fe1e922 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:27.797676 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5944f5c8-c0ef-409b-a86f-b5d2548596b3 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:27.807207 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-5944f5c8-c0ef-409b-a86f-b5d2548596b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:27.833232 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5944f5c8-c0ef-409b-a86f-b5d2548596b3 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:27.844206 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-d5b5ae81-bfc7-4d97-8bd0-99c20fe1e922 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13f8a3965e8d4b0ab2dc90fb59cd5916', 'request_id': 'req-d5b5ae81-bfc7-4d97-8bd0-99c20fe1e922'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:27.869235 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-d5b5ae81-bfc7-4d97-8bd0-99c20fe1e922 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13f8a3965e8d4b0ab2dc90fb59cd5916', 'request_id': 'req-d5b5ae81-bfc7-4d97-8bd0-99c20fe1e922'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:27.888730 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-d5b5ae81-bfc7-4d97-8bd0-99c20fe1e922 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13f8a3965e8d4b0ab2dc90fb59cd5916', 'request_id': 'req-d5b5ae81-bfc7-4d97-8bd0-99c20fe1e922'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:27.923348 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-d5b5ae81-bfc7-4d97-8bd0-99c20fe1e922 admin admin] The token cache is being invalidate because project 13f8a3965e8d4b0ab2dc90fb59cd5916 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:29:27.927540 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-d5b5ae81-bfc7-4d97-8bd0-99c20fe1e922 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:27.928821 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-d5b5ae81-bfc7-4d97-8bd0-99c20fe1e922 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:27.930584 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 846/1680] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:29:27 2022] DELETE /identity/v3/projects/13f8a3965e8d4b0ab2dc90fb59cd5916 => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:29:27.943544 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb74fa-961c-465e-99ab-2c07853ceed0 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:27.944461 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb74fa-961c-465e-99ab-2c07853ceed0 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:27.945350 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb74fa-961c-465e-99ab-2c07853ceed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:27.997285 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-ccdb74fa-961c-465e-99ab-2c07853ceed0 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:28.000007 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-ccdb74fa-961c-465e-99ab-2c07853ceed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:28.118082 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f28a8c0-22e4-479b-a551-850be3af07d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:28.119141 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28a8c0-22e4-479b-a551-850be3af07d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:28.119623 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28a8c0-22e4-479b-a551-850be3af07d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:28.136666 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28a8c0-22e4-479b-a551-850be3af07d3 admin admin] PATH_INFO: `/v3/users/ed60126ecfae42caa30d13e8f037608b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:28.151138 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f28a8c0-22e4-479b-a551-850be3af07d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed60126ecfae42caa30d13e8f037608b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:28.154898 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f28a8c0-22e4-479b-a551-850be3af07d3 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:28.328806 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 847/1681] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:29:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:29:28.333648 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ecf044-80fa-4e03-88ba-be9923ea89a7 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:28.334687 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ecf044-80fa-4e03-88ba-be9923ea89a7 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:28.335454 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ecf044-80fa-4e03-88ba-be9923ea89a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:28.382976 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:28.416123 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-2f28a8c0-22e4-479b-a551-850be3af07d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed60126ecfae42caa30d13e8f037608b'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:28.417385 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-2f28a8c0-22e4-479b-a551-850be3af07d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed60126ecfae42caa30d13e8f037608b'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:28.419328 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-2f28a8c0-22e4-479b-a551-850be3af07d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed60126ecfae42caa30d13e8f037608b'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:28.448313 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-65ecf044-80fa-4e03-88ba-be9923ea89a7 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:28.461197 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-65ecf044-80fa-4e03-88ba-be9923ea89a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:28.508155 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-2f28a8c0-22e4-479b-a551-850be3af07d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed60126ecfae42caa30d13e8f037608b'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:28.538746 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 848/1682] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:29:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:28.562425 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ecf044-80fa-4e03-88ba-be9923ea89a7 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:28.626164 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-2f28a8c0-22e4-479b-a551-850be3af07d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed60126ecfae42caa30d13e8f037608b'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:28.665253 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ecf044-80fa-4e03-88ba-be9923ea89a7 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:28.683873 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 835/1683] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:29:27 2022] DELETE /identity/v3/users/ed60126ecfae42caa30d13e8f037608b => generated 0 bytes in 887 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:29:28.694755 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff4f53-dff0-4253-86ce-30fdbbabee24 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:28.695111 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff4f53-dff0-4253-86ce-30fdbbabee24 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:28.695333 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff4f53-dff0-4253-86ce-30fdbbabee24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:28.719533 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9756ea-e7b0-499c-9cef-e28224e3eba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:28.720566 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9756ea-e7b0-499c-9cef-e28224e3eba1 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:28.721014 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9756ea-e7b0-499c-9cef-e28224e3eba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:28.724982 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9756ea-e7b0-499c-9cef-e28224e3eba1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:28.726255 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9756ea-e7b0-499c-9cef-e28224e3eba1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:29:28.726817 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9756ea-e7b0-499c-9cef-e28224e3eba1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:28.740223 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9756ea-e7b0-499c-9cef-e28224e3eba1 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:28.755152 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-5dff4f53-dff0-4253-86ce-30fdbbabee24 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:28.764392 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-5dff4f53-dff0-4253-86ce-30fdbbabee24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:28.819445 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 849/1684] 10.222.0.91 () {58 vars in 1153 bytes} [Tue Aug 30 04:29:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:29:28.825922 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9756ea-e7b0-499c-9cef-e28224e3eba1 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:28.840803 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-5d9756ea-e7b0-499c-9cef-e28224e3eba1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:28.980209 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 836/1685] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:29:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:28.981849 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff4f53-dff0-4253-86ce-30fdbbabee24 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:29.019294 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff4f53-dff0-4253-86ce-30fdbbabee24 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:29.043661 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d6c7f2-aceb-44b0-abf1-1f9ee9bd564c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:29.045280 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d6c7f2-aceb-44b0-abf1-1f9ee9bd564c admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:29.047900 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d6c7f2-aceb-44b0-abf1-1f9ee9bd564c admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:29.048974 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d6c7f2-aceb-44b0-abf1-1f9ee9bd564c admin admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:29.053972 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d6c7f2-aceb-44b0-abf1-1f9ee9bd564c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:29.063689 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d6c7f2-aceb-44b0-abf1-1f9ee9bd564c admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:29.090618 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:29.106373 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9756ea-e7b0-499c-9cef-e28224e3eba1 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:29.217521 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 837/1686] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:29:28 2022] POST /identity/v3/projects => generated 365 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:29:29.220979 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d6c7f2-aceb-44b0-abf1-1f9ee9bd564c admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:29.224915 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-a5d6c7f2-aceb-44b0-abf1-1f9ee9bd564c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:29.450087 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e9c67-bf43-4a9f-ae57-fd4a69e2160b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47a092fbe1334f7e9ae4ba9bdb5e9f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:29.451168 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e9c67-bf43-4a9f-ae57-fd4a69e2160b service placement] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:29.451701 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e9c67-bf43-4a9f-ae57-fd4a69e2160b service placement] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:29.452242 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e9c67-bf43-4a9f-ae57-fd4a69e2160b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:29.471204 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-ba4e9c67-bf43-4a9f-ae57-fd4a69e2160b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:29.536045 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e9c67-bf43-4a9f-ae57-fd4a69e2160b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:29.539746 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e9c67-bf43-4a9f-ae57-fd4a69e2160b service placement] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:29.566814 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d6c7f2-aceb-44b0-abf1-1f9ee9bd564c admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:29.585756 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1dc6c4-412b-4b26-91be-55a68c80efd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:29.586826 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1dc6c4-412b-4b26-91be-55a68c80efd9 service neutron] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:29.587308 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1dc6c4-412b-4b26-91be-55a68c80efd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:29.587774 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1dc6c4-412b-4b26-91be-55a68c80efd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:29.608064 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 850/1687] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:29:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 788 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:29:29.610548 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e9c67-bf43-4a9f-ae57-fd4a69e2160b service placement] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:29.667068 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e9c67-bf43-4a9f-ae57-fd4a69e2160b service placement] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:29.820718 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:29.923572 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d55f0f-eb56-4263-aa30-66df5d24c4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:29.924108 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1dc6c4-412b-4b26-91be-55a68c80efd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:29.925731 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d55f0f-eb56-4263-aa30-66df5d24c4ab admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:29.926170 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d55f0f-eb56-4263-aa30-66df5d24c4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:29.926516 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d55f0f-eb56-4263-aa30-66df5d24c4ab admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:29.927420 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d55f0f-eb56-4263-aa30-66df5d24c4ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:29.934216 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d55f0f-eb56-4263-aa30-66df5d24c4ab admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:29.935724 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1dc6c4-412b-4b26-91be-55a68c80efd9 service neutron] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:29.962812 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 838/1688] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:29:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 746 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:29:29.992887 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 851/1689] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:29:29 2022] POST /identity/v3/users => generated 283 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:29:29.999950 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1dc6c4-412b-4b26-91be-55a68c80efd9 service neutron] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:30.020601 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1dc6c4-412b-4b26-91be-55a68c80efd9 service neutron] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:30.047067 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e317004-d089-4e69-9c69-ea3468759bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:30.048125 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e317004-d089-4e69-9c69-ea3468759bf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:30.048602 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e317004-d089-4e69-9c69-ea3468759bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:30.049061 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e317004-d089-4e69-9c69-ea3468759bf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:30.049994 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e317004-d089-4e69-9c69-ea3468759bf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:30.055585 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e317004-d089-4e69-9c69-ea3468759bf3 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:30.084624 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 839/1690] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:29:30.091560 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d55f0f-eb56-4263-aa30-66df5d24c4ab admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:30.116496 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d55f0f-eb56-4263-aa30-66df5d24c4ab admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:30.126165 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c8bb10-ad50-4eab-9011-918d1a7beb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:30.126835 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8bb10-ad50-4eab-9011-918d1a7beb90 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:30.127112 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8bb10-ad50-4eab-9011-918d1a7beb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:30.127384 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8bb10-ad50-4eab-9011-918d1a7beb90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:30.128148 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c8bb10-ad50-4eab-9011-918d1a7beb90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:30.129946 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c8bb10-ad50-4eab-9011-918d1a7beb90 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:30.134927 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e317004-d089-4e69-9c69-ea3468759bf3 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:30.137240 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-5e317004-d089-4e69-9c69-ea3468759bf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:30.163209 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 852/1691] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:29:30.167552 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e317004-d089-4e69-9c69-ea3468759bf3 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:30.168990 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c8bb10-ad50-4eab-9011-918d1a7beb90 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:30.186494 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c8bb10-ad50-4eab-9011-918d1a7beb90 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:30.189012 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2cf1ad-b91b-41bd-8ca1-0ac8eea38c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:30.190846 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2cf1ad-b91b-41bd-8ca1-0ac8eea38c3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:30.192348 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2cf1ad-b91b-41bd-8ca1-0ac8eea38c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:30.193588 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2cf1ad-b91b-41bd-8ca1-0ac8eea38c3e admin admin] PATH_INFO: `/v3/projects/10968ce0611c4e9da11df8f03fb640d1` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:30.198654 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df8f2a5-4a90-4757-a52a-b1dfe5ef45cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:30.199614 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8f2a5-4a90-4757-a52a-b1dfe5ef45cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:30.200128 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8f2a5-4a90-4757-a52a-b1dfe5ef45cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:30.200488 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8f2a5-4a90-4757-a52a-b1dfe5ef45cd admin admin] PATH_INFO: `/v3/projects/7c9a672447c3445cbf53c3dc645cc03d/users/1b14b33f99fc44bca96bf3a8b37c7506/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:30.201013 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2cf1ad-b91b-41bd-8ca1-0ac8eea38c3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=10968ce0611c4e9da11df8f03fb640d1)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:30.204216 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2cf1ad-b91b-41bd-8ca1-0ac8eea38c3e admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:30.249561 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df8f2a5-4a90-4757-a52a-b1dfe5ef45cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c9a672447c3445cbf53c3dc645cc03d, user_id=1b14b33f99fc44bca96bf3a8b37c7506, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:30.267653 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df8f2a5-4a90-4757-a52a-b1dfe5ef45cd admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:30.355349 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-7a2cf1ad-b91b-41bd-8ca1-0ac8eea38c3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10968ce0611c4e9da11df8f03fb640d1', 'request_id': 'req-7a2cf1ad-b91b-41bd-8ca1-0ac8eea38c3e'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:30.364195 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-7a2cf1ad-b91b-41bd-8ca1-0ac8eea38c3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10968ce0611c4e9da11df8f03fb640d1', 'request_id': 'req-7a2cf1ad-b91b-41bd-8ca1-0ac8eea38c3e'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:30.379951 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 853/1692] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:29:30 2022] PUT /identity/v3/projects/7c9a672447c3445cbf53c3dc645cc03d/users/1b14b33f99fc44bca96bf3a8b37c7506/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:29:30.392119 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-7a2cf1ad-b91b-41bd-8ca1-0ac8eea38c3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10968ce0611c4e9da11df8f03fb640d1', 'request_id': 'req-7a2cf1ad-b91b-41bd-8ca1-0ac8eea38c3e'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:30.397973 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8144d6a1-d546-437a-bc61-3946400e4b3e None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:30.398449 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8144d6a1-d546-437a-bc61-3946400e4b3e None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:30.399110 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8144d6a1-d546-437a-bc61-3946400e4b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:30.420827 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-7a2cf1ad-b91b-41bd-8ca1-0ac8eea38c3e admin admin] The token cache is being invalidate because project 10968ce0611c4e9da11df8f03fb640d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:29:30.421333 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-7a2cf1ad-b91b-41bd-8ca1-0ac8eea38c3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:30.425809 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-7a2cf1ad-b91b-41bd-8ca1-0ac8eea38c3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:30.437741 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 840/1693] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:29:30 2022] DELETE /identity/v3/projects/10968ce0611c4e9da11df8f03fb640d1 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:29:30.443728 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2cf1ad-b91b-41bd-8ca1-0ac8eea38c3e admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:30.445615 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-7a2cf1ad-b91b-41bd-8ca1-0ac8eea38c3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:30.611500 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2cf1ad-b91b-41bd-8ca1-0ac8eea38c3e admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:30.624077 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-8144d6a1-d546-437a-bc61-3946400e4b3e None None] MFA Rules not processed for user `1b14b33f99fc44bca96bf3a8b37c7506`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:30.626145 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-8144d6a1-d546-437a-bc61-3946400e4b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:30.770245 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c0a9d3-1320-4386-a96e-08f2677d7dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:30.771212 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0a9d3-1320-4386-a96e-08f2677d7dc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:30.771669 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0a9d3-1320-4386-a96e-08f2677d7dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:30.772123 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0a9d3-1320-4386-a96e-08f2677d7dc2 admin admin] PATH_INFO: `/v3/users/fdbdd2b7bd38484a9b474c793f84c563` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:30.776918 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c0a9d3-1320-4386-a96e-08f2677d7dc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdbdd2b7bd38484a9b474c793f84c563)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:30.783478 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c0a9d3-1320-4386-a96e-08f2677d7dc2 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:30.798497 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:30.833721 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:30.944741 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 854/1694] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:29:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 552 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:30.959242 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8144d6a1-d546-437a-bc61-3946400e4b3e None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:30.963934 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-8144d6a1-d546-437a-bc61-3946400e4b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:31.100531 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-b1c0a9d3-1320-4386-a96e-08f2677d7dc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdbdd2b7bd38484a9b474c793f84c563'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:31.102034 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-b1c0a9d3-1320-4386-a96e-08f2677d7dc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdbdd2b7bd38484a9b474c793f84c563'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:31.103354 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-b1c0a9d3-1320-4386-a96e-08f2677d7dc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdbdd2b7bd38484a9b474c793f84c563'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:31.135956 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-b1c0a9d3-1320-4386-a96e-08f2677d7dc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdbdd2b7bd38484a9b474c793f84c563'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:31.175398 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-b1c0a9d3-1320-4386-a96e-08f2677d7dc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdbdd2b7bd38484a9b474c793f84c563'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:31.213529 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8144d6a1-d546-437a-bc61-3946400e4b3e None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:31.221673 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 841/1695] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:29:30 2022] DELETE /identity/v3/users/fdbdd2b7bd38484a9b474c793f84c563 => generated 0 bytes in 778 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:29:31.229159 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341fac25-98d4-45c9-a842-a8c29c1722ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:31.229944 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341fac25-98d4-45c9-a842-a8c29c1722ba service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:31.230306 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341fac25-98d4-45c9-a842-a8c29c1722ba service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:31.231395 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341fac25-98d4-45c9-a842-a8c29c1722ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:31.233197 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-341fac25-98d4-45c9-a842-a8c29c1722ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:31.260963 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341fac25-98d4-45c9-a842-a8c29c1722ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:31.260963 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341fac25-98d4-45c9-a842-a8c29c1722ba service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:31.290699 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 855/1696] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:29:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:29:33.063600 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c0a9d3-1320-4386-a96e-08f2677d7dc2 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:33.072095 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-b1c0a9d3-1320-4386-a96e-08f2677d7dc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:33.204905 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341fac25-98d4-45c9-a842-a8c29c1722ba service cinder] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:33.209394 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-341fac25-98d4-45c9-a842-a8c29c1722ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:33.230145 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c0a9d3-1320-4386-a96e-08f2677d7dc2 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:33.246722 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2811a8f7-58b2-489b-a4b3-7af130a3d091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:33.247646 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2811a8f7-58b2-489b-a4b3-7af130a3d091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:33.253081 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2811a8f7-58b2-489b-a4b3-7af130a3d091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:33.259307 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341fac25-98d4-45c9-a842-a8c29c1722ba service cinder] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:33.260348 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2811a8f7-58b2-489b-a4b3-7af130a3d091 admin admin] PATH_INFO: `/v3/projects/d3545a9bd9a14de998a60c368027e005` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:33.267068 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2811a8f7-58b2-489b-a4b3-7af130a3d091 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3545a9bd9a14de998a60c368027e005)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:33.269420 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2811a8f7-58b2-489b-a4b3-7af130a3d091 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:33.275997 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b44541d-7630-4ebb-b86a-542c47c6948f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:33.280820 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44541d-7630-4ebb-b86a-542c47c6948f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:33.281117 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44541d-7630-4ebb-b86a-542c47c6948f admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:33.284335 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44541d-7630-4ebb-b86a-542c47c6948f admin admin] PATH_INFO: `/v3/projects/100239fde42b4375a17c1395b26c20d4` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:33.289479 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b44541d-7630-4ebb-b86a-542c47c6948f admin admin] RBAC: Authorizing `identity:delete_project(project_id=100239fde42b4375a17c1395b26c20d4)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:33.305024 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b44541d-7630-4ebb-b86a-542c47c6948f admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:33.538636 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-2811a8f7-58b2-489b-a4b3-7af130a3d091 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3545a9bd9a14de998a60c368027e005', 'request_id': 'req-2811a8f7-58b2-489b-a4b3-7af130a3d091'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:33.572150 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-2811a8f7-58b2-489b-a4b3-7af130a3d091 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3545a9bd9a14de998a60c368027e005', 'request_id': 'req-2811a8f7-58b2-489b-a4b3-7af130a3d091'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:33.627745 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-2811a8f7-58b2-489b-a4b3-7af130a3d091 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3545a9bd9a14de998a60c368027e005', 'request_id': 'req-2811a8f7-58b2-489b-a4b3-7af130a3d091'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:33.680716 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-7b44541d-7630-4ebb-b86a-542c47c6948f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '100239fde42b4375a17c1395b26c20d4', 'request_id': 'req-7b44541d-7630-4ebb-b86a-542c47c6948f'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:33.701227 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-2811a8f7-58b2-489b-a4b3-7af130a3d091 admin admin] The token cache is being invalidate because project d3545a9bd9a14de998a60c368027e005 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:29:33.701543 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-2811a8f7-58b2-489b-a4b3-7af130a3d091 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:33.702520 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-2811a8f7-58b2-489b-a4b3-7af130a3d091 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:33.715051 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 842/1697] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:29:33 2022] DELETE /identity/v3/projects/d3545a9bd9a14de998a60c368027e005 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:29:33.717270 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e446c8-3560-4eb1-bfb9-12a4b0db9d44 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:33.717512 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e446c8-3560-4eb1-bfb9-12a4b0db9d44 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:33.717783 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e446c8-3560-4eb1-bfb9-12a4b0db9d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:33.719818 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-7b44541d-7630-4ebb-b86a-542c47c6948f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '100239fde42b4375a17c1395b26c20d4', 'request_id': 'req-7b44541d-7630-4ebb-b86a-542c47c6948f'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:33.743081 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-7b44541d-7630-4ebb-b86a-542c47c6948f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '100239fde42b4375a17c1395b26c20d4', 'request_id': 'req-7b44541d-7630-4ebb-b86a-542c47c6948f'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:33.780102 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-96e446c8-3560-4eb1-bfb9-12a4b0db9d44 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:33.781418 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-96e446c8-3560-4eb1-bfb9-12a4b0db9d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:33.799039 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-7b44541d-7630-4ebb-b86a-542c47c6948f admin admin] The token cache is being invalidate because project 100239fde42b4375a17c1395b26c20d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:29:33.799039 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-7b44541d-7630-4ebb-b86a-542c47c6948f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:33.804023 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-7b44541d-7630-4ebb-b86a-542c47c6948f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:33.807289 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 856/1698] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:29:33 2022] DELETE /identity/v3/projects/100239fde42b4375a17c1395b26c20d4 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:29:33.812303 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b44541d-7630-4ebb-b86a-542c47c6948f admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:33.820025 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-7b44541d-7630-4ebb-b86a-542c47c6948f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:33.822787 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:34.107508 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 843/1699] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:29:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:34.119155 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc4d6a-1c7c-49d7-a4b2-43d2f7128dbe None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:34.119450 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc4d6a-1c7c-49d7-a4b2-43d2f7128dbe None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:34.119702 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc4d6a-1c7c-49d7-a4b2-43d2f7128dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:34.146627 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b44541d-7630-4ebb-b86a-542c47c6948f admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:34.183138 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872fa927-f9e3-4f6f-8a80-272f18edcdc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:34.184113 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-01fc4d6a-1c7c-49d7-a4b2-43d2f7128dbe None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:34.185390 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-01fc4d6a-1c7c-49d7-a4b2-43d2f7128dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:34.187117 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872fa927-f9e3-4f6f-8a80-272f18edcdc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:34.192222 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872fa927-f9e3-4f6f-8a80-272f18edcdc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:34.195189 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872fa927-f9e3-4f6f-8a80-272f18edcdc7 admin admin] PATH_INFO: `/v3/users/bbf6a0a487d44d3e9b06106c14979b60` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:34.201873 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872fa927-f9e3-4f6f-8a80-272f18edcdc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbf6a0a487d44d3e9b06106c14979b60)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:34.212615 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872fa927-f9e3-4f6f-8a80-272f18edcdc7 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:34.216578 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 844/1700] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:29:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:34.221121 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fc4d6a-1c7c-49d7-a4b2-43d2f7128dbe None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:34.232632 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fc4d6a-1c7c-49d7-a4b2-43d2f7128dbe None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:34.237607 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:34.242440 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce801f-e250-4cd3-b092-f39eca0b64a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:34.244329 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce801f-e250-4cd3-b092-f39eca0b64a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:34.244329 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce801f-e250-4cd3-b092-f39eca0b64a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:34.245546 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce801f-e250-4cd3-b092-f39eca0b64a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:34.246473 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cce801f-e250-4cd3-b092-f39eca0b64a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:29:34.246990 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cce801f-e250-4cd3-b092-f39eca0b64a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:34.248910 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cce801f-e250-4cd3-b092-f39eca0b64a4 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:34.299516 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 845/1701] 10.222.0.91 () {58 vars in 1153 bytes} [Tue Aug 30 04:29:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:29:34.306351 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce801f-e250-4cd3-b092-f39eca0b64a4 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:34.338351 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce801f-e250-4cd3-b092-f39eca0b64a4 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:34.374069 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7956e6-8776-49f7-8e3a-d1177b100cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:34.376322 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7956e6-8776-49f7-8e3a-d1177b100cb7 admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:34.377415 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7956e6-8776-49f7-8e3a-d1177b100cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:34.378069 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7956e6-8776-49f7-8e3a-d1177b100cb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:34.379958 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7956e6-8776-49f7-8e3a-d1177b100cb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:34.383050 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-872fa927-f9e3-4f6f-8a80-272f18edcdc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbf6a0a487d44d3e9b06106c14979b60'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:34.393928 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7956e6-8776-49f7-8e3a-d1177b100cb7 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:34.419191 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-872fa927-f9e3-4f6f-8a80-272f18edcdc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbf6a0a487d44d3e9b06106c14979b60'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:34.458996 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-872fa927-f9e3-4f6f-8a80-272f18edcdc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbf6a0a487d44d3e9b06106c14979b60'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:34.459847 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-872fa927-f9e3-4f6f-8a80-272f18edcdc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbf6a0a487d44d3e9b06106c14979b60'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:34.547113 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 846/1702] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:29:34 2022] POST /identity/v3/projects => generated 381 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:29:34.556242 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7956e6-8776-49f7-8e3a-d1177b100cb7 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:34.565166 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-7f7956e6-8776-49f7-8e3a-d1177b100cb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:34.567632 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-872fa927-f9e3-4f6f-8a80-272f18edcdc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbf6a0a487d44d3e9b06106c14979b60'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:34.598785 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 857/1703] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:29:33 2022] DELETE /identity/v3/users/bbf6a0a487d44d3e9b06106c14979b60 => generated 0 bytes in 787 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:29:34.804012 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7956e6-8776-49f7-8e3a-d1177b100cb7 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:34.972472 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e9f8a8-6a0f-4173-b4bc-e670594f9a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:34.973541 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e9f8a8-6a0f-4173-b4bc-e670594f9a0f admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:34.973733 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e9f8a8-6a0f-4173-b4bc-e670594f9a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:34.973938 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e9f8a8-6a0f-4173-b4bc-e670594f9a0f admin admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:34.974700 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e9f8a8-6a0f-4173-b4bc-e670594f9a0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:35.028606 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e9f8a8-6a0f-4173-b4bc-e670594f9a0f admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:35.163138 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 847/1704] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:29:34 2022] POST /identity/v3/users => generated 291 bytes in 610 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:29:35.164055 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872fa927-f9e3-4f6f-8a80-272f18edcdc7 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:35.207585 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872fa927-f9e3-4f6f-8a80-272f18edcdc7 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:35.253343 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ec955-6209-4b10-8d90-e0035b23a0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:35.255587 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ec955-6209-4b10-8d90-e0035b23a0eb admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:35.256339 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ec955-6209-4b10-8d90-e0035b23a0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:35.257132 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ec955-6209-4b10-8d90-e0035b23a0eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:35.258684 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765ec955-6209-4b10-8d90-e0035b23a0eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:35.271283 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765ec955-6209-4b10-8d90-e0035b23a0eb admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:35.321019 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e9f8a8-6a0f-4173-b4bc-e670594f9a0f admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:35.330383 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 858/1705] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:29:35.387021 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e9f8a8-6a0f-4173-b4bc-e670594f9a0f admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:35.416973 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c667988d-257b-4b6f-9de3-7c88238f68f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:35.420223 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667988d-257b-4b6f-9de3-7c88238f68f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:35.421322 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667988d-257b-4b6f-9de3-7c88238f68f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:35.423747 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667988d-257b-4b6f-9de3-7c88238f68f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:35.427521 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c667988d-257b-4b6f-9de3-7c88238f68f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:35.457982 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c667988d-257b-4b6f-9de3-7c88238f68f7 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:35.465713 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:35.508193 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63cecec-e6cd-49fc-8845-6fc2a883ffe4 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:35.508863 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63cecec-e6cd-49fc-8845-6fc2a883ffe4 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:35.509305 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63cecec-e6cd-49fc-8845-6fc2a883ffe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:35.511860 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 848/1706] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:29:35.538067 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c667988d-257b-4b6f-9de3-7c88238f68f7 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:35.573964 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c667988d-257b-4b6f-9de3-7c88238f68f7 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:35.603069 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a8d555-fb66-4f25-851a-71fae026e166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:35.606563 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8d555-fb66-4f25-851a-71fae026e166 admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:35.611196 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8d555-fb66-4f25-851a-71fae026e166 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:35.612105 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8d555-fb66-4f25-851a-71fae026e166 admin admin] PATH_INFO: `/v3/projects/e78e77f1da7f4e0d96d5b5f0f5482983/users/7f44c5f4edce47b987a5fac69c7ca8a1/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:35.665182 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a8d555-fb66-4f25-851a-71fae026e166 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e78e77f1da7f4e0d96d5b5f0f5482983, user_id=7f44c5f4edce47b987a5fac69c7ca8a1, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:35.668932 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a8d555-fb66-4f25-851a-71fae026e166 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:35.707142 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 849/1707] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:29:35 2022] PUT /identity/v3/projects/e78e77f1da7f4e0d96d5b5f0f5482983/users/7f44c5f4edce47b987a5fac69c7ca8a1/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:29:35.722813 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d3a9f9-fadb-4359-a9b4-9a5881c6a6a9 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:35.723114 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d3a9f9-fadb-4359-a9b4-9a5881c6a6a9 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:35.723374 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d3a9f9-fadb-4359-a9b4-9a5881c6a6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:35.736813 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-e63cecec-e6cd-49fc-8845-6fc2a883ffe4 None None] MFA Rules not processed for user `1bc12faf48984335a3515dcde85b5cb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:35.739550 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-e63cecec-e6cd-49fc-8845-6fc2a883ffe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:35.860730 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-83d3a9f9-fadb-4359-a9b4-9a5881c6a6a9 None None] MFA Rules not processed for user `7f44c5f4edce47b987a5fac69c7ca8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:35.877281 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-83d3a9f9-fadb-4359-a9b4-9a5881c6a6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:35.993365 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 859/1708] 10.222.0.91 () {58 vars in 1009 bytes} [Tue Aug 30 04:29:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 486 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:29:36.240174 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 850/1709] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:29:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 513 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:36.240651 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63cecec-e6cd-49fc-8845-6fc2a883ffe4 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:36.328255 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d3a9f9-fadb-4359-a9b4-9a5881c6a6a9 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:36.332886 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-83d3a9f9-fadb-4359-a9b4-9a5881c6a6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:36.415724 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:36.463307 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63cecec-e6cd-49fc-8845-6fc2a883ffe4 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:36.493319 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3d14f-c7be-4d1a-a760-120bd2ba02d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:36.494384 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3d14f-c7be-4d1a-a760-120bd2ba02d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:36.496361 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3d14f-c7be-4d1a-a760-120bd2ba02d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:36.496834 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3d14f-c7be-4d1a-a760-120bd2ba02d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:36.497717 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c3d14f-c7be-4d1a-a760-120bd2ba02d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:36.509569 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c3d14f-c7be-4d1a-a760-120bd2ba02d1 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:36.574399 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 860/1710] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:29:36 2022] POST /identity/v3/projects => generated 381 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:29:36.581227 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3d14f-c7be-4d1a-a760-120bd2ba02d1 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:36.760498 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d3a9f9-fadb-4359-a9b4-9a5881c6a6a9 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:36.904236 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3d14f-c7be-4d1a-a760-120bd2ba02d1 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:36.933160 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0bb24e-9f72-414f-8add-80a57d40f2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:36.934307 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0bb24e-9f72-414f-8add-80a57d40f2b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:36.934768 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0bb24e-9f72-414f-8add-80a57d40f2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:36.940418 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0bb24e-9f72-414f-8add-80a57d40f2b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:36.948568 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0bb24e-9f72-414f-8add-80a57d40f2b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:36.968494 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0bb24e-9f72-414f-8add-80a57d40f2b2 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:37.080387 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 861/1711] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:29:36 2022] POST /identity/v3/users => generated 297 bytes in 497 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:29:37.085438 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0bb24e-9f72-414f-8add-80a57d40f2b2 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:37.141420 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:37.157579 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0bb24e-9f72-414f-8add-80a57d40f2b2 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:37.194965 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d6f246-e1c9-487b-bc09-e939ecf2d29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:37.199271 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6f246-e1c9-487b-bc09-e939ecf2d29d admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:37.201144 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6f246-e1c9-487b-bc09-e939ecf2d29d admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:37.201529 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6f246-e1c9-487b-bc09-e939ecf2d29d admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:37.206164 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d6f246-e1c9-487b-bc09-e939ecf2d29d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:37.215295 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d6f246-e1c9-487b-bc09-e939ecf2d29d admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:37.260404 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e53bfc0-cf54-46b7-b658-79069d1edc65 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b50f9552124b07822ae63c1d553864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:37.261016 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53bfc0-cf54-46b7-b658-79069d1edc65 service swift] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:37.261299 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53bfc0-cf54-46b7-b658-79069d1edc65 service swift] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:37.268807 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53bfc0-cf54-46b7-b658-79069d1edc65 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:37.298533 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 862/1712] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:29:37.299872 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d6f246-e1c9-487b-bc09-e939ecf2d29d admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:37.339194 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d6f246-e1c9-487b-bc09-e939ecf2d29d admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:37.361664 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e7ed54-4da9-4be1-aca5-de9665e7053d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:37.365154 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7ed54-4da9-4be1-aca5-de9665e7053d admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:37.365154 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7ed54-4da9-4be1-aca5-de9665e7053d admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:37.367487 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7ed54-4da9-4be1-aca5-de9665e7053d admin admin] PATH_INFO: `/v3/projects/5d5bf3e268ee4a2c9aa7119fb5452f71/users/af62d011a7b14305ae28509820534a54/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:37.459594 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e7ed54-4da9-4be1-aca5-de9665e7053d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d5bf3e268ee4a2c9aa7119fb5452f71, user_id=af62d011a7b14305ae28509820534a54, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:37.469143 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e7ed54-4da9-4be1-aca5-de9665e7053d admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:37.508686 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 863/1713] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:29:37 2022] PUT /identity/v3/projects/5d5bf3e268ee4a2c9aa7119fb5452f71/users/af62d011a7b14305ae28509820534a54/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:29:37.509920 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e7ed54-4da9-4be1-aca5-de9665e7053d admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:37.584286 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e53bfc0-cf54-46b7-b658-79069d1edc65 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:37.602272 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e53bfc0-cf54-46b7-b658-79069d1edc65 service swift] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:37.694041 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 851/1714] 10.222.0.91 () {60 vars in 1384 bytes} [Tue Aug 30 04:29:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 1366 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 04:29:37.836278 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e7ed54-4da9-4be1-aca5-de9665e7053d admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:37.858438 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0a4e1-b949-4dd2-b9fb-7502dd9ce8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:37.862366 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0a4e1-b949-4dd2-b9fb-7502dd9ce8e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:37.862366 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0a4e1-b949-4dd2-b9fb-7502dd9ce8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:37.863224 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0a4e1-b949-4dd2-b9fb-7502dd9ce8e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:37.866674 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e0a4e1-b949-4dd2-b9fb-7502dd9ce8e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:37.871875 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e0a4e1-b949-4dd2-b9fb-7502dd9ce8e1 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:37.951808 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 864/1715] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 441 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:29:37.959828 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e53bfc0-cf54-46b7-b658-79069d1edc65 service swift] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:38.076415 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e53bfc0-cf54-46b7-b658-79069d1edc65 service swift] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:38.093248 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69b4585-d169-4f41-b6ef-edf24d7f3ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:38.094621 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b4585-d169-4f41-b6ef-edf24d7f3ea6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:38.095269 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b4585-d169-4f41-b6ef-edf24d7f3ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:38.095951 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b4585-d169-4f41-b6ef-edf24d7f3ea6 admin admin] PATH_INFO: `/v3/projects/5d5bf3e268ee4a2c9aa7119fb5452f71/users/af62d011a7b14305ae28509820534a54/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:38.099749 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69b4585-d169-4f41-b6ef-edf24d7f3ea6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d5bf3e268ee4a2c9aa7119fb5452f71, user_id=af62d011a7b14305ae28509820534a54, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:38.106800 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69b4585-d169-4f41-b6ef-edf24d7f3ea6 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:38.152183 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 852/1716] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:29:37 2022] PUT /identity/v3/projects/5d5bf3e268ee4a2c9aa7119fb5452f71/users/af62d011a7b14305ae28509820534a54/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:29:38.164356 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c63da-38a3-4f2c-9d90-881112868538 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:38.164651 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c63da-38a3-4f2c-9d90-881112868538 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:38.165291 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c63da-38a3-4f2c-9d90-881112868538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:38.266161 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-389c63da-38a3-4f2c-9d90-881112868538 None None] MFA Rules not processed for user `af62d011a7b14305ae28509820534a54`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:38.267801 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-389c63da-38a3-4f2c-9d90-881112868538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:38.283041 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:38.531113 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 865/1717] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:29:38 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:38.630704 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69b4585-d169-4f41-b6ef-edf24d7f3ea6 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:38.636247 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-f69b4585-d169-4f41-b6ef-edf24d7f3ea6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:39.034663 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69b4585-d169-4f41-b6ef-edf24d7f3ea6 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:39.081078 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74480d9c-96e8-4671-9be0-92e19b499565 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:39.082188 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74480d9c-96e8-4671-9be0-92e19b499565 service cinder] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:39.083044 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74480d9c-96e8-4671-9be0-92e19b499565 service cinder] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:39.095694 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74480d9c-96e8-4671-9be0-92e19b499565 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:39.185027 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74480d9c-96e8-4671-9be0-92e19b499565 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:39.198764 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74480d9c-96e8-4671-9be0-92e19b499565 service cinder] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:39.290514 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 853/1718] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:29:38 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 657 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:29:40.139074 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389c63da-38a3-4f2c-9d90-881112868538 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:40.141567 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-389c63da-38a3-4f2c-9d90-881112868538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:40.186042 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389c63da-38a3-4f2c-9d90-881112868538 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:40.205723 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06d7250-92f6-4eb7-89f4-aaa8906a080e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:40.209823 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d7250-92f6-4eb7-89f4-aaa8906a080e service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:40.215034 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d7250-92f6-4eb7-89f4-aaa8906a080e service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:40.215863 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d7250-92f6-4eb7-89f4-aaa8906a080e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:40.382886 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06d7250-92f6-4eb7-89f4-aaa8906a080e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:40.386413 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06d7250-92f6-4eb7-89f4-aaa8906a080e service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:40.444888 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 866/1719] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:29:40 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:29:40.557800 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf15513-3fe3-41ae-8c96-9594bbe6fdb5 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:40.558597 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf15513-3fe3-41ae-8c96-9594bbe6fdb5 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:40.558597 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf15513-3fe3-41ae-8c96-9594bbe6fdb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:40.683829 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-caf15513-3fe3-41ae-8c96-9594bbe6fdb5 None None] MFA Rules not processed for user `91067603d9c549278cdc2d97b54cca88`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:40.689012 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-caf15513-3fe3-41ae-8c96-9594bbe6fdb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:41.024628 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 854/1720] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:29:40 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 470 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:41.050295 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06d7250-92f6-4eb7-89f4-aaa8906a080e service cinder] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:41.055505 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-c06d7250-92f6-4eb7-89f4-aaa8906a080e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:41.318845 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06d7250-92f6-4eb7-89f4-aaa8906a080e service cinder] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:41.344497 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0e1e6b-e65f-4a76-8bfb-aa46cf1d3b23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd806295278ae4997b5c6968aa553290c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:41.346479 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e1e6b-e65f-4a76-8bfb-aa46cf1d3b23 service nova] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:41.348473 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e1e6b-e65f-4a76-8bfb-aa46cf1d3b23 service nova] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:41.351125 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e1e6b-e65f-4a76-8bfb-aa46cf1d3b23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:41.390827 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0e1e6b-e65f-4a76-8bfb-aa46cf1d3b23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:41.410593 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0e1e6b-e65f-4a76-8bfb-aa46cf1d3b23 service nova] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:41.451254 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 867/1721] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:29:41 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:29:41.497727 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf15513-3fe3-41ae-8c96-9594bbe6fdb5 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:41.501991 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-caf15513-3fe3-41ae-8c96-9594bbe6fdb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:41.538569 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:41.847659 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf15513-3fe3-41ae-8c96-9594bbe6fdb5 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:41.872962 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccf677f-673d-4149-833a-9e4851606e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:41.876133 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf677f-673d-4149-833a-9e4851606e85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:41.876411 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf677f-673d-4149-833a-9e4851606e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:41.877892 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf677f-673d-4149-833a-9e4851606e85 admin admin] PATH_INFO: `/v3/projects/e4cbb49e912a4c4d8572f86168831266` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:41.892571 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccf677f-673d-4149-833a-9e4851606e85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4cbb49e912a4c4d8572f86168831266)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:41.935346 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccf677f-673d-4149-833a-9e4851606e85 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:41.954159 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4959387-fc66-4958-9091-3f4b5280acdb None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:41.954527 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4959387-fc66-4958-9091-3f4b5280acdb None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:41.954877 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4959387-fc66-4958-9091-3f4b5280acdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:42.148480 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-d4959387-fc66-4958-9091-3f4b5280acdb None None] MFA Rules not processed for user `1c05f49ae42b4f9583ff10b2cfce52a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:42.153738 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-d4959387-fc66-4958-9091-3f4b5280acdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:42.186404 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-7ccf677f-673d-4149-833a-9e4851606e85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4cbb49e912a4c4d8572f86168831266', 'request_id': 'req-7ccf677f-673d-4149-833a-9e4851606e85'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:42.204515 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-7ccf677f-673d-4149-833a-9e4851606e85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4cbb49e912a4c4d8572f86168831266', 'request_id': 'req-7ccf677f-673d-4149-833a-9e4851606e85'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:42.230412 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-7ccf677f-673d-4149-833a-9e4851606e85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4cbb49e912a4c4d8572f86168831266', 'request_id': 'req-7ccf677f-673d-4149-833a-9e4851606e85'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:42.269431 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-7ccf677f-673d-4149-833a-9e4851606e85 admin admin] The token cache is being invalidate because project e4cbb49e912a4c4d8572f86168831266 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:29:42.270292 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-7ccf677f-673d-4149-833a-9e4851606e85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:42.271268 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-7ccf677f-673d-4149-833a-9e4851606e85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:42.285830 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 855/1722] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:29:41 2022] DELETE /identity/v3/projects/e4cbb49e912a4c4d8572f86168831266 => generated 0 bytes in 788 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:29:42.287940 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a31db-bd36-42e1-929a-b87eda0116ed None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:42.291527 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a31db-bd36-42e1-929a-b87eda0116ed None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:42.292284 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a31db-bd36-42e1-929a-b87eda0116ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:42.311730 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:42.353906 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-b10a31db-bd36-42e1-929a-b87eda0116ed None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:42.355510 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-b10a31db-bd36-42e1-929a-b87eda0116ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:42.444796 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 868/1723] 10.222.0.83 () {58 vars in 1015 bytes} [Tue Aug 30 04:29:41 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 492 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:29:42.470297 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4959387-fc66-4958-9091-3f4b5280acdb None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:42.472594 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-d4959387-fc66-4958-9091-3f4b5280acdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:42.499309 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4959387-fc66-4958-9091-3f4b5280acdb None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:42.511575 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c0acc7-9c9a-4ecb-915d-489aba2acb20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:42.516783 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c0acc7-9c9a-4ecb-915d-489aba2acb20 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:42.516783 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c0acc7-9c9a-4ecb-915d-489aba2acb20 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:42.517384 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c0acc7-9c9a-4ecb-915d-489aba2acb20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:42.538800 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c0acc7-9c9a-4ecb-915d-489aba2acb20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:42.542095 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c0acc7-9c9a-4ecb-915d-489aba2acb20 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:42.567788 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 856/1724] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:29:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:42.570232 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ec096-8fe7-478c-a8c7-22955372f47c None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:42.575532 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ec096-8fe7-478c-a8c7-22955372f47c None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:42.601755 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 869/1725] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:29:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:29:42.602061 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ec096-8fe7-478c-a8c7-22955372f47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:42.657773 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-2b7ec096-8fe7-478c-a8c7-22955372f47c None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:42.661564 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-2b7ec096-8fe7-478c-a8c7-22955372f47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:42.693350 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c0acc7-9c9a-4ecb-915d-489aba2acb20 service neutron] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:42.703852 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 857/1726] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:29:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:42.714593 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c0acc7-9c9a-4ecb-915d-489aba2acb20 service neutron] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:42.726292 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e90b062-2d88-4ca1-9439-9cb06495764e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:42.728203 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90b062-2d88-4ca1-9439-9cb06495764e admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:42.737379 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90b062-2d88-4ca1-9439-9cb06495764e admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:42.738144 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90b062-2d88-4ca1-9439-9cb06495764e admin admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:42.739185 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e90b062-2d88-4ca1-9439-9cb06495764e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:29:42.739716 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e90b062-2d88-4ca1-9439-9cb06495764e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:42.742049 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e90b062-2d88-4ca1-9439-9cb06495764e admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:42.776577 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ec096-8fe7-478c-a8c7-22955372f47c None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:42.789582 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 870/1727] 10.222.0.91 () {58 vars in 1153 bytes} [Tue Aug 30 04:29:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:29:42.790732 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ec096-8fe7-478c-a8c7-22955372f47c None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:42.817448 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a05978-a1ad-4b5c-9e09-cea6835353a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:42.820328 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a05978-a1ad-4b5c-9e09-cea6835353a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:42.823036 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a05978-a1ad-4b5c-9e09-cea6835353a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:42.828719 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a05978-a1ad-4b5c-9e09-cea6835353a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:42.833163 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a05978-a1ad-4b5c-9e09-cea6835353a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:42.841444 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a05978-a1ad-4b5c-9e09-cea6835353a1 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:42.948218 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 858/1728] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:29:42 2022] POST /identity/v3/projects => generated 401 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:29:42.952764 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e90b062-2d88-4ca1-9439-9cb06495764e admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:43.010941 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e90b062-2d88-4ca1-9439-9cb06495764e admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:43.360192 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004d131-2979-4d72-92a6-e00f0cdac6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:43.363049 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004d131-2979-4d72-92a6-e00f0cdac6d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:43.363049 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004d131-2979-4d72-92a6-e00f0cdac6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:43.363049 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004d131-2979-4d72-92a6-e00f0cdac6d7 admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:43.363651 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c004d131-2979-4d72-92a6-e00f0cdac6d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:43.367348 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c004d131-2979-4d72-92a6-e00f0cdac6d7 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:43.448114 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 871/1729] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:29:42 2022] POST /identity/v3/users => generated 301 bytes in 496 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:29:43.452131 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a05978-a1ad-4b5c-9e09-cea6835353a1 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:43.478328 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a05978-a1ad-4b5c-9e09-cea6835353a1 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:43.516892 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ee085-393b-4f87-8ba1-6155f5b1fd11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:43.517556 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ee085-393b-4f87-8ba1-6155f5b1fd11 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:43.517842 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ee085-393b-4f87-8ba1-6155f5b1fd11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:43.518201 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ee085-393b-4f87-8ba1-6155f5b1fd11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:43.519012 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089ee085-393b-4f87-8ba1-6155f5b1fd11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:43.521906 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089ee085-393b-4f87-8ba1-6155f5b1fd11 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:43.541679 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:43.590984 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004d131-2979-4d72-92a6-e00f0cdac6d7 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:43.591652 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 859/1730] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:29:43.654611 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004d131-2979-4d72-92a6-e00f0cdac6d7 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:43.678894 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa99339-46ff-4e3e-b313-ba152426114d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:43.680391 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa99339-46ff-4e3e-b313-ba152426114d admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:43.687638 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa99339-46ff-4e3e-b313-ba152426114d admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:43.688431 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa99339-46ff-4e3e-b313-ba152426114d admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:43.695094 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa99339-46ff-4e3e-b313-ba152426114d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:43.702254 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa99339-46ff-4e3e-b313-ba152426114d admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:43.806334 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ee085-393b-4f87-8ba1-6155f5b1fd11 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:43.816442 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 872/1731] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:29:43.839881 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ee085-393b-4f87-8ba1-6155f5b1fd11 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:43.868394 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf37d57-bf75-4d46-891f-683a4af3f5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:43.876295 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf37d57-bf75-4d46-891f-683a4af3f5ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:43.877334 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf37d57-bf75-4d46-891f-683a4af3f5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:43.877967 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf37d57-bf75-4d46-891f-683a4af3f5ab admin admin] PATH_INFO: `/v3/projects/5f2f06bdfbfb435fbfc082f289b85d38/users/1119a63983284a69ba69d532235e32f2/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:43.990058 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf37d57-bf75-4d46-891f-683a4af3f5ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f2f06bdfbfb435fbfc082f289b85d38, user_id=1119a63983284a69ba69d532235e32f2, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:44.041290 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf37d57-bf75-4d46-891f-683a4af3f5ab admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:44.064788 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa99339-46ff-4e3e-b313-ba152426114d admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:44.068045 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-aaa99339-46ff-4e3e-b313-ba152426114d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:44.168004 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 860/1732] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:29:43 2022] PUT /identity/v3/projects/5f2f06bdfbfb435fbfc082f289b85d38/users/1119a63983284a69ba69d532235e32f2/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:29:44.197087 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a0e33-2729-4a8d-8da7-2d40ca1051bd None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:44.197582 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a0e33-2729-4a8d-8da7-2d40ca1051bd None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:44.198086 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a0e33-2729-4a8d-8da7-2d40ca1051bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:44.207617 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa99339-46ff-4e3e-b313-ba152426114d admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:44.435749 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-6f7a0e33-2729-4a8d-8da7-2d40ca1051bd None None] MFA Rules not processed for user `1119a63983284a69ba69d532235e32f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:44.442290 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-6f7a0e33-2729-4a8d-8da7-2d40ca1051bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:44.649645 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547794a-922f-473d-b53b-21c0d5a50fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:44.651863 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547794a-922f-473d-b53b-21c0d5a50fdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:44.655444 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547794a-922f-473d-b53b-21c0d5a50fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:44.656594 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547794a-922f-473d-b53b-21c0d5a50fdc admin admin] PATH_INFO: `/v3/users/7f44c5f4edce47b987a5fac69c7ca8a1` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:44.660901 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0547794a-922f-473d-b53b-21c0d5a50fdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f44c5f4edce47b987a5fac69c7ca8a1)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:44.676340 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0547794a-922f-473d-b53b-21c0d5a50fdc admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:44.826204 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 861/1733] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:29:44 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 628 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:44.832106 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a0e33-2729-4a8d-8da7-2d40ca1051bd None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:44.853419 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:44.903610 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a0e33-2729-4a8d-8da7-2d40ca1051bd None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:44.921995 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-0547794a-922f-473d-b53b-21c0d5a50fdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f44c5f4edce47b987a5fac69c7ca8a1'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:44.924698 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f2bb30-dbb4-405a-9b22-e55bbdfc295c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:44.925764 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2bb30-dbb4-405a-9b22-e55bbdfc295c admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:44.926379 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2bb30-dbb4-405a-9b22-e55bbdfc295c admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:44.927024 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2bb30-dbb4-405a-9b22-e55bbdfc295c admin admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:44.928115 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f2bb30-dbb4-405a-9b22-e55bbdfc295c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:44.932959 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f2bb30-dbb4-405a-9b22-e55bbdfc295c admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:44.969165 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-0547794a-922f-473d-b53b-21c0d5a50fdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f44c5f4edce47b987a5fac69c7ca8a1'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:45.010859 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-0547794a-922f-473d-b53b-21c0d5a50fdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f44c5f4edce47b987a5fac69c7ca8a1'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:45.012803 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-0547794a-922f-473d-b53b-21c0d5a50fdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f44c5f4edce47b987a5fac69c7ca8a1'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:45.034613 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 862/1734] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:29:44 2022] POST /identity/v3/projects => generated 399 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:29:45.037291 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5fa5b0-a9b6-4072-878a-7356697964b2 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:45.052974 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5fa5b0-a9b6-4072-878a-7356697964b2 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:45.062544 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5fa5b0-a9b6-4072-878a-7356697964b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:45.089853 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-0547794a-922f-473d-b53b-21c0d5a50fdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f44c5f4edce47b987a5fac69c7ca8a1'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:45.122294 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 873/1735] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:29:44 2022] DELETE /identity/v3/users/7f44c5f4edce47b987a5fac69c7ca8a1 => generated 0 bytes in 1059 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:29:45.125621 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547794a-922f-473d-b53b-21c0d5a50fdc admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:45.132508 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-0547794a-922f-473d-b53b-21c0d5a50fdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:45.191834 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-6a5fa5b0-a9b6-4072-878a-7356697964b2 None None] MFA Rules not processed for user `589bd91dbf434099b15ed7a8680f93bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:45.195963 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-6a5fa5b0-a9b6-4072-878a-7356697964b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:45.454223 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 863/1736] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:29:45 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 418 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:45.456100 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd8af7-c16c-4b91-bfa3-d781de81c018 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:45.456440 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd8af7-c16c-4b91-bfa3-d781de81c018 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:45.457717 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd8af7-c16c-4b91-bfa3-d781de81c018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:45.493508 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547794a-922f-473d-b53b-21c0d5a50fdc admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:45.512000 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-68cd8af7-c16c-4b91-bfa3-d781de81c018 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:45.513332 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-68cd8af7-c16c-4b91-bfa3-d781de81c018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:45.536835 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f61fac-c27f-4011-999c-d3f417b090e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:45.539111 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 864/1737] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:29:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:45.541229 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd30e3a-5e99-436b-9934-ed7b5715acff None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:45.541565 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd30e3a-5e99-436b-9934-ed7b5715acff None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:45.541811 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd30e3a-5e99-436b-9934-ed7b5715acff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:45.546880 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f61fac-c27f-4011-999c-d3f417b090e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:45.547397 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f61fac-c27f-4011-999c-d3f417b090e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:45.552483 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f61fac-c27f-4011-999c-d3f417b090e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:45.562729 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f61fac-c27f-4011-999c-d3f417b090e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:45.572164 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f61fac-c27f-4011-999c-d3f417b090e5 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:45.603021 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-6fd30e3a-5e99-436b-9934-ed7b5715acff None None] MFA Rules not processed for user `589bd91dbf434099b15ed7a8680f93bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:45.605467 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-6fd30e3a-5e99-436b-9934-ed7b5715acff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:45.633591 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 865/1738] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:29:45 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:45.648008 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd30e3a-5e99-436b-9934-ed7b5715acff None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:45.649777 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-6fd30e3a-5e99-436b-9934-ed7b5715acff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:45.672173 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 874/1739] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:29:45 2022] POST /identity/v3/users => generated 306 bytes in 549 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:29:45.673878 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f61fac-c27f-4011-999c-d3f417b090e5 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:45.705684 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:45.707857 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f61fac-c27f-4011-999c-d3f417b090e5 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:45.736180 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ad877-9c3d-4e36-9167-14cf7330e112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:45.740684 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ad877-9c3d-4e36-9167-14cf7330e112 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:45.745463 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ad877-9c3d-4e36-9167-14cf7330e112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:45.745929 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ad877-9c3d-4e36-9167-14cf7330e112 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:45.747192 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087ad877-9c3d-4e36-9167-14cf7330e112 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:45.758200 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087ad877-9c3d-4e36-9167-14cf7330e112 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:45.828402 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 875/1740] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:29:45.830189 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ad877-9c3d-4e36-9167-14cf7330e112 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:45.842030 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-087ad877-9c3d-4e36-9167-14cf7330e112 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:46.088713 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd30e3a-5e99-436b-9934-ed7b5715acff None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:46.138135 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db6df11-0a41-4cef-9d40-b8f100ea2368 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd806295278ae4997b5c6968aa553290c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:46.139400 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db6df11-0a41-4cef-9d40-b8f100ea2368 service nova] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:46.139894 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db6df11-0a41-4cef-9d40-b8f100ea2368 service nova] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:46.140406 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db6df11-0a41-4cef-9d40-b8f100ea2368 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:46.221169 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db6df11-0a41-4cef-9d40-b8f100ea2368 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:46.238955 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db6df11-0a41-4cef-9d40-b8f100ea2368 service nova] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:46.324695 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 866/1741] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:29:45 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 677 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:29:46.325512 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ad877-9c3d-4e36-9167-14cf7330e112 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:46.333678 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c3efd-ad9c-4624-977f-e92c6f2b7935 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:46.336287 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c3efd-ad9c-4624-977f-e92c6f2b7935 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:46.336287 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c3efd-ad9c-4624-977f-e92c6f2b7935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:46.360627 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe66e3-c5e3-48f7-9096-e4c35b1ba505 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:46.361976 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe66e3-c5e3-48f7-9096-e4c35b1ba505 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:46.362488 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe66e3-c5e3-48f7-9096-e4c35b1ba505 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:46.363094 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe66e3-c5e3-48f7-9096-e4c35b1ba505 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:46.452453 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fe66e3-c5e3-48f7-9096-e4c35b1ba505 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:46.460140 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fe66e3-c5e3-48f7-9096-e4c35b1ba505 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:46.470345 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-9f5c3efd-ad9c-4624-977f-e92c6f2b7935 None None] MFA Rules not processed for user `9a872454622d41ce9462890af418182d`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:46.478563 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-9f5c3efd-ad9c-4624-977f-e92c6f2b7935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:46.537359 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 876/1742] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:29:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 707 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:29:46.538860 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe66e3-c5e3-48f7-9096-e4c35b1ba505 service neutron] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:46.606114 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe66e3-c5e3-48f7-9096-e4c35b1ba505 service neutron] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:46.643848 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18bc6cf-5bb2-4807-ac64-b78e64820c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:46.651641 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18bc6cf-5bb2-4807-ac64-b78e64820c03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:46.652674 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18bc6cf-5bb2-4807-ac64-b78e64820c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:46.653147 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18bc6cf-5bb2-4807-ac64-b78e64820c03 admin admin] PATH_INFO: `/v3/projects/d0d079afa3b64cd9bfe5b01a65b2502b/users/990258c3d6e040b6960f3f5b71c1029b/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:46.728551 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18bc6cf-5bb2-4807-ac64-b78e64820c03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0d079afa3b64cd9bfe5b01a65b2502b, user_id=990258c3d6e040b6960f3f5b71c1029b, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:46.736787 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18bc6cf-5bb2-4807-ac64-b78e64820c03 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:46.787865 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 877/1743] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:29:46 2022] PUT /identity/v3/projects/d0d079afa3b64cd9bfe5b01a65b2502b/users/990258c3d6e040b6960f3f5b71c1029b/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:29:46.802633 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18bc6cf-5bb2-4807-ac64-b78e64820c03 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:46.879981 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 867/1744] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:29:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 551 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:46.892102 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:47.087945 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18bc6cf-5bb2-4807-ac64-b78e64820c03 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:47.114514 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dceb71c-fbea-4c61-9670-8817cc1d7499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:47.121888 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dceb71c-fbea-4c61-9670-8817cc1d7499 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:47.122600 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dceb71c-fbea-4c61-9670-8817cc1d7499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:47.123175 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dceb71c-fbea-4c61-9670-8817cc1d7499 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:47.124776 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dceb71c-fbea-4c61-9670-8817cc1d7499 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:47.130504 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dceb71c-fbea-4c61-9670-8817cc1d7499 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:47.184348 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 878/1745] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:29:46 2022] GET /identity/v3/roles => generated 1420 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:29:47.192493 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5c3efd-ad9c-4624-977f-e92c6f2b7935 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:47.221028 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5c3efd-ad9c-4624-977f-e92c6f2b7935 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:47.243662 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d92931-e1fc-4bb0-b5fc-b5e72e6f1326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:47.244439 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d92931-e1fc-4bb0-b5fc-b5e72e6f1326 admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:47.244729 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d92931-e1fc-4bb0-b5fc-b5e72e6f1326 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:47.244978 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d92931-e1fc-4bb0-b5fc-b5e72e6f1326 admin admin] PATH_INFO: `/v3/projects/d0d079afa3b64cd9bfe5b01a65b2502b/users/990258c3d6e040b6960f3f5b71c1029b/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:47.257361 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d92931-e1fc-4bb0-b5fc-b5e72e6f1326 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0d079afa3b64cd9bfe5b01a65b2502b, user_id=990258c3d6e040b6960f3f5b71c1029b, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:47.264552 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d92931-e1fc-4bb0-b5fc-b5e72e6f1326 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:47.321676 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 868/1746] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:29:47 2022] PUT /identity/v3/projects/d0d079afa3b64cd9bfe5b01a65b2502b/users/990258c3d6e040b6960f3f5b71c1029b/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:29:47.338511 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f521fb0c-5d9e-4e31-b952-76fa5f34791d None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:47.339051 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f521fb0c-5d9e-4e31-b952-76fa5f34791d None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:47.340007 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f521fb0c-5d9e-4e31-b952-76fa5f34791d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:47.479031 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-f521fb0c-5d9e-4e31-b952-76fa5f34791d None None] MFA Rules not processed for user `990258c3d6e040b6960f3f5b71c1029b`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:47.484896 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-f521fb0c-5d9e-4e31-b952-76fa5f34791d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:47.595838 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e196ff-a2df-45bf-ae30-841eab661c79 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:47.597334 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e196ff-a2df-45bf-ae30-841eab661c79 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:47.598358 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e196ff-a2df-45bf-ae30-841eab661c79 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:47.612222 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 869/1747] 10.222.0.91 () {54 vars in 921 bytes} [Tue Aug 30 04:29:47 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:29:47.759093 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e196ff-a2df-45bf-ae30-841eab661c79 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:47.762600 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-77e196ff-a2df-45bf-ae30-841eab661c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:47.979040 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 879/1748] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:29:47 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 642 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:29:47.981774 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f521fb0c-5d9e-4e31-b952-76fa5f34791d None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:47.989479 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-f521fb0c-5d9e-4e31-b952-76fa5f34791d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:48.179559 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e196ff-a2df-45bf-ae30-841eab661c79 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:48.209358 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d542bf-6693-41a6-8c1c-a441bd918fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:48.211021 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d542bf-6693-41a6-8c1c-a441bd918fac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:48.211892 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d542bf-6693-41a6-8c1c-a441bd918fac admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:48.212227 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d542bf-6693-41a6-8c1c-a441bd918fac admin admin] PATH_INFO: `/v3/users/1b14b33f99fc44bca96bf3a8b37c7506` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:48.214495 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d542bf-6693-41a6-8c1c-a441bd918fac admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b14b33f99fc44bca96bf3a8b37c7506)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:48.229571 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d542bf-6693-41a6-8c1c-a441bd918fac admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:48.413312 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:48.499868 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f521fb0c-5d9e-4e31-b952-76fa5f34791d None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:48.511854 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-f7d542bf-6693-41a6-8c1c-a441bd918fac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b14b33f99fc44bca96bf3a8b37c7506'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:48.513309 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-f7d542bf-6693-41a6-8c1c-a441bd918fac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b14b33f99fc44bca96bf3a8b37c7506'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:48.517291 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-f7d542bf-6693-41a6-8c1c-a441bd918fac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b14b33f99fc44bca96bf3a8b37c7506'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:48.545036 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-f7d542bf-6693-41a6-8c1c-a441bd918fac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b14b33f99fc44bca96bf3a8b37c7506'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:48.550378 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1239cdd-8f15-49ed-ba37-98aeec578774 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd806295278ae4997b5c6968aa553290c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:48.553915 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1239cdd-8f15-49ed-ba37-98aeec578774 service nova] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:48.554195 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1239cdd-8f15-49ed-ba37-98aeec578774 service nova] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:48.554648 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1239cdd-8f15-49ed-ba37-98aeec578774 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:48.570133 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-d1239cdd-8f15-49ed-ba37-98aeec578774 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:48.589569 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-f7d542bf-6693-41a6-8c1c-a441bd918fac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b14b33f99fc44bca96bf3a8b37c7506'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:48.648167 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 870/1749] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:29:47 2022] DELETE /identity/v3/users/1b14b33f99fc44bca96bf3a8b37c7506 => generated 0 bytes in 890 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:29:48.651088 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d542bf-6693-41a6-8c1c-a441bd918fac admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:48.656022 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-f7d542bf-6693-41a6-8c1c-a441bd918fac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:48.763331 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:48.904872 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d542bf-6693-41a6-8c1c-a441bd918fac admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:48.916264 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b2a1a-f116-4bd9-80cb-44bc246ebbe1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:48.917326 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b2a1a-f116-4bd9-80cb-44bc246ebbe1 service cinder] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:48.918279 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b2a1a-f116-4bd9-80cb-44bc246ebbe1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:48.918752 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b2a1a-f116-4bd9-80cb-44bc246ebbe1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:48.921537 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-cb9b2a1a-f116-4bd9-80cb-44bc246ebbe1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:48.954435 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1239cdd-8f15-49ed-ba37-98aeec578774 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:48.957567 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1239cdd-8f15-49ed-ba37-98aeec578774 service nova] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:49.027570 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 880/1750] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:29:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 1047 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:29:49.043157 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ac5b7-8b67-4517-b3c9-b8c62cedcc8d None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:49.044041 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ac5b7-8b67-4517-b3c9-b8c62cedcc8d None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:49.044537 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ac5b7-8b67-4517-b3c9-b8c62cedcc8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:49.208762 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-8a9ac5b7-8b67-4517-b3c9-b8c62cedcc8d None None] MFA Rules not processed for user `d806295278ae4997b5c6968aa553290c`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:49.215354 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-8a9ac5b7-8b67-4517-b3c9-b8c62cedcc8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:49.237266 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9b2a1a-f116-4bd9-80cb-44bc246ebbe1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:49.243193 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9b2a1a-f116-4bd9-80cb-44bc246ebbe1 service cinder] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:49.299071 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 871/1751] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:29:48 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 650 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:29:49.300691 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383f795-06fd-4127-907b-06fdf5ed44c2 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:49.300978 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383f795-06fd-4127-907b-06fdf5ed44c2 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:49.301264 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383f795-06fd-4127-907b-06fdf5ed44c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:49.396745 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-0383f795-06fd-4127-907b-06fdf5ed44c2 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:49.415280 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-0383f795-06fd-4127-907b-06fdf5ed44c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:49.570588 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 881/1752] 10.222.0.91 () {58 vars in 1018 bytes} [Tue Aug 30 04:29:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 542 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:49.571525 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ac5b7-8b67-4517-b3c9-b8c62cedcc8d None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:49.628407 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ac5b7-8b67-4517-b3c9-b8c62cedcc8d None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:49.651141 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c28da-9a54-45e1-b390-008e1ef46559 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:49.654293 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c28da-9a54-45e1-b390-008e1ef46559 service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:49.656698 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c28da-9a54-45e1-b390-008e1ef46559 service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:49.657114 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c28da-9a54-45e1-b390-008e1ef46559 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:49.664858 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-4f1c28da-9a54-45e1-b390-008e1ef46559 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:49.810638 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:49.905806 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 872/1753] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:29:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 606 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:49.906906 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0383f795-06fd-4127-907b-06fdf5ed44c2 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:49.908995 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-0383f795-06fd-4127-907b-06fdf5ed44c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:50.007337 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0383f795-06fd-4127-907b-06fdf5ed44c2 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:50.056995 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dcf7e0-a68c-4f8d-8389-590829ef4a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:50.063094 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dcf7e0-a68c-4f8d-8389-590829ef4a45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:50.067170 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dcf7e0-a68c-4f8d-8389-590829ef4a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:50.072668 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dcf7e0-a68c-4f8d-8389-590829ef4a45 admin admin] PATH_INFO: `/v3/projects/e78e77f1da7f4e0d96d5b5f0f5482983` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:50.077050 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dcf7e0-a68c-4f8d-8389-590829ef4a45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e78e77f1da7f4e0d96d5b5f0f5482983)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:50.082172 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dcf7e0-a68c-4f8d-8389-590829ef4a45 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:50.122971 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1c28da-9a54-45e1-b390-008e1ef46559 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:50.124857 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1c28da-9a54-45e1-b390-008e1ef46559 service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:50.148678 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 882/1754] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:29:49 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:29:50.152058 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c28da-9a54-45e1-b390-008e1ef46559 service cinder] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:50.154904 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-4f1c28da-9a54-45e1-b390-008e1ef46559 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:50.275572 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-05dcf7e0-a68c-4f8d-8389-590829ef4a45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e78e77f1da7f4e0d96d5b5f0f5482983', 'request_id': 'req-05dcf7e0-a68c-4f8d-8389-590829ef4a45'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:50.302265 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-05dcf7e0-a68c-4f8d-8389-590829ef4a45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e78e77f1da7f4e0d96d5b5f0f5482983', 'request_id': 'req-05dcf7e0-a68c-4f8d-8389-590829ef4a45'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:50.334811 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-05dcf7e0-a68c-4f8d-8389-590829ef4a45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e78e77f1da7f4e0d96d5b5f0f5482983', 'request_id': 'req-05dcf7e0-a68c-4f8d-8389-590829ef4a45'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:50.399504 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-05dcf7e0-a68c-4f8d-8389-590829ef4a45 admin admin] The token cache is being invalidate because project e78e77f1da7f4e0d96d5b5f0f5482983 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:29:50.409102 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-05dcf7e0-a68c-4f8d-8389-590829ef4a45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:50.412341 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-05dcf7e0-a68c-4f8d-8389-590829ef4a45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:50.422934 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 873/1755] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:29:49 2022] DELETE /identity/v3/projects/e78e77f1da7f4e0d96d5b5f0f5482983 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:29:50.428086 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c28da-9a54-45e1-b390-008e1ef46559 service cinder] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:50.430310 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dcf7e0-a68c-4f8d-8389-590829ef4a45 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:50.437967 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-05dcf7e0-a68c-4f8d-8389-590829ef4a45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:50.475575 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:50.676773 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0493ddac-1686-471e-b440-2b893f471b54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:50.677563 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0493ddac-1686-471e-b440-2b893f471b54 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:50.677879 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0493ddac-1686-471e-b440-2b893f471b54 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:50.678220 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0493ddac-1686-471e-b440-2b893f471b54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:50.695630 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-0493ddac-1686-471e-b440-2b893f471b54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:50.757929 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dcf7e0-a68c-4f8d-8389-590829ef4a45 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:50.776573 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42df320d-3d97-443c-8775-ca6f459b85e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:50.777357 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df320d-3d97-443c-8775-ca6f459b85e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:50.777681 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df320d-3d97-443c-8775-ca6f459b85e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:50.778072 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df320d-3d97-443c-8775-ca6f459b85e7 admin admin] PATH_INFO: `/v3/users/af62d011a7b14305ae28509820534a54` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:50.780152 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42df320d-3d97-443c-8775-ca6f459b85e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af62d011a7b14305ae28509820534a54)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:50.797257 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42df320d-3d97-443c-8775-ca6f459b85e7 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:50.916634 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0493ddac-1686-471e-b440-2b893f471b54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:50.918156 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0493ddac-1686-471e-b440-2b893f471b54 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:50.970818 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 883/1756] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:29:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 821 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:29:50.984590 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-42df320d-3d97-443c-8775-ca6f459b85e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af62d011a7b14305ae28509820534a54'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:50.985815 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-42df320d-3d97-443c-8775-ca6f459b85e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af62d011a7b14305ae28509820534a54'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:50.986743 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-42df320d-3d97-443c-8775-ca6f459b85e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af62d011a7b14305ae28509820534a54'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:51.019005 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-42df320d-3d97-443c-8775-ca6f459b85e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af62d011a7b14305ae28509820534a54'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:51.091837 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-42df320d-3d97-443c-8775-ca6f459b85e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af62d011a7b14305ae28509820534a54'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:51.096633 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:51.145532 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 874/1757] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:29:50 2022] DELETE /identity/v3/users/af62d011a7b14305ae28509820534a54 => generated 0 bytes in 717 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:29:51.326372 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0493ddac-1686-471e-b440-2b893f471b54 service neutron] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:51.328698 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-0493ddac-1686-471e-b440-2b893f471b54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:51.593200 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0493ddac-1686-471e-b440-2b893f471b54 service neutron] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:51.813855 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:51.854280 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e499aa-e9a4-46a0-9965-eb3b341fe5ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd806295278ae4997b5c6968aa553290c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:51.857249 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e499aa-e9a4-46a0-9965-eb3b341fe5ad service nova] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:51.857249 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e499aa-e9a4-46a0-9965-eb3b341fe5ad service nova] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:51.858191 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e499aa-e9a4-46a0-9965-eb3b341fe5ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:51.861897 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-61e499aa-e9a4-46a0-9965-eb3b341fe5ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:51.881533 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e499aa-e9a4-46a0-9965-eb3b341fe5ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:51.883538 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e499aa-e9a4-46a0-9965-eb3b341fe5ad service nova] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:51.927579 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 884/1758] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:29:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 603 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:29:52.472701 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca43bd2-5a2c-4071-975b-2943aed9c9bf None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:52.473390 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca43bd2-5a2c-4071-975b-2943aed9c9bf None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:52.473726 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca43bd2-5a2c-4071-975b-2943aed9c9bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:52.745195 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-aca43bd2-5a2c-4071-975b-2943aed9c9bf None None] MFA Rules not processed for user `589bd91dbf434099b15ed7a8680f93bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:52.758413 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-aca43bd2-5a2c-4071-975b-2943aed9c9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:53.248118 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 875/1759] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:29:52 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 779 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:53.690660 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e499aa-e9a4-46a0-9965-eb3b341fe5ad service nova] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:53.692778 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-61e499aa-e9a4-46a0-9965-eb3b341fe5ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:53.973740 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e499aa-e9a4-46a0-9965-eb3b341fe5ad service nova] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:54.004994 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac74c4eb-7b1f-43d8-9c17-b77ea0c4706a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:54.005685 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74c4eb-7b1f-43d8-9c17-b77ea0c4706a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:54.005968 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74c4eb-7b1f-43d8-9c17-b77ea0c4706a admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:54.006249 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74c4eb-7b1f-43d8-9c17-b77ea0c4706a admin admin] PATH_INFO: `/v3/projects/7c9a672447c3445cbf53c3dc645cc03d` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:54.013041 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac74c4eb-7b1f-43d8-9c17-b77ea0c4706a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c9a672447c3445cbf53c3dc645cc03d)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:54.019816 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac74c4eb-7b1f-43d8-9c17-b77ea0c4706a admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:54.303631 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-ac74c4eb-7b1f-43d8-9c17-b77ea0c4706a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c9a672447c3445cbf53c3dc645cc03d', 'request_id': 'req-ac74c4eb-7b1f-43d8-9c17-b77ea0c4706a'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:54.331623 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-ac74c4eb-7b1f-43d8-9c17-b77ea0c4706a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c9a672447c3445cbf53c3dc645cc03d', 'request_id': 'req-ac74c4eb-7b1f-43d8-9c17-b77ea0c4706a'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:54.350660 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-ac74c4eb-7b1f-43d8-9c17-b77ea0c4706a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c9a672447c3445cbf53c3dc645cc03d', 'request_id': 'req-ac74c4eb-7b1f-43d8-9c17-b77ea0c4706a'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:54.408571 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-ac74c4eb-7b1f-43d8-9c17-b77ea0c4706a admin admin] The token cache is being invalidate because project 7c9a672447c3445cbf53c3dc645cc03d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:29:54.416111 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-ac74c4eb-7b1f-43d8-9c17-b77ea0c4706a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:54.429079 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-ac74c4eb-7b1f-43d8-9c17-b77ea0c4706a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:54.431189 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 885/1760] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:29:53 2022] DELETE /identity/v3/projects/7c9a672447c3445cbf53c3dc645cc03d => generated 0 bytes in 741 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:29:54.436582 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca5078-6cda-4300-abd4-efbc8185e883 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:54.437198 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca5078-6cda-4300-abd4-efbc8185e883 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:54.437198 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca5078-6cda-4300-abd4-efbc8185e883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:54.478198 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-b4ca5078-6cda-4300-abd4-efbc8185e883 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:54.480060 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-b4ca5078-6cda-4300-abd4-efbc8185e883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:54.586836 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac74c4eb-7b1f-43d8-9c17-b77ea0c4706a admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:54.590879 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-ac74c4eb-7b1f-43d8-9c17-b77ea0c4706a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:54.921105 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 876/1761] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:29:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 484 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:29:54.921510 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac74c4eb-7b1f-43d8-9c17-b77ea0c4706a admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:54.940471 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76d3e9-baba-436e-98c2-8336848772a4 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:54.941480 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886fa315-5c80-4a6f-9866-661d3aea0968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:54.942676 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886fa315-5c80-4a6f-9866-661d3aea0968 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:54.943150 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886fa315-5c80-4a6f-9866-661d3aea0968 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:54.943588 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886fa315-5c80-4a6f-9866-661d3aea0968 admin admin] PATH_INFO: `/v3/projects/5d5bf3e268ee4a2c9aa7119fb5452f71` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:54.944695 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76d3e9-baba-436e-98c2-8336848772a4 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:54.949328 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76d3e9-baba-436e-98c2-8336848772a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:54.973602 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886fa315-5c80-4a6f-9866-661d3aea0968 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d5bf3e268ee4a2c9aa7119fb5452f71)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:54.990239 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886fa315-5c80-4a6f-9866-661d3aea0968 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:55.035118 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:55.148718 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-ae76d3e9-baba-436e-98c2-8336848772a4 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:55.156280 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-ae76d3e9-baba-436e-98c2-8336848772a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:55.231341 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-886fa315-5c80-4a6f-9866-661d3aea0968 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d5bf3e268ee4a2c9aa7119fb5452f71', 'request_id': 'req-886fa315-5c80-4a6f-9866-661d3aea0968'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:55.261987 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-886fa315-5c80-4a6f-9866-661d3aea0968 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d5bf3e268ee4a2c9aa7119fb5452f71', 'request_id': 'req-886fa315-5c80-4a6f-9866-661d3aea0968'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:55.291155 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-886fa315-5c80-4a6f-9866-661d3aea0968 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d5bf3e268ee4a2c9aa7119fb5452f71', 'request_id': 'req-886fa315-5c80-4a6f-9866-661d3aea0968'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:55.352485 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-886fa315-5c80-4a6f-9866-661d3aea0968 admin admin] The token cache is being invalidate because project 5d5bf3e268ee4a2c9aa7119fb5452f71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:29:55.352992 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-886fa315-5c80-4a6f-9866-661d3aea0968 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:55.359572 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-886fa315-5c80-4a6f-9866-661d3aea0968 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:55.369728 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 886/1762] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:29:54 2022] DELETE /identity/v3/projects/5d5bf3e268ee4a2c9aa7119fb5452f71 => generated 0 bytes in 779 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:29:55.374020 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44cb1e0-a4f8-417b-a928-bffa8fdf12f8 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:55.374676 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44cb1e0-a4f8-417b-a928-bffa8fdf12f8 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:55.374886 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44cb1e0-a4f8-417b-a928-bffa8fdf12f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:55.495021 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-e44cb1e0-a4f8-417b-a928-bffa8fdf12f8 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:55.499456 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-e44cb1e0-a4f8-417b-a928-bffa8fdf12f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:55.512852 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 877/1763] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:29:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 584 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:55.515454 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae76d3e9-baba-436e-98c2-8336848772a4 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:55.541213 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae76d3e9-baba-436e-98c2-8336848772a4 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:55.541527 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 887/1764] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:29:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:55.558194 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab9427-4d2e-46ef-976d-5d94ddcf34cd None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:55.558433 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab9427-4d2e-46ef-976d-5d94ddcf34cd None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:55.561067 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab9427-4d2e-46ef-976d-5d94ddcf34cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:55.575636 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480ac41-b2bf-48bc-b3e3-1be30396f6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:55.578919 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480ac41-b2bf-48bc-b3e3-1be30396f6ae admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:55.579604 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480ac41-b2bf-48bc-b3e3-1be30396f6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:55.579882 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480ac41-b2bf-48bc-b3e3-1be30396f6ae admin admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:55.586494 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2480ac41-b2bf-48bc-b3e3-1be30396f6ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:29:55.588390 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2480ac41-b2bf-48bc-b3e3-1be30396f6ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:55.591337 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2480ac41-b2bf-48bc-b3e3-1be30396f6ae admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:55.626303 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-35ab9427-4d2e-46ef-976d-5d94ddcf34cd None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:55.630616 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-35ab9427-4d2e-46ef-976d-5d94ddcf34cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:55.668761 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 888/1765] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:29:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:55.676618 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ab9427-4d2e-46ef-976d-5d94ddcf34cd None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:55.680606 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 878/1766] 10.222.0.91 () {58 vars in 1153 bytes} [Tue Aug 30 04:29:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:29:55.701090 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480ac41-b2bf-48bc-b3e3-1be30396f6ae admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:55.740791 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ab9427-4d2e-46ef-976d-5d94ddcf34cd None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:55.765287 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39af663d-4f66-4d3b-8f24-1430b0dd98ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:55.766154 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af663d-4f66-4d3b-8f24-1430b0dd98ce admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:55.766618 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af663d-4f66-4d3b-8f24-1430b0dd98ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:55.766928 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af663d-4f66-4d3b-8f24-1430b0dd98ce admin admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:55.767639 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39af663d-4f66-4d3b-8f24-1430b0dd98ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:29:55.768175 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39af663d-4f66-4d3b-8f24-1430b0dd98ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:55.778355 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39af663d-4f66-4d3b-8f24-1430b0dd98ce admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:55.789202 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480ac41-b2bf-48bc-b3e3-1be30396f6ae admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:55.817310 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b8466-bbd7-4688-8c8a-01c6e3fefe61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:55.819839 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b8466-bbd7-4688-8c8a-01c6e3fefe61 admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:55.822521 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b8466-bbd7-4688-8c8a-01c6e3fefe61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:55.841365 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b8466-bbd7-4688-8c8a-01c6e3fefe61 admin admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:55.841776 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 889/1767] 10.222.0.91 () {58 vars in 1153 bytes} [Tue Aug 30 04:29:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:29:55.851007 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39af663d-4f66-4d3b-8f24-1430b0dd98ce admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:55.853877 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785b8466-bbd7-4688-8c8a-01c6e3fefe61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:55.876100 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39af663d-4f66-4d3b-8f24-1430b0dd98ce admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:55.880593 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785b8466-bbd7-4688-8c8a-01c6e3fefe61 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:55.897032 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc3469d-0956-433d-b17b-8566edf2d394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:55.897830 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc3469d-0956-433d-b17b-8566edf2d394 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:55.898117 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc3469d-0956-433d-b17b-8566edf2d394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:55.898480 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc3469d-0956-433d-b17b-8566edf2d394 admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:55.899242 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc3469d-0956-433d-b17b-8566edf2d394 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:55.909014 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc3469d-0956-433d-b17b-8566edf2d394 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:56.035065 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 890/1768] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:29:55 2022] POST /identity/v3/projects => generated 379 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:29:56.045411 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc3469d-0956-433d-b17b-8566edf2d394 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:56.135512 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 879/1769] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:29:55 2022] POST /identity/v3/projects => generated 369 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:29:56.138574 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b8466-bbd7-4688-8c8a-01c6e3fefe61 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:56.159448 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:56.430289 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc3469d-0956-433d-b17b-8566edf2d394 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:56.519832 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b8466-bbd7-4688-8c8a-01c6e3fefe61 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:56.526809 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a564e22c-49f3-4931-a2b6-745d17263066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:56.527666 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564e22c-49f3-4931-a2b6-745d17263066 admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:56.528158 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564e22c-49f3-4931-a2b6-745d17263066 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:56.528573 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564e22c-49f3-4931-a2b6-745d17263066 admin admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:56.529481 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a564e22c-49f3-4931-a2b6-745d17263066 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:56.548487 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a564e22c-49f3-4931-a2b6-745d17263066 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:56.600477 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 880/1770] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:29:56 2022] POST /identity/v3/users => generated 285 bytes in 464 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:29:56.608508 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a564e22c-49f3-4931-a2b6-745d17263066 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:56.651021 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a564e22c-49f3-4931-a2b6-745d17263066 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:56.693598 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a0c9ad-fd8c-4af8-a3c3-83d9a52800c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:56.695112 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a0c9ad-fd8c-4af8-a3c3-83d9a52800c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:56.698637 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a0c9ad-fd8c-4af8-a3c3-83d9a52800c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:56.700562 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a0c9ad-fd8c-4af8-a3c3-83d9a52800c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:56.705149 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a0c9ad-fd8c-4af8-a3c3-83d9a52800c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:56.714076 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a0c9ad-fd8c-4af8-a3c3-83d9a52800c1 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:56.788313 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84d9aa-65ab-4fbb-afcb-156bdb13ff25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:56.792691 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84d9aa-65ab-4fbb-afcb-156bdb13ff25 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:56.793536 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84d9aa-65ab-4fbb-afcb-156bdb13ff25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:56.794230 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84d9aa-65ab-4fbb-afcb-156bdb13ff25 admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:56.795718 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c84d9aa-65ab-4fbb-afcb-156bdb13ff25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:56.804207 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c84d9aa-65ab-4fbb-afcb-156bdb13ff25 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:56.810239 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 881/1771] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:29:56.817889 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a0c9ad-fd8c-4af8-a3c3-83d9a52800c1 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:56.832649 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:56.880810 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 891/1772] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:29:56 2022] POST /identity/v3/users => generated 290 bytes in 837 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:29:56.895796 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84d9aa-65ab-4fbb-afcb-156bdb13ff25 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:56.897211 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a0c9ad-fd8c-4af8-a3c3-83d9a52800c1 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:56.930626 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51ecabf-b063-4c91-9d99-43091908c0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:56.931312 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ecabf-b063-4c91-9d99-43091908c0df admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:56.931780 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ecabf-b063-4c91-9d99-43091908c0df admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:56.932218 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ecabf-b063-4c91-9d99-43091908c0df admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:56.933364 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51ecabf-b063-4c91-9d99-43091908c0df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:56.947629 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51ecabf-b063-4c91-9d99-43091908c0df admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:56.976657 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84d9aa-65ab-4fbb-afcb-156bdb13ff25 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:57.005105 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff166b-1ef0-4730-80df-608963579e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:57.006559 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff166b-1ef0-4730-80df-608963579e5c admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:57.007269 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff166b-1ef0-4730-80df-608963579e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:57.011166 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff166b-1ef0-4730-80df-608963579e5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:57.012846 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcff166b-1ef0-4730-80df-608963579e5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:57.023506 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcff166b-1ef0-4730-80df-608963579e5c admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:57.033002 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 882/1773] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:29:57.048497 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51ecabf-b063-4c91-9d99-43091908c0df admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:57.052445 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 892/1774] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:29:57.057662 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff166b-1ef0-4730-80df-608963579e5c admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:57.085645 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff166b-1ef0-4730-80df-608963579e5c admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:57.106632 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51ecabf-b063-4c91-9d99-43091908c0df admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:57.109358 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa1c9d0-1332-47d0-8f44-90a4261b192d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:57.109358 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1c9d0-1332-47d0-8f44-90a4261b192d admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:57.109768 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1c9d0-1332-47d0-8f44-90a4261b192d admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:57.110999 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1c9d0-1332-47d0-8f44-90a4261b192d admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:57.112870 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa1c9d0-1332-47d0-8f44-90a4261b192d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:57.116995 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa1c9d0-1332-47d0-8f44-90a4261b192d admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:57.138972 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3316b0c-7261-4940-a52c-5b1fc17e2e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:57.139732 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3316b0c-7261-4940-a52c-5b1fc17e2e10 admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:57.140055 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3316b0c-7261-4940-a52c-5b1fc17e2e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:57.140336 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3316b0c-7261-4940-a52c-5b1fc17e2e10 admin admin] PATH_INFO: `/v3/projects/efd4c3b962d74138a4ea48f6b7f0ec3f/users/8a8a9615082b47f4ab15127f21a7074e/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:57.193344 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 893/1775] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:29:57 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:29:57.195278 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa1c9d0-1332-47d0-8f44-90a4261b192d admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:57.241135 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3316b0c-7261-4940-a52c-5b1fc17e2e10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efd4c3b962d74138a4ea48f6b7f0ec3f, user_id=8a8a9615082b47f4ab15127f21a7074e, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:57.247477 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa1c9d0-1332-47d0-8f44-90a4261b192d admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:57.258631 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3316b0c-7261-4940-a52c-5b1fc17e2e10 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:57.270723 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60869c7d-d915-42c7-aa32-a82bbb13d030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:57.273733 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60869c7d-d915-42c7-aa32-a82bbb13d030 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:57.275217 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60869c7d-d915-42c7-aa32-a82bbb13d030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:57.276535 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60869c7d-d915-42c7-aa32-a82bbb13d030 admin admin] PATH_INFO: `/v3/projects/793e87aeab2f4829b6eda5f43a7c66dc/users/6c5751fca7fd4ec08f126309aeecca8a/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:57.298153 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 883/1776] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:29:57 2022] PUT /identity/v3/projects/efd4c3b962d74138a4ea48f6b7f0ec3f/users/8a8a9615082b47f4ab15127f21a7074e/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:29:57.310559 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2f866-03f2-42fe-a95a-27a726487609 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:57.311236 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2f866-03f2-42fe-a95a-27a726487609 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:57.311735 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2f866-03f2-42fe-a95a-27a726487609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:57.359121 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60869c7d-d915-42c7-aa32-a82bbb13d030 admin admin] RBAC: Authorizing `identity:create_grant(project_id=793e87aeab2f4829b6eda5f43a7c66dc, user_id=6c5751fca7fd4ec08f126309aeecca8a, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:57.387834 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60869c7d-d915-42c7-aa32-a82bbb13d030 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:57.391355 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-89b2f866-03f2-42fe-a95a-27a726487609 None None] MFA Rules not processed for user `8a8a9615082b47f4ab15127f21a7074e`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:57.393091 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-89b2f866-03f2-42fe-a95a-27a726487609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:57.462858 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 894/1777] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:29:57 2022] PUT /identity/v3/projects/793e87aeab2f4829b6eda5f43a7c66dc/users/6c5751fca7fd4ec08f126309aeecca8a/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:29:57.484126 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f01bc5-4c70-4a72-a0c0-bd7a10bdf0c9 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:57.484522 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f01bc5-4c70-4a72-a0c0-bd7a10bdf0c9 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:57.484993 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f01bc5-4c70-4a72-a0c0-bd7a10bdf0c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:57.619964 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 884/1778] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:29:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:57.619964 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b2f866-03f2-42fe-a95a-27a726487609 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:57.712658 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-95f01bc5-4c70-4a72-a0c0-bd7a10bdf0c9 None None] MFA Rules not processed for user `6c5751fca7fd4ec08f126309aeecca8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:57.714970 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-95f01bc5-4c70-4a72-a0c0-bd7a10bdf0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:57.783462 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:57.863806 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b2f866-03f2-42fe-a95a-27a726487609 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:58.055573 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f71acfd-feb7-4531-959e-62146489e967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:58.058349 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71acfd-feb7-4531-959e-62146489e967 admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:58.059639 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71acfd-feb7-4531-959e-62146489e967 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:58.069234 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71acfd-feb7-4531-959e-62146489e967 admin admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:58.070580 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f71acfd-feb7-4531-959e-62146489e967 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:58.073266 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f71acfd-feb7-4531-959e-62146489e967 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:58.092111 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 895/1779] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:29:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 607 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:58.093675 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f01bc5-4c70-4a72-a0c0-bd7a10bdf0c9 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:58.138927 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f01bc5-4c70-4a72-a0c0-bd7a10bdf0c9 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:58.162816 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ab6c0-da54-4e0e-ad49-9c24cb5258bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:58.168167 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ab6c0-da54-4e0e-ad49-9c24cb5258bf admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:58.168444 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ab6c0-da54-4e0e-ad49-9c24cb5258bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:58.168714 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ab6c0-da54-4e0e-ad49-9c24cb5258bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:58.168884 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 885/1780] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:29:57 2022] POST /identity/v3/projects => generated 367 bytes in 549 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:29:58.169403 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009ab6c0-da54-4e0e-ad49-9c24cb5258bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:58.171407 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009ab6c0-da54-4e0e-ad49-9c24cb5258bf admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:58.174000 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f71acfd-feb7-4531-959e-62146489e967 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:58.304009 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 896/1781] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:29:58 2022] POST /identity/v3/projects => generated 379 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:29:58.305557 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ab6c0-da54-4e0e-ad49-9c24cb5258bf admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:58.558488 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f71acfd-feb7-4531-959e-62146489e967 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:58.587889 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ab6c0-da54-4e0e-ad49-9c24cb5258bf admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:58.594022 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb36ed90-8260-4c23-b168-dfc027969d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:58.599535 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36ed90-8260-4c23-b168-dfc027969d04 admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:58.600478 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36ed90-8260-4c23-b168-dfc027969d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:58.601287 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36ed90-8260-4c23-b168-dfc027969d04 admin admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:58.602877 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb36ed90-8260-4c23-b168-dfc027969d04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:58.605070 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924317bc-1235-4491-87cb-9eb83de4ae98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:58.605928 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924317bc-1235-4491-87cb-9eb83de4ae98 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:58.606213 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924317bc-1235-4491-87cb-9eb83de4ae98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:58.606590 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924317bc-1235-4491-87cb-9eb83de4ae98 admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:58.607464 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924317bc-1235-4491-87cb-9eb83de4ae98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:58.611803 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb36ed90-8260-4c23-b168-dfc027969d04 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:58.613858 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924317bc-1235-4491-87cb-9eb83de4ae98 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:58.684978 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 897/1782] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:29:58 2022] POST /identity/v3/users => generated 296 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:29:58.688236 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924317bc-1235-4491-87cb-9eb83de4ae98 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:58.701659 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-924317bc-1235-4491-87cb-9eb83de4ae98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:58.710821 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 886/1783] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:29:58 2022] POST /identity/v3/users => generated 290 bytes in 537 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:29:58.712418 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb36ed90-8260-4c23-b168-dfc027969d04 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:58.725068 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb36ed90-8260-4c23-b168-dfc027969d04 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:58.733753 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa3e39-fd56-4d7a-b239-3cf3adaea414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:58.735632 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa3e39-fd56-4d7a-b239-3cf3adaea414 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:58.736182 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa3e39-fd56-4d7a-b239-3cf3adaea414 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:58.736739 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa3e39-fd56-4d7a-b239-3cf3adaea414 admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:58.737630 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfa3e39-fd56-4d7a-b239-3cf3adaea414 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:58.740819 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfa3e39-fd56-4d7a-b239-3cf3adaea414 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:58.744900 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:58.766976 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924317bc-1235-4491-87cb-9eb83de4ae98 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:58.772045 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 887/1784] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:29:58 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:29:58.778245 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa3e39-fd56-4d7a-b239-3cf3adaea414 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:58.790267 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7845a961-55d9-4f2a-81a0-2869a543b0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:58.791982 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845a961-55d9-4f2a-81a0-2869a543b0ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:58.792832 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845a961-55d9-4f2a-81a0-2869a543b0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:58.793611 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845a961-55d9-4f2a-81a0-2869a543b0ed admin admin] PATH_INFO: `/v3/users/1119a63983284a69ba69d532235e32f2` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:58.796728 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7845a961-55d9-4f2a-81a0-2869a543b0ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=1119a63983284a69ba69d532235e32f2)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:58.806282 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7845a961-55d9-4f2a-81a0-2869a543b0ed admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:58.838732 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa3e39-fd56-4d7a-b239-3cf3adaea414 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:58.865704 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cb54b6-b636-4a49-a63e-c4158fe17832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:58.866353 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb54b6-b636-4a49-a63e-c4158fe17832 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:58.866633 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb54b6-b636-4a49-a63e-c4158fe17832 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:58.868868 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb54b6-b636-4a49-a63e-c4158fe17832 admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:58.870777 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cb54b6-b636-4a49-a63e-c4158fe17832 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:58.873706 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cb54b6-b636-4a49-a63e-c4158fe17832 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:58.909290 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 888/1785] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:29:58 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:29:58.910911 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cb54b6-b636-4a49-a63e-c4158fe17832 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:58.932436 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cb54b6-b636-4a49-a63e-c4158fe17832 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:58.962423 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0975d850-de31-4e8a-9bf7-f1868045ed5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:58.965158 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975d850-de31-4e8a-9bf7-f1868045ed5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:58.965800 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975d850-de31-4e8a-9bf7-f1868045ed5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:58.969137 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975d850-de31-4e8a-9bf7-f1868045ed5f admin admin] PATH_INFO: `/v3/projects/ebfdb7619e4043eab6c03ea851c9931f/users/c029e6c1a3f145c5ab4a861c0847718f/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:59.035493 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0975d850-de31-4e8a-9bf7-f1868045ed5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebfdb7619e4043eab6c03ea851c9931f, user_id=c029e6c1a3f145c5ab4a861c0847718f, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:59.062649 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0975d850-de31-4e8a-9bf7-f1868045ed5f admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:59.079247 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-7845a961-55d9-4f2a-81a0-2869a543b0ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1119a63983284a69ba69d532235e32f2'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:59.111429 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-7845a961-55d9-4f2a-81a0-2869a543b0ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1119a63983284a69ba69d532235e32f2'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:59.152461 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-7845a961-55d9-4f2a-81a0-2869a543b0ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1119a63983284a69ba69d532235e32f2'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:59.154037 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-7845a961-55d9-4f2a-81a0-2869a543b0ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1119a63983284a69ba69d532235e32f2'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:59.172284 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 889/1786] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:29:58 2022] PUT /identity/v3/projects/ebfdb7619e4043eab6c03ea851c9931f/users/c029e6c1a3f145c5ab4a861c0847718f/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:29:59.179420 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0975d850-de31-4e8a-9bf7-f1868045ed5f admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:59.191773 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-0975d850-de31-4e8a-9bf7-f1868045ed5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:59.229776 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-7845a961-55d9-4f2a-81a0-2869a543b0ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1119a63983284a69ba69d532235e32f2'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:59.245188 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:59.257675 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 898/1787] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:29:58 2022] DELETE /identity/v3/users/1119a63983284a69ba69d532235e32f2 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:29:59.262784 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7845a961-55d9-4f2a-81a0-2869a543b0ed admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:59.269295 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-7845a961-55d9-4f2a-81a0-2869a543b0ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:59.498781 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0975d850-de31-4e8a-9bf7-f1868045ed5f admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:59.516196 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe4090-a5bd-4245-8ec2-2b69bf1e6d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:59.518221 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe4090-a5bd-4245-8ec2-2b69bf1e6d64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:59.521620 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe4090-a5bd-4245-8ec2-2b69bf1e6d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:59.527551 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe4090-a5bd-4245-8ec2-2b69bf1e6d64 admin admin] PATH_INFO: `/v3/projects/f300f3c364d54d0a8c74bbff0e7da4f6/users/090324081a1f424089f7f8747c753189/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:59.536602 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7845a961-55d9-4f2a-81a0-2869a543b0ed admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:59.561397 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a1ce7e-c943-464a-83c1-f5b88e51c656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:59.562753 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1ce7e-c943-464a-83c1-f5b88e51c656 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:59.565171 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1ce7e-c943-464a-83c1-f5b88e51c656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:59.565867 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1ce7e-c943-464a-83c1-f5b88e51c656 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:59.568087 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a1ce7e-c943-464a-83c1-f5b88e51c656 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:59.575339 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a1ce7e-c943-464a-83c1-f5b88e51c656 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:59.595900 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effe4090-a5bd-4245-8ec2-2b69bf1e6d64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f300f3c364d54d0a8c74bbff0e7da4f6, user_id=090324081a1f424089f7f8747c753189, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:59.607316 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effe4090-a5bd-4245-8ec2-2b69bf1e6d64 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:59.611751 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 899/1788] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:29:59.632983 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c63bfc-6680-46a3-91e1-ee71b3e87c42 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:59.634128 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c63bfc-6680-46a3-91e1-ee71b3e87c42 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:59.634963 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c63bfc-6680-46a3-91e1-ee71b3e87c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:59.651372 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 890/1789] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:29:59 2022] PUT /identity/v3/projects/f300f3c364d54d0a8c74bbff0e7da4f6/users/090324081a1f424089f7f8747c753189/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:29:59.654681 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe4090-a5bd-4245-8ec2-2b69bf1e6d64 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:59.663045 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-effe4090-a5bd-4245-8ec2-2b69bf1e6d64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:59.743570 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-f6c63bfc-6680-46a3-91e1-ee71b3e87c42 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:59.751743 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-f6c63bfc-6680-46a3-91e1-ee71b3e87c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:59.956013 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe4090-a5bd-4245-8ec2-2b69bf1e6d64 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:59.966753 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524df111-2e97-4456-8828-5b0cc856c458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:59.968527 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524df111-2e97-4456-8828-5b0cc856c458 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:59.969008 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524df111-2e97-4456-8828-5b0cc856c458 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:59.969601 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524df111-2e97-4456-8828-5b0cc856c458 admin admin] PATH_INFO: `/v3/users/b54289a9e0bc4e26a7e1ce9b94ee69ed` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:59.972081 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524df111-2e97-4456-8828-5b0cc856c458 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b54289a9e0bc4e26a7e1ce9b94ee69ed)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:59.977475 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524df111-2e97-4456-8828-5b0cc856c458 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:00.042804 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 900/1790] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:29:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:00.045317 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3457e6-d0c9-4103-abff-18d323256348 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:00.045721 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3457e6-d0c9-4103-abff-18d323256348 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:00.046055 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3457e6-d0c9-4103-abff-18d323256348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:00.078798 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-524df111-2e97-4456-8828-5b0cc856c458 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b54289a9e0bc4e26a7e1ce9b94ee69ed'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:00.078798 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-524df111-2e97-4456-8828-5b0cc856c458 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b54289a9e0bc4e26a7e1ce9b94ee69ed'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:00.088249 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-524df111-2e97-4456-8828-5b0cc856c458 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b54289a9e0bc4e26a7e1ce9b94ee69ed'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:00.119472 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-524df111-2e97-4456-8828-5b0cc856c458 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b54289a9e0bc4e26a7e1ce9b94ee69ed'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:00.122016 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-2c3457e6-d0c9-4103-abff-18d323256348 None None] MFA Rules not processed for user `91067603d9c549278cdc2d97b54cca88`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:00.124629 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-2c3457e6-d0c9-4103-abff-18d323256348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:00.138900 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:00.155438 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-524df111-2e97-4456-8828-5b0cc856c458 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b54289a9e0bc4e26a7e1ce9b94ee69ed'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:00.182832 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 891/1791] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:29:59 2022] DELETE /identity/v3/users/b54289a9e0bc4e26a7e1ce9b94ee69ed => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:00.185863 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524df111-2e97-4456-8828-5b0cc856c458 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:00.189729 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-524df111-2e97-4456-8828-5b0cc856c458 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:00.250190 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:00.271314 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 901/1792] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:30:00 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:00.272606 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3457e6-d0c9-4103-abff-18d323256348 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:00.274200 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-2c3457e6-d0c9-4103-abff-18d323256348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:00.296164 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3457e6-d0c9-4103-abff-18d323256348 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:00.499604 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524df111-2e97-4456-8828-5b0cc856c458 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:00.521935 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4100bf51-d1c3-430e-bce7-c4d81796e18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:00.522600 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100bf51-d1c3-430e-bce7-c4d81796e18a admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:00.522789 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee4920-6a5c-4a2e-9905-a6d86771cadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:00.523991 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee4920-6a5c-4a2e-9905-a6d86771cadc admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:00.524723 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee4920-6a5c-4a2e-9905-a6d86771cadc admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:00.525215 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee4920-6a5c-4a2e-9905-a6d86771cadc admin admin] PATH_INFO: `/v3/projects/ebfdb7619e4043eab6c03ea851c9931f/users/c029e6c1a3f145c5ab4a861c0847718f/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:00.535840 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100bf51-d1c3-430e-bce7-c4d81796e18a admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:00.536852 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100bf51-d1c3-430e-bce7-c4d81796e18a admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:00.537601 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4100bf51-d1c3-430e-bce7-c4d81796e18a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:00.542628 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4100bf51-d1c3-430e-bce7-c4d81796e18a admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:00.545633 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dee4920-6a5c-4a2e-9905-a6d86771cadc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebfdb7619e4043eab6c03ea851c9931f, user_id=c029e6c1a3f145c5ab4a861c0847718f, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:00.557529 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dee4920-6a5c-4a2e-9905-a6d86771cadc admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:00.588652 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 902/1793] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:30:00 2022] GET /identity/v3/roles => generated 1420 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:30:00.590549 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4100bf51-d1c3-430e-bce7-c4d81796e18a admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:00.600474 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-4100bf51-d1c3-430e-bce7-c4d81796e18a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:00.607440 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 892/1794] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:30:00 2022] PUT /identity/v3/projects/ebfdb7619e4043eab6c03ea851c9931f/users/c029e6c1a3f145c5ab4a861c0847718f/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:00.622540 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d3bc3-8d2a-4047-b55f-d3405cc54afb None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:00.623276 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d3bc3-8d2a-4047-b55f-d3405cc54afb None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:00.626020 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d3bc3-8d2a-4047-b55f-d3405cc54afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:00.668689 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-130d3bc3-8d2a-4047-b55f-d3405cc54afb None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:00.670124 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-130d3bc3-8d2a-4047-b55f-d3405cc54afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:00.756350 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4100bf51-d1c3-430e-bce7-c4d81796e18a admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:00.762455 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 893/1795] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:30:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:00.764090 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a7979-8184-40bb-8d3e-b38a747e3800 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:00.764374 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a7979-8184-40bb-8d3e-b38a747e3800 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:00.764653 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a7979-8184-40bb-8d3e-b38a747e3800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:00.799718 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-cf3a7979-8184-40bb-8d3e-b38a747e3800 None None] MFA Rules not processed for user `9a872454622d41ce9462890af418182d`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:00.801875 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-cf3a7979-8184-40bb-8d3e-b38a747e3800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:00.909115 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 894/1796] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:30:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:00.909115 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a7979-8184-40bb-8d3e-b38a747e3800 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:00.929443 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8029b7dc-dfae-42a1-9ea5-c173002c357b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:00.931545 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029b7dc-dfae-42a1-9ea5-c173002c357b service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:00.932406 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029b7dc-dfae-42a1-9ea5-c173002c357b service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:00.933307 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029b7dc-dfae-42a1-9ea5-c173002c357b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:00.937154 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-8029b7dc-dfae-42a1-9ea5-c173002c357b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:00.944301 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a7979-8184-40bb-8d3e-b38a747e3800 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:00.959734 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2d6c12-9295-4abf-8a0d-a972a9414d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:00.960782 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d6c12-9295-4abf-8a0d-a972a9414d09 admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:00.960782 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d6c12-9295-4abf-8a0d-a972a9414d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:00.961066 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d6c12-9295-4abf-8a0d-a972a9414d09 admin admin] PATH_INFO: `/v3/projects/f300f3c364d54d0a8c74bbff0e7da4f6/users/090324081a1f424089f7f8747c753189/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:00.966489 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2d6c12-9295-4abf-8a0d-a972a9414d09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f300f3c364d54d0a8c74bbff0e7da4f6, user_id=090324081a1f424089f7f8747c753189, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:00.970743 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2d6c12-9295-4abf-8a0d-a972a9414d09 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:00.976303 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8029b7dc-dfae-42a1-9ea5-c173002c357b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:00.987192 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8029b7dc-dfae-42a1-9ea5-c173002c357b service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:01.003055 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 895/1797] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:30:00 2022] PUT /identity/v3/projects/f300f3c364d54d0a8c74bbff0e7da4f6/users/090324081a1f424089f7f8747c753189/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:01.005091 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6bbec4-b2c4-44ea-9e09-b1ee186b00ad None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:01.005587 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6bbec4-b2c4-44ea-9e09-b1ee186b00ad None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:01.007302 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6bbec4-b2c4-44ea-9e09-b1ee186b00ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:01.036587 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 903/1798] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:30:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:30:01.039599 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8029b7dc-dfae-42a1-9ea5-c173002c357b service neutron] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:01.073983 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8029b7dc-dfae-42a1-9ea5-c173002c357b service neutron] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:01.086495 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-2e6bbec4-b2c4-44ea-9e09-b1ee186b00ad None None] MFA Rules not processed for user `c029e6c1a3f145c5ab4a861c0847718f`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:01.087846 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-2e6bbec4-b2c4-44ea-9e09-b1ee186b00ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:01.113601 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:01.196385 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:01.295550 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 896/1799] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:30:01 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:01.298222 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d92f94-0903-465b-9c32-979ef790e20c None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:01.298798 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d92f94-0903-465b-9c32-979ef790e20c None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:01.299242 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d92f94-0903-465b-9c32-979ef790e20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:01.313999 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b474a2d-cbe0-4697-b413-ea96ebf49d64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:01.315488 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b474a2d-cbe0-4697-b413-ea96ebf49d64 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:01.319575 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b474a2d-cbe0-4697-b413-ea96ebf49d64 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:01.320386 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b474a2d-cbe0-4697-b413-ea96ebf49d64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:01.350320 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-21d92f94-0903-465b-9c32-979ef790e20c None None] MFA Rules not processed for user `090324081a1f424089f7f8747c753189`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:01.352157 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-21d92f94-0903-465b-9c32-979ef790e20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:01.524834 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 897/1800] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:30:01 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:01.526459 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b474a2d-cbe0-4697-b413-ea96ebf49d64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:01.527008 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d92f94-0903-465b-9c32-979ef790e20c None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:01.530249 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-21d92f94-0903-465b-9c32-979ef790e20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:01.545424 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b474a2d-cbe0-4697-b413-ea96ebf49d64 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:01.588109 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 904/1801] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:30:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:30:01.601650 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b474a2d-cbe0-4697-b413-ea96ebf49d64 service neutron] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:01.604240 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-8b474a2d-cbe0-4697-b413-ea96ebf49d64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:01.678476 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d92f94-0903-465b-9c32-979ef790e20c None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:01.692213 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d21c4-b66a-4a62-b1e7-2563ad68944a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:01.692507 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d21c4-b66a-4a62-b1e7-2563ad68944a service cinder] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:01.692911 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d21c4-b66a-4a62-b1e7-2563ad68944a service cinder] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:01.693223 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d21c4-b66a-4a62-b1e7-2563ad68944a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:01.697564 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b474a2d-cbe0-4697-b413-ea96ebf49d64 service neutron] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:01.703055 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b50e0a-4018-4fa9-bcba-2e4f24a5eb70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:01.703984 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b50e0a-4018-4fa9-bcba-2e4f24a5eb70 service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:01.704267 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b50e0a-4018-4fa9-bcba-2e4f24a5eb70 service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:01.704539 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b50e0a-4018-4fa9-bcba-2e4f24a5eb70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:01.717667 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85d21c4-b66a-4a62-b1e7-2563ad68944a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:01.719185 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85d21c4-b66a-4a62-b1e7-2563ad68944a service cinder] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:01.719593 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b50e0a-4018-4fa9-bcba-2e4f24a5eb70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:01.722729 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b50e0a-4018-4fa9-bcba-2e4f24a5eb70 service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:01.731420 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 898/1802] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:30:01 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:30:01.746483 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 905/1803] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:30:01 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:30:01.865500 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d21c4-b66a-4a62-b1e7-2563ad68944a service cinder] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:01.875336 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d21c4-b66a-4a62-b1e7-2563ad68944a service cinder] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:01.880741 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a13fc0-c20a-4b95-95c7-b77f0f8ce2e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:01.881480 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a13fc0-c20a-4b95-95c7-b77f0f8ce2e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:01.881835 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a13fc0-c20a-4b95-95c7-b77f0f8ce2e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:01.882183 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a13fc0-c20a-4b95-95c7-b77f0f8ce2e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:01.884395 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-c0a13fc0-c20a-4b95-95c7-b77f0f8ce2e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:01.950333 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:01.965074 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a13fc0-c20a-4b95-95c7-b77f0f8ce2e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:01.966694 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a13fc0-c20a-4b95-95c7-b77f0f8ce2e2 service cinder] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:01.979845 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 899/1804] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:30:01 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:30:02.336222 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b50e0a-4018-4fa9-bcba-2e4f24a5eb70 service cinder] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:02.337744 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-01b50e0a-4018-4fa9-bcba-2e4f24a5eb70 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:02.368136 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b50e0a-4018-4fa9-bcba-2e4f24a5eb70 service cinder] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:02.377545 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711aae19-ae8e-4f50-b915-288752dba374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:02.378366 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711aae19-ae8e-4f50-b915-288752dba374 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:02.378806 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711aae19-ae8e-4f50-b915-288752dba374 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:02.379667 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711aae19-ae8e-4f50-b915-288752dba374 admin admin] PATH_INFO: `/v3/projects/5f2f06bdfbfb435fbfc082f289b85d38` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:02.380873 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711aae19-ae8e-4f50-b915-288752dba374 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f2f06bdfbfb435fbfc082f289b85d38)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:02.382922 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711aae19-ae8e-4f50-b915-288752dba374 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:02.583251 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-711aae19-ae8e-4f50-b915-288752dba374 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f2f06bdfbfb435fbfc082f289b85d38', 'request_id': 'req-711aae19-ae8e-4f50-b915-288752dba374'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:02.597527 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-711aae19-ae8e-4f50-b915-288752dba374 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f2f06bdfbfb435fbfc082f289b85d38', 'request_id': 'req-711aae19-ae8e-4f50-b915-288752dba374'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:02.610769 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:02.613958 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-711aae19-ae8e-4f50-b915-288752dba374 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f2f06bdfbfb435fbfc082f289b85d38', 'request_id': 'req-711aae19-ae8e-4f50-b915-288752dba374'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:02.664889 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-711aae19-ae8e-4f50-b915-288752dba374 admin admin] The token cache is being invalidate because project 5f2f06bdfbfb435fbfc082f289b85d38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:30:02.665467 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-711aae19-ae8e-4f50-b915-288752dba374 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:02.667390 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-711aae19-ae8e-4f50-b915-288752dba374 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:02.675508 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 906/1805] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:30:02 2022] DELETE /identity/v3/projects/5f2f06bdfbfb435fbfc082f289b85d38 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:02.676971 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a13fc0-c20a-4b95-95c7-b77f0f8ce2e2 service cinder] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:02.693005 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a13fc0-c20a-4b95-95c7-b77f0f8ce2e2 service cinder] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:02.793799 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce067d7-a89d-4185-b11d-3de90de1ba4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:02.794686 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce067d7-a89d-4185-b11d-3de90de1ba4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:02.794967 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce067d7-a89d-4185-b11d-3de90de1ba4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:02.795399 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce067d7-a89d-4185-b11d-3de90de1ba4a admin admin] PATH_INFO: `/v3/users/990258c3d6e040b6960f3f5b71c1029b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:02.797083 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce067d7-a89d-4185-b11d-3de90de1ba4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=990258c3d6e040b6960f3f5b71c1029b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:02.799031 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce067d7-a89d-4185-b11d-3de90de1ba4a admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:02.841810 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711aae19-ae8e-4f50-b915-288752dba374 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:02.843683 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-711aae19-ae8e-4f50-b915-288752dba374 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:02.875219 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711aae19-ae8e-4f50-b915-288752dba374 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:02.910869 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-8ce067d7-a89d-4185-b11d-3de90de1ba4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '990258c3d6e040b6960f3f5b71c1029b'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:02.914624 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-8ce067d7-a89d-4185-b11d-3de90de1ba4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '990258c3d6e040b6960f3f5b71c1029b'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:02.916870 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-8ce067d7-a89d-4185-b11d-3de90de1ba4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '990258c3d6e040b6960f3f5b71c1029b'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:02.949945 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb250463-baf5-4e1d-a4ae-785ff193eae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:02.953090 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb250463-baf5-4e1d-a4ae-785ff193eae9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:02.953634 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb250463-baf5-4e1d-a4ae-785ff193eae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:02.954682 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb250463-baf5-4e1d-a4ae-785ff193eae9 admin admin] PATH_INFO: `/v3/users/6c5751fca7fd4ec08f126309aeecca8a` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:02.958332 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb250463-baf5-4e1d-a4ae-785ff193eae9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c5751fca7fd4ec08f126309aeecca8a)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:02.962744 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb250463-baf5-4e1d-a4ae-785ff193eae9 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:02.972199 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-8ce067d7-a89d-4185-b11d-3de90de1ba4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '990258c3d6e040b6960f3f5b71c1029b'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:03.050056 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-8ce067d7-a89d-4185-b11d-3de90de1ba4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '990258c3d6e040b6960f3f5b71c1029b'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:03.106702 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-eb250463-baf5-4e1d-a4ae-785ff193eae9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c5751fca7fd4ec08f126309aeecca8a'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:03.123447 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 900/1806] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:30:02 2022] DELETE /identity/v3/users/990258c3d6e040b6960f3f5b71c1029b => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:03.126933 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-eb250463-baf5-4e1d-a4ae-785ff193eae9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c5751fca7fd4ec08f126309aeecca8a'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:03.135298 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b190f-8ab1-4dbe-8560-d4c26aa55a04 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:03.136192 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b190f-8ab1-4dbe-8560-d4c26aa55a04 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:03.136642 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b190f-8ab1-4dbe-8560-d4c26aa55a04 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:03.139628 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 901/1807] 10.222.0.91 () {54 vars in 912 bytes} [Tue Aug 30 04:30:03 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:30:03.141547 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b190f-8ab1-4dbe-8560-d4c26aa55a04 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:03.154159 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-eb250463-baf5-4e1d-a4ae-785ff193eae9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c5751fca7fd4ec08f126309aeecca8a'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:03.154741 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-eb250463-baf5-4e1d-a4ae-785ff193eae9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c5751fca7fd4ec08f126309aeecca8a'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:03.178234 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-146b190f-8ab1-4dbe-8560-d4c26aa55a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:03.194187 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-eb250463-baf5-4e1d-a4ae-785ff193eae9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c5751fca7fd4ec08f126309aeecca8a'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:03.207977 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 907/1808] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:30:02 2022] DELETE /identity/v3/users/6c5751fca7fd4ec08f126309aeecca8a => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:30:03.209861 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625e56e-009e-40e1-9b32-92d8c62d32f0 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:03.210328 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625e56e-009e-40e1-9b32-92d8c62d32f0 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:03.210743 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625e56e-009e-40e1-9b32-92d8c62d32f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:03.262052 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-c625e56e-009e-40e1-9b32-92d8c62d32f0 None None] MFA Rules not processed for user `1c05f49ae42b4f9583ff10b2cfce52a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:03.266559 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-c625e56e-009e-40e1-9b32-92d8c62d32f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:03.430834 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b190f-8ab1-4dbe-8560-d4c26aa55a04 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:03.442876 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 908/1809] 10.222.0.91 () {58 vars in 1009 bytes} [Tue Aug 30 04:30:03 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:03.445351 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead1fe0-0186-4deb-999b-3af01efb1bfb None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:03.445638 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead1fe0-0186-4deb-999b-3af01efb1bfb None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:03.445918 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead1fe0-0186-4deb-999b-3af01efb1bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:03.488293 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:03.526266 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-7ead1fe0-0186-4deb-999b-3af01efb1bfb None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:03.538903 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-7ead1fe0-0186-4deb-999b-3af01efb1bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:03.633660 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6871440-08e8-474b-b771-e0769a387ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:03.640489 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6871440-08e8-474b-b771-e0769a387ee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:03.640489 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6871440-08e8-474b-b771-e0769a387ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:03.640489 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6871440-08e8-474b-b771-e0769a387ee6 admin admin] PATH_INFO: `/v3/projects/4e3490dfe4a640cfbe39a1071ea4e38a` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:03.641875 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6871440-08e8-474b-b771-e0769a387ee6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e3490dfe4a640cfbe39a1071ea4e38a)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:03.647069 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6871440-08e8-474b-b771-e0769a387ee6 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:03.674425 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 909/1810] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:30:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:03.675897 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ead1fe0-0186-4deb-999b-3af01efb1bfb None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:03.677881 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-7ead1fe0-0186-4deb-999b-3af01efb1bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:03.728651 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ead1fe0-0186-4deb-999b-3af01efb1bfb None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:03.732707 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5341658a-5651-4d94-a39b-fdd2f7897a18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:03.735270 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5341658a-5651-4d94-a39b-fdd2f7897a18 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:03.735947 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5341658a-5651-4d94-a39b-fdd2f7897a18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:03.736994 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5341658a-5651-4d94-a39b-fdd2f7897a18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:03.764844 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5341658a-5651-4d94-a39b-fdd2f7897a18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:03.766275 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5341658a-5651-4d94-a39b-fdd2f7897a18 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:03.776412 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:03.780396 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-e6871440-08e8-474b-b771-e0769a387ee6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e3490dfe4a640cfbe39a1071ea4e38a', 'request_id': 'req-e6871440-08e8-474b-b771-e0769a387ee6'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:03.791957 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-e6871440-08e8-474b-b771-e0769a387ee6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e3490dfe4a640cfbe39a1071ea4e38a', 'request_id': 'req-e6871440-08e8-474b-b771-e0769a387ee6'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:03.797001 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 910/1811] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:30:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:30:03.800697 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5341658a-5651-4d94-a39b-fdd2f7897a18 service neutron] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:03.804386 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-5341658a-5651-4d94-a39b-fdd2f7897a18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:03.807047 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-e6871440-08e8-474b-b771-e0769a387ee6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e3490dfe4a640cfbe39a1071ea4e38a', 'request_id': 'req-e6871440-08e8-474b-b771-e0769a387ee6'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:03.827491 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5341658a-5651-4d94-a39b-fdd2f7897a18 service neutron] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:03.830110 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-e6871440-08e8-474b-b771-e0769a387ee6 admin admin] The token cache is being invalidate because project 4e3490dfe4a640cfbe39a1071ea4e38a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:30:03.830710 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-e6871440-08e8-474b-b771-e0769a387ee6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:03.831882 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-e6871440-08e8-474b-b771-e0769a387ee6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:03.840344 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 902/1812] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:30:03 2022] DELETE /identity/v3/projects/4e3490dfe4a640cfbe39a1071ea4e38a => generated 0 bytes in 696 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:03.842307 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6871440-08e8-474b-b771-e0769a387ee6 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:03.844472 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-e6871440-08e8-474b-b771-e0769a387ee6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:03.975218 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6871440-08e8-474b-b771-e0769a387ee6 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:03.978217 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf58c058-835a-45ce-bbf4-88f08a0e4e00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:03.979030 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58c058-835a-45ce-bbf4-88f08a0e4e00 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:03.979427 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58c058-835a-45ce-bbf4-88f08a0e4e00 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:03.979847 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58c058-835a-45ce-bbf4-88f08a0e4e00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:03.984320 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7404fa4a-f486-46d4-8ef1-3302fe4c79ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:03.984544 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-cf58c058-835a-45ce-bbf4-88f08a0e4e00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:03.985706 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7404fa4a-f486-46d4-8ef1-3302fe4c79ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:03.985706 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7404fa4a-f486-46d4-8ef1-3302fe4c79ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:03.985706 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7404fa4a-f486-46d4-8ef1-3302fe4c79ee admin admin] PATH_INFO: `/v3/users/34337cf10266409b88b30fa1fbde8cce` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:03.988898 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7404fa4a-f486-46d4-8ef1-3302fe4c79ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=34337cf10266409b88b30fa1fbde8cce)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:03.993821 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7404fa4a-f486-46d4-8ef1-3302fe4c79ee admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:04.007890 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf58c058-835a-45ce-bbf4-88f08a0e4e00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:04.009858 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf58c058-835a-45ce-bbf4-88f08a0e4e00 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:04.038365 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 911/1813] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:30:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:30:04.142483 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-7404fa4a-f486-46d4-8ef1-3302fe4c79ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34337cf10266409b88b30fa1fbde8cce'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:04.143884 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-7404fa4a-f486-46d4-8ef1-3302fe4c79ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34337cf10266409b88b30fa1fbde8cce'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:04.149019 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-7404fa4a-f486-46d4-8ef1-3302fe4c79ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34337cf10266409b88b30fa1fbde8cce'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:04.175104 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:04.191062 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-7404fa4a-f486-46d4-8ef1-3302fe4c79ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34337cf10266409b88b30fa1fbde8cce'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:04.233698 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-7404fa4a-f486-46d4-8ef1-3302fe4c79ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34337cf10266409b88b30fa1fbde8cce'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:04.271548 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 903/1814] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:30:03 2022] DELETE /identity/v3/users/34337cf10266409b88b30fa1fbde8cce => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:04.295759 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf58c058-835a-45ce-bbf4-88f08a0e4e00 service neutron] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:04.300083 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-cf58c058-835a-45ce-bbf4-88f08a0e4e00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:04.376976 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf58c058-835a-45ce-bbf4-88f08a0e4e00 service neutron] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:04.574290 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3d54ea-becd-4edf-967d-122f476b58f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:04.576879 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d54ea-becd-4edf-967d-122f476b58f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:04.578128 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d54ea-becd-4edf-967d-122f476b58f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:04.580010 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d54ea-becd-4edf-967d-122f476b58f5 admin admin] PATH_INFO: `/v3/projects/d0d079afa3b64cd9bfe5b01a65b2502b` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:04.582666 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3d54ea-becd-4edf-967d-122f476b58f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0d079afa3b64cd9bfe5b01a65b2502b)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:04.588781 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3d54ea-becd-4edf-967d-122f476b58f5 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:04.740050 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-2c3d54ea-becd-4edf-967d-122f476b58f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0d079afa3b64cd9bfe5b01a65b2502b', 'request_id': 'req-2c3d54ea-becd-4edf-967d-122f476b58f5'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:04.771345 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-2c3d54ea-becd-4edf-967d-122f476b58f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0d079afa3b64cd9bfe5b01a65b2502b', 'request_id': 'req-2c3d54ea-becd-4edf-967d-122f476b58f5'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:04.804169 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-2c3d54ea-becd-4edf-967d-122f476b58f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0d079afa3b64cd9bfe5b01a65b2502b', 'request_id': 'req-2c3d54ea-becd-4edf-967d-122f476b58f5'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:04.872612 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-2c3d54ea-becd-4edf-967d-122f476b58f5 admin admin] The token cache is being invalidate because project d0d079afa3b64cd9bfe5b01a65b2502b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:30:04.873125 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-2c3d54ea-becd-4edf-967d-122f476b58f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:04.876082 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-2c3d54ea-becd-4edf-967d-122f476b58f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:04.885566 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 912/1815] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:30:04 2022] DELETE /identity/v3/projects/d0d079afa3b64cd9bfe5b01a65b2502b => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:04.905468 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909d70f-fd48-41a1-a628-49bcb49b3559 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:04.906766 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909d70f-fd48-41a1-a628-49bcb49b3559 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:04.910800 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909d70f-fd48-41a1-a628-49bcb49b3559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:05.017605 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-8909d70f-fd48-41a1-a628-49bcb49b3559 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:05.019955 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-8909d70f-fd48-41a1-a628-49bcb49b3559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:05.226262 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 904/1816] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:30:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:05.244292 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337a449-e8a3-4edb-b908-fe7faf566ef2 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:05.244292 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337a449-e8a3-4edb-b908-fe7faf566ef2 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:05.244292 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337a449-e8a3-4edb-b908-fe7faf566ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:05.331650 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-c337a449-e8a3-4edb-b908-fe7faf566ef2 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:05.337335 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-c337a449-e8a3-4edb-b908-fe7faf566ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:05.380036 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 913/1817] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:30:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:05.394836 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8909d70f-fd48-41a1-a628-49bcb49b3559 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:05.427020 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8909d70f-fd48-41a1-a628-49bcb49b3559 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:05.435347 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f234158-b630-4b2d-9841-1bab3abee9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:05.435877 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f234158-b630-4b2d-9841-1bab3abee9cb admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:05.436966 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f234158-b630-4b2d-9841-1bab3abee9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:05.437228 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f234158-b630-4b2d-9841-1bab3abee9cb admin admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:05.445716 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20dd240-bdff-4ab3-8d65-36c625233858 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:05.445716 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20dd240-bdff-4ab3-8d65-36c625233858 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:05.445716 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20dd240-bdff-4ab3-8d65-36c625233858 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:05.447629 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 914/1818] 10.222.0.91 () {54 vars in 921 bytes} [Tue Aug 30 04:30:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:30:05.449366 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f234158-b630-4b2d-9841-1bab3abee9cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:30:05.449699 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f234158-b630-4b2d-9841-1bab3abee9cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:05.455188 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f234158-b630-4b2d-9841-1bab3abee9cb admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:05.470767 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825969f-1d2d-43aa-8f35-95f10cd1dda2 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:05.471707 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825969f-1d2d-43aa-8f35-95f10cd1dda2 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:05.472081 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825969f-1d2d-43aa-8f35-95f10cd1dda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:05.499433 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-6825969f-1d2d-43aa-8f35-95f10cd1dda2 None None] MFA Rules not processed for user `d806295278ae4997b5c6968aa553290c`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:05.500782 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-6825969f-1d2d-43aa-8f35-95f10cd1dda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:05.516068 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 905/1819] 10.222.0.91 () {58 vars in 1153 bytes} [Tue Aug 30 04:30:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:30:05.519280 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f234158-b630-4b2d-9841-1bab3abee9cb admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:05.571360 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f234158-b630-4b2d-9841-1bab3abee9cb admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:05.575186 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:05.600309 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2669df14-71db-4921-9253-85d525b1f0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:05.600987 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669df14-71db-4921-9253-85d525b1f0a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:05.602009 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669df14-71db-4921-9253-85d525b1f0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:05.602334 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669df14-71db-4921-9253-85d525b1f0a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:05.609467 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2669df14-71db-4921-9253-85d525b1f0a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:05.613875 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2669df14-71db-4921-9253-85d525b1f0a1 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:05.685731 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 906/1820] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:30:05 2022] POST /identity/v3/projects => generated 383 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:30:05.687697 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2669df14-71db-4921-9253-85d525b1f0a1 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:05.689718 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-2669df14-71db-4921-9253-85d525b1f0a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:05.737758 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 915/1821] 10.222.0.91 () {58 vars in 1018 bytes} [Tue Aug 30 04:30:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:30:05.739266 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825969f-1d2d-43aa-8f35-95f10cd1dda2 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:05.771605 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825969f-1d2d-43aa-8f35-95f10cd1dda2 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:05.888850 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2669df14-71db-4921-9253-85d525b1f0a1 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:05.896123 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f079c8b-93f2-4c9c-b7dc-effcbc76613f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:05.897229 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f079c8b-93f2-4c9c-b7dc-effcbc76613f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:05.897698 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f079c8b-93f2-4c9c-b7dc-effcbc76613f admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:05.898879 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f079c8b-93f2-4c9c-b7dc-effcbc76613f admin admin] PATH_INFO: `/v3/projects/793e87aeab2f4829b6eda5f43a7c66dc` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:05.900624 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f079c8b-93f2-4c9c-b7dc-effcbc76613f admin admin] RBAC: Authorizing `identity:delete_project(project_id=793e87aeab2f4829b6eda5f43a7c66dc)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:05.903192 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec92c22-57cf-449d-bd8b-97976b3806c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:05.903978 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f079c8b-93f2-4c9c-b7dc-effcbc76613f admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:05.904165 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec92c22-57cf-449d-bd8b-97976b3806c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:05.907442 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec92c22-57cf-449d-bd8b-97976b3806c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:05.907856 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec92c22-57cf-449d-bd8b-97976b3806c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:05.909127 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec92c22-57cf-449d-bd8b-97976b3806c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:05.913752 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec92c22-57cf-449d-bd8b-97976b3806c0 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:05.979546 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 916/1822] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:30:05 2022] POST /identity/v3/users => generated 292 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:30:05.981824 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec92c22-57cf-449d-bd8b-97976b3806c0 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:06.008108 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:06.009932 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec92c22-57cf-449d-bd8b-97976b3806c0 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:06.026085 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-7f079c8b-93f2-4c9c-b7dc-effcbc76613f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '793e87aeab2f4829b6eda5f43a7c66dc', 'request_id': 'req-7f079c8b-93f2-4c9c-b7dc-effcbc76613f'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:06.035062 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-7f079c8b-93f2-4c9c-b7dc-effcbc76613f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '793e87aeab2f4829b6eda5f43a7c66dc', 'request_id': 'req-7f079c8b-93f2-4c9c-b7dc-effcbc76613f'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:06.052085 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-7f079c8b-93f2-4c9c-b7dc-effcbc76613f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '793e87aeab2f4829b6eda5f43a7c66dc', 'request_id': 'req-7f079c8b-93f2-4c9c-b7dc-effcbc76613f'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:06.075126 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-7f079c8b-93f2-4c9c-b7dc-effcbc76613f admin admin] The token cache is being invalidate because project 793e87aeab2f4829b6eda5f43a7c66dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:30:06.075410 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-7f079c8b-93f2-4c9c-b7dc-effcbc76613f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:06.076188 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-7f079c8b-93f2-4c9c-b7dc-effcbc76613f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:06.080084 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 907/1823] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:30:05 2022] DELETE /identity/v3/projects/793e87aeab2f4829b6eda5f43a7c66dc => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:06.085200 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f079c8b-93f2-4c9c-b7dc-effcbc76613f admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:06.086705 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-7f079c8b-93f2-4c9c-b7dc-effcbc76613f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:06.167618 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163aa7ca-843a-4664-bb44-6004d8456ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:06.168676 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163aa7ca-843a-4664-bb44-6004d8456ef7 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:06.169371 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163aa7ca-843a-4664-bb44-6004d8456ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:06.169891 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163aa7ca-843a-4664-bb44-6004d8456ef7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:06.171208 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163aa7ca-843a-4664-bb44-6004d8456ef7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:06.175828 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163aa7ca-843a-4664-bb44-6004d8456ef7 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:06.209014 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 917/1824] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:30:05 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:30:06.210993 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163aa7ca-843a-4664-bb44-6004d8456ef7 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:06.213991 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-163aa7ca-843a-4664-bb44-6004d8456ef7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:06.245401 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163aa7ca-843a-4664-bb44-6004d8456ef7 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:06.250161 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f079c8b-93f2-4c9c-b7dc-effcbc76613f admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:06.260200 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856c66b-2d98-4403-873b-5ffb4e40442c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:06.260943 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856c66b-2d98-4403-873b-5ffb4e40442c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:06.261225 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856c66b-2d98-4403-873b-5ffb4e40442c admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:06.261508 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856c66b-2d98-4403-873b-5ffb4e40442c admin admin] PATH_INFO: `/v3/users/c029e6c1a3f145c5ab4a861c0847718f` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:06.262139 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8383011c-d1b9-4188-9b0b-a63e93f3cf09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:06.263884 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8383011c-d1b9-4188-9b0b-a63e93f3cf09 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:06.265699 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8383011c-d1b9-4188-9b0b-a63e93f3cf09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:06.266445 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8383011c-d1b9-4188-9b0b-a63e93f3cf09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:06.267885 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8383011c-d1b9-4188-9b0b-a63e93f3cf09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:06.272411 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4856c66b-2d98-4403-873b-5ffb4e40442c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c029e6c1a3f145c5ab4a861c0847718f)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:06.273018 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8383011c-d1b9-4188-9b0b-a63e93f3cf09 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:06.279948 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4856c66b-2d98-4403-873b-5ffb4e40442c admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:06.307158 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 918/1825] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:30:06 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:30:06.309074 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8383011c-d1b9-4188-9b0b-a63e93f3cf09 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:06.312798 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-8383011c-d1b9-4188-9b0b-a63e93f3cf09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:06.415880 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:06.507965 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-4856c66b-2d98-4403-873b-5ffb4e40442c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c029e6c1a3f145c5ab4a861c0847718f'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:06.520127 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-4856c66b-2d98-4403-873b-5ffb4e40442c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c029e6c1a3f145c5ab4a861c0847718f'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:06.520127 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-4856c66b-2d98-4403-873b-5ffb4e40442c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c029e6c1a3f145c5ab4a861c0847718f'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:06.545292 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-4856c66b-2d98-4403-873b-5ffb4e40442c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c029e6c1a3f145c5ab4a861c0847718f'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:06.607066 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-4856c66b-2d98-4403-873b-5ffb4e40442c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c029e6c1a3f145c5ab4a861c0847718f'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:06.630943 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8383011c-d1b9-4188-9b0b-a63e93f3cf09 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:06.666625 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 908/1826] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:30:06 2022] DELETE /identity/v3/users/c029e6c1a3f145c5ab4a861c0847718f => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:06.668328 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856c66b-2d98-4403-873b-5ffb4e40442c admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:06.670113 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-4856c66b-2d98-4403-873b-5ffb4e40442c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:06.671434 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba6647-1f36-46b4-861d-1004d569f7fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd806295278ae4997b5c6968aa553290c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:06.672744 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba6647-1f36-46b4-861d-1004d569f7fb service nova] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:06.676504 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba6647-1f36-46b4-861d-1004d569f7fb service nova] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:06.681693 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba6647-1f36-46b4-861d-1004d569f7fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:06.685296 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-c9ba6647-1f36-46b4-861d-1004d569f7fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:06.725978 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba6647-1f36-46b4-861d-1004d569f7fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:06.728007 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba6647-1f36-46b4-861d-1004d569f7fb service nova] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:06.748928 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 919/1827] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:30:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:30:06.811681 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:06.859258 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba6647-1f36-46b4-861d-1004d569f7fb service nova] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:06.863538 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-c9ba6647-1f36-46b4-861d-1004d569f7fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:06.907228 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba6647-1f36-46b4-861d-1004d569f7fb service nova] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:06.908121 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856c66b-2d98-4403-873b-5ffb4e40442c admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:06.924902 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b1e311-2266-4cf6-8885-bf5065ec9193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:06.925986 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d049ded2-eb61-40bb-ac77-75070f5b5094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:06.927114 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1e311-2266-4cf6-8885-bf5065ec9193 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:06.927594 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1e311-2266-4cf6-8885-bf5065ec9193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:06.928481 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1e311-2266-4cf6-8885-bf5065ec9193 admin admin] PATH_INFO: `/v3/projects/f98bc2887d6e4833b657d99fd0691046` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:06.930556 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b1e311-2266-4cf6-8885-bf5065ec9193 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f98bc2887d6e4833b657d99fd0691046)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:06.931102 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049ded2-eb61-40bb-ac77-75070f5b5094 admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:06.931568 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049ded2-eb61-40bb-ac77-75070f5b5094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:06.932044 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049ded2-eb61-40bb-ac77-75070f5b5094 admin admin] PATH_INFO: `/v3/projects/194e4fb98c89450eab94a9df2b9a99a5/users/7625945f0dc74f4983112f71987903db/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:06.934341 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b1e311-2266-4cf6-8885-bf5065ec9193 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:07.006303 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d049ded2-eb61-40bb-ac77-75070f5b5094 admin admin] RBAC: Authorizing `identity:create_grant(project_id=194e4fb98c89450eab94a9df2b9a99a5, user_id=7625945f0dc74f4983112f71987903db, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:07.017926 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d049ded2-eb61-40bb-ac77-75070f5b5094 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:07.090289 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 909/1828] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:30:06 2022] PUT /identity/v3/projects/194e4fb98c89450eab94a9df2b9a99a5/users/7625945f0dc74f4983112f71987903db/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:07.107402 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193bcdf9-38ce-49ee-98e7-3faccb6f6e28 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:07.107884 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193bcdf9-38ce-49ee-98e7-3faccb6f6e28 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:07.108463 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193bcdf9-38ce-49ee-98e7-3faccb6f6e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:07.133105 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-e2b1e311-2266-4cf6-8885-bf5065ec9193 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f98bc2887d6e4833b657d99fd0691046', 'request_id': 'req-e2b1e311-2266-4cf6-8885-bf5065ec9193'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:07.169692 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-e2b1e311-2266-4cf6-8885-bf5065ec9193 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f98bc2887d6e4833b657d99fd0691046', 'request_id': 'req-e2b1e311-2266-4cf6-8885-bf5065ec9193'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:07.202891 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-193bcdf9-38ce-49ee-98e7-3faccb6f6e28 None None] MFA Rules not processed for user `7625945f0dc74f4983112f71987903db`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:07.204347 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-193bcdf9-38ce-49ee-98e7-3faccb6f6e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:07.234259 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-e2b1e311-2266-4cf6-8885-bf5065ec9193 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f98bc2887d6e4833b657d99fd0691046', 'request_id': 'req-e2b1e311-2266-4cf6-8885-bf5065ec9193'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:07.284515 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-e2b1e311-2266-4cf6-8885-bf5065ec9193 admin admin] The token cache is being invalidate because project f98bc2887d6e4833b657d99fd0691046 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:30:07.285264 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-e2b1e311-2266-4cf6-8885-bf5065ec9193 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:07.286575 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-e2b1e311-2266-4cf6-8885-bf5065ec9193 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:07.288947 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 920/1829] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:30:06 2022] DELETE /identity/v3/projects/f98bc2887d6e4833b657d99fd0691046 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:07.296469 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ad99e-a69d-4888-8f80-3c951ccfbf0b None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:07.296796 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ad99e-a69d-4888-8f80-3c951ccfbf0b None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:07.297988 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ad99e-a69d-4888-8f80-3c951ccfbf0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:07.326976 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 910/1830] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:30:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:30:07.337545 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-091ad99e-a69d-4888-8f80-3c951ccfbf0b None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:07.339139 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-091ad99e-a69d-4888-8f80-3c951ccfbf0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:07.347958 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193bcdf9-38ce-49ee-98e7-3faccb6f6e28 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:07.349526 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-193bcdf9-38ce-49ee-98e7-3faccb6f6e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:07.483341 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193bcdf9-38ce-49ee-98e7-3faccb6f6e28 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:07.485886 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27b389-4bfb-4ff6-b88c-fc5f05511958 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:07.486718 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27b389-4bfb-4ff6-b88c-fc5f05511958 service cinder] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:07.487154 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27b389-4bfb-4ff6-b88c-fc5f05511958 service cinder] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:07.487410 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27b389-4bfb-4ff6-b88c-fc5f05511958 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:07.501949 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c27b389-4bfb-4ff6-b88c-fc5f05511958 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:07.504323 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c27b389-4bfb-4ff6-b88c-fc5f05511958 service cinder] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:07.548083 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 921/1831] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:30:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:07.549348 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 911/1832] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:30:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:30:07.559524 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dcd79c-bb79-4fd1-a59d-41379c861e9f None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:07.560093 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dcd79c-bb79-4fd1-a59d-41379c861e9f None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:07.560532 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dcd79c-bb79-4fd1-a59d-41379c861e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:07.625579 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27b389-4bfb-4ff6-b88c-fc5f05511958 service cinder] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:07.627229 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-8c27b389-4bfb-4ff6-b88c-fc5f05511958 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:07.649847 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27b389-4bfb-4ff6-b88c-fc5f05511958 service cinder] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:07.670658 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-b9dcd79c-bb79-4fd1-a59d-41379c861e9f None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:07.673074 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-b9dcd79c-bb79-4fd1-a59d-41379c861e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:07.675658 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ec1da-c0a5-422f-966c-b1a169395b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:07.679026 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ec1da-c0a5-422f-966c-b1a169395b4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:07.679329 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ec1da-c0a5-422f-966c-b1a169395b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:07.679604 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ec1da-c0a5-422f-966c-b1a169395b4f admin admin] PATH_INFO: `/v3/users/7625945f0dc74f4983112f71987903db` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:07.682968 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879ec1da-c0a5-422f-966c-b1a169395b4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7625945f0dc74f4983112f71987903db)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:07.690150 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879ec1da-c0a5-422f-966c-b1a169395b4f admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:07.697942 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 922/1833] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:30:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:07.714470 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dcd79c-bb79-4fd1-a59d-41379c861e9f None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:07.753298 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dcd79c-bb79-4fd1-a59d-41379c861e9f None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:07.797338 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e003aefa-a788-4d69-bd3e-9f771eeed55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:07.798161 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003aefa-a788-4d69-bd3e-9f771eeed55b admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:07.798492 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003aefa-a788-4d69-bd3e-9f771eeed55b admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:07.799415 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003aefa-a788-4d69-bd3e-9f771eeed55b admin admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:07.801129 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e003aefa-a788-4d69-bd3e-9f771eeed55b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:30:07.801575 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e003aefa-a788-4d69-bd3e-9f771eeed55b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:07.804067 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e003aefa-a788-4d69-bd3e-9f771eeed55b admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:07.840432 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 923/1834] 10.222.0.91 () {58 vars in 1153 bytes} [Tue Aug 30 04:30:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:30:07.848524 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e003aefa-a788-4d69-bd3e-9f771eeed55b admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:07.861539 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-879ec1da-c0a5-422f-966c-b1a169395b4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7625945f0dc74f4983112f71987903db'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:07.864477 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-879ec1da-c0a5-422f-966c-b1a169395b4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7625945f0dc74f4983112f71987903db'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:07.865957 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-879ec1da-c0a5-422f-966c-b1a169395b4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7625945f0dc74f4983112f71987903db'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:07.881073 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e003aefa-a788-4d69-bd3e-9f771eeed55b admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:07.882337 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:07.892667 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3dcaa4-98b1-440f-afdc-52652dd51b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:07.894264 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3dcaa4-98b1-440f-afdc-52652dd51b0c admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:07.894817 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3dcaa4-98b1-440f-afdc-52652dd51b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:07.895332 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3dcaa4-98b1-440f-afdc-52652dd51b0c admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:07.897767 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-879ec1da-c0a5-422f-966c-b1a169395b4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7625945f0dc74f4983112f71987903db'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:07.901361 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3dcaa4-98b1-440f-afdc-52652dd51b0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:07.930260 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3dcaa4-98b1-440f-afdc-52652dd51b0c admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:07.980549 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-879ec1da-c0a5-422f-966c-b1a169395b4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7625945f0dc74f4983112f71987903db'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:08.055514 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:08.062871 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 912/1835] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:30:07 2022] DELETE /identity/v3/users/7625945f0dc74f4983112f71987903db => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:30:08.073200 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7042b670-d441-4493-9dd9-cb6c49ca263a None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:08.078559 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7042b670-d441-4493-9dd9-cb6c49ca263a None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:08.079180 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7042b670-d441-4493-9dd9-cb6c49ca263a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:08.108375 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 924/1836] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:30:07 2022] POST /identity/v3/projects => generated 377 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:30:08.112237 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3dcaa4-98b1-440f-afdc-52652dd51b0c admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:08.123187 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-ac3dcaa4-98b1-440f-afdc-52652dd51b0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:08.201535 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-7042b670-d441-4493-9dd9-cb6c49ca263a None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:08.209916 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-7042b670-d441-4493-9dd9-cb6c49ca263a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:08.396200 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3dcaa4-98b1-440f-afdc-52652dd51b0c admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:08.412029 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3907125-a0f6-475a-80e2-d7a3b16ee867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:08.412561 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3907125-a0f6-475a-80e2-d7a3b16ee867 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:08.417058 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3907125-a0f6-475a-80e2-d7a3b16ee867 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:08.417385 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3907125-a0f6-475a-80e2-d7a3b16ee867 admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:08.420913 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3907125-a0f6-475a-80e2-d7a3b16ee867 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:08.429189 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3907125-a0f6-475a-80e2-d7a3b16ee867 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:08.437930 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 913/1837] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:30:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:08.499690 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7042b670-d441-4493-9dd9-cb6c49ca263a None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:08.504395 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 925/1838] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:30:08 2022] POST /identity/v3/users => generated 289 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:30:08.514702 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7042b670-d441-4493-9dd9-cb6c49ca263a None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:08.523021 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47db0825-5628-4e5f-9f68-a103c7643911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:08.523885 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db0825-5628-4e5f-9f68-a103c7643911 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:08.524343 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db0825-5628-4e5f-9f68-a103c7643911 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:08.524626 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db0825-5628-4e5f-9f68-a103c7643911 admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:08.525428 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47db0825-5628-4e5f-9f68-a103c7643911 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:08.527502 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47db0825-5628-4e5f-9f68-a103c7643911 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:08.532656 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3907125-a0f6-475a-80e2-d7a3b16ee867 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:08.535227 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-b3907125-a0f6-475a-80e2-d7a3b16ee867 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:08.555278 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3907125-a0f6-475a-80e2-d7a3b16ee867 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:08.560340 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 914/1839] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:30:08.564960 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47db0825-5628-4e5f-9f68-a103c7643911 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:08.567686 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c92c27c-817c-48a7-8618-5c17d6b66546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:08.569569 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92c27c-817c-48a7-8618-5c17d6b66546 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:08.570270 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92c27c-817c-48a7-8618-5c17d6b66546 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:08.571175 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92c27c-817c-48a7-8618-5c17d6b66546 admin admin] PATH_INFO: `/v3/users/8a8a9615082b47f4ab15127f21a7074e` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:08.576352 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c92c27c-817c-48a7-8618-5c17d6b66546 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a8a9615082b47f4ab15127f21a7074e)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:08.580388 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47db0825-5628-4e5f-9f68-a103c7643911 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:08.581087 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c92c27c-817c-48a7-8618-5c17d6b66546 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:08.591994 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbef1c8-bb7e-417c-ae0f-6f0a74c0cef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:08.592872 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbef1c8-bb7e-417c-ae0f-6f0a74c0cef3 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:08.594988 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbef1c8-bb7e-417c-ae0f-6f0a74c0cef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:08.595409 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbef1c8-bb7e-417c-ae0f-6f0a74c0cef3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:08.597373 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbef1c8-bb7e-417c-ae0f-6f0a74c0cef3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:08.600773 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbef1c8-bb7e-417c-ae0f-6f0a74c0cef3 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:08.628964 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 915/1840] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:30:08.632398 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbef1c8-bb7e-417c-ae0f-6f0a74c0cef3 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:08.634474 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-fbbef1c8-bb7e-417c-ae0f-6f0a74c0cef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:08.708305 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-0c92c27c-817c-48a7-8618-5c17d6b66546 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a8a9615082b47f4ab15127f21a7074e'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:08.726265 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-0c92c27c-817c-48a7-8618-5c17d6b66546 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a8a9615082b47f4ab15127f21a7074e'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:08.736944 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbef1c8-bb7e-417c-ae0f-6f0a74c0cef3 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:08.745035 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b909fd-b0b9-4d75-b8c7-c833fe29bc09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:08.747456 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b909fd-b0b9-4d75-b8c7-c833fe29bc09 service neutron] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:08.747456 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b909fd-b0b9-4d75-b8c7-c833fe29bc09 service neutron] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:08.748166 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b909fd-b0b9-4d75-b8c7-c833fe29bc09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:08.751606 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-0c92c27c-817c-48a7-8618-5c17d6b66546 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a8a9615082b47f4ab15127f21a7074e'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:08.753986 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-0c92c27c-817c-48a7-8618-5c17d6b66546 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a8a9615082b47f4ab15127f21a7074e'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:08.765234 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b909fd-b0b9-4d75-b8c7-c833fe29bc09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:08.769398 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b909fd-b0b9-4d75-b8c7-c833fe29bc09 service neutron] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:08.784171 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 916/1841] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:30:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:30:08.785694 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b909fd-b0b9-4d75-b8c7-c833fe29bc09 service neutron] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:08.790970 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-0c92c27c-817c-48a7-8618-5c17d6b66546 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a8a9615082b47f4ab15127f21a7074e'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:08.802214 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b909fd-b0b9-4d75-b8c7-c833fe29bc09 service neutron] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:08.819556 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 926/1842] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:30:08 2022] DELETE /identity/v3/users/8a8a9615082b47f4ab15127f21a7074e => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:30:08.823395 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c1e2fb-0eb9-4857-b646-b20b1755a87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:08.824225 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c1e2fb-0eb9-4857-b646-b20b1755a87b admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:08.824548 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c1e2fb-0eb9-4857-b646-b20b1755a87b admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:08.824828 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c1e2fb-0eb9-4857-b646-b20b1755a87b admin admin] PATH_INFO: `/v3/projects/bed39aec22484edbb93f01e30ff111a7/users/f72940749cb6402397e99deab5ce820d/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:08.826294 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81e202-2019-4e02-8a05-cf21d3fd30e5 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:08.827283 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81e202-2019-4e02-8a05-cf21d3fd30e5 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:08.835693 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81e202-2019-4e02-8a05-cf21d3fd30e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:08.855379 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c1e2fb-0eb9-4857-b646-b20b1755a87b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bed39aec22484edbb93f01e30ff111a7, user_id=f72940749cb6402397e99deab5ce820d, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:08.859484 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c1e2fb-0eb9-4857-b646-b20b1755a87b admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:08.899386 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 917/1843] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:30:08 2022] PUT /identity/v3/projects/bed39aec22484edbb93f01e30ff111a7/users/f72940749cb6402397e99deab5ce820d/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:08.901219 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecfbd8a-8f39-4c82-b3a2-64b48a3dae16 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:08.901585 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecfbd8a-8f39-4c82-b3a2-64b48a3dae16 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:08.901851 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecfbd8a-8f39-4c82-b3a2-64b48a3dae16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:08.912603 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-ee81e202-2019-4e02-8a05-cf21d3fd30e5 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:08.914938 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-ee81e202-2019-4e02-8a05-cf21d3fd30e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:08.975077 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-cecfbd8a-8f39-4c82-b3a2-64b48a3dae16 None None] MFA Rules not processed for user `f72940749cb6402397e99deab5ce820d`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:08.977427 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-cecfbd8a-8f39-4c82-b3a2-64b48a3dae16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:08.998954 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:09.086868 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:09.110659 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 918/1844] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:30:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:09.116351 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecfbd8a-8f39-4c82-b3a2-64b48a3dae16 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:09.119312 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 927/1845] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:30:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:09.119541 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-cecfbd8a-8f39-4c82-b3a2-64b48a3dae16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:09.123511 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81e202-2019-4e02-8a05-cf21d3fd30e5 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:09.126632 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-ee81e202-2019-4e02-8a05-cf21d3fd30e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:09.143891 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecfbd8a-8f39-4c82-b3a2-64b48a3dae16 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:09.151962 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4bd524-8333-431c-a8f9-b1f5c349ac0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:09.152791 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4bd524-8333-431c-a8f9-b1f5c349ac0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:09.153222 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4bd524-8333-431c-a8f9-b1f5c349ac0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:09.153569 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4bd524-8333-431c-a8f9-b1f5c349ac0b admin admin] PATH_INFO: `/v3/projects/ebfdb7619e4043eab6c03ea851c9931f` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:09.155148 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4bd524-8333-431c-a8f9-b1f5c349ac0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebfdb7619e4043eab6c03ea851c9931f)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:09.158049 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4bd524-8333-431c-a8f9-b1f5c349ac0b admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:09.173656 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81e202-2019-4e02-8a05-cf21d3fd30e5 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:09.184428 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcdd69d-d3cc-460b-b6b3-8dde550977af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:09.186147 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcdd69d-d3cc-460b-b6b3-8dde550977af admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:09.187064 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcdd69d-d3cc-460b-b6b3-8dde550977af admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:09.188201 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcdd69d-d3cc-460b-b6b3-8dde550977af admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:09.190604 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcdd69d-d3cc-460b-b6b3-8dde550977af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:09.196149 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcdd69d-d3cc-460b-b6b3-8dde550977af admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:09.269840 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-8b4bd524-8333-431c-a8f9-b1f5c349ac0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebfdb7619e4043eab6c03ea851c9931f', 'request_id': 'req-8b4bd524-8333-431c-a8f9-b1f5c349ac0b'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:09.302828 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-8b4bd524-8333-431c-a8f9-b1f5c349ac0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebfdb7619e4043eab6c03ea851c9931f', 'request_id': 'req-8b4bd524-8333-431c-a8f9-b1f5c349ac0b'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:09.324131 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 928/1846] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:30:09 2022] POST /identity/v3/projects => generated 377 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:30:09.329921 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-8b4bd524-8333-431c-a8f9-b1f5c349ac0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebfdb7619e4043eab6c03ea851c9931f', 'request_id': 'req-8b4bd524-8333-431c-a8f9-b1f5c349ac0b'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:09.340000 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcdd69d-d3cc-460b-b6b3-8dde550977af admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:09.346854 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-5dcdd69d-d3cc-460b-b6b3-8dde550977af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:09.351295 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-8b4bd524-8333-431c-a8f9-b1f5c349ac0b admin admin] The token cache is being invalidate because project ebfdb7619e4043eab6c03ea851c9931f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:30:09.351581 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-8b4bd524-8333-431c-a8f9-b1f5c349ac0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:09.355589 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-8b4bd524-8333-431c-a8f9-b1f5c349ac0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:09.365275 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 919/1847] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:30:09 2022] DELETE /identity/v3/projects/ebfdb7619e4043eab6c03ea851c9931f => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:09.367354 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4bd524-8333-431c-a8f9-b1f5c349ac0b admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:09.374923 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-8b4bd524-8333-431c-a8f9-b1f5c349ac0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:09.486257 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcdd69d-d3cc-460b-b6b3-8dde550977af admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:09.491720 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44114df6-87c8-44ed-820b-e39af6844e9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:09.492863 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44114df6-87c8-44ed-820b-e39af6844e9c service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:09.493136 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44114df6-87c8-44ed-820b-e39af6844e9c service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:09.493402 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44114df6-87c8-44ed-820b-e39af6844e9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:09.495634 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-44114df6-87c8-44ed-820b-e39af6844e9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:09.580349 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4bd524-8333-431c-a8f9-b1f5c349ac0b admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:09.625435 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44114df6-87c8-44ed-820b-e39af6844e9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:09.628407 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44114df6-87c8-44ed-820b-e39af6844e9c service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:09.659055 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 929/1848] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:30:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:30:09.661666 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e69024-0749-4a3b-9ec1-c6930d1a92e4 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:09.662116 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e69024-0749-4a3b-9ec1-c6930d1a92e4 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:09.662560 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e69024-0749-4a3b-9ec1-c6930d1a92e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:09.679392 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:09.717487 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-52e69024-0749-4a3b-9ec1-c6930d1a92e4 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:09.720296 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-52e69024-0749-4a3b-9ec1-c6930d1a92e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:09.732029 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fdb121-f3b4-4c14-9140-85b7d6dbfb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:09.733497 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fdb121-f3b4-4c14-9140-85b7d6dbfb9e admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:09.734288 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fdb121-f3b4-4c14-9140-85b7d6dbfb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:09.734948 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fdb121-f3b4-4c14-9140-85b7d6dbfb9e admin admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:09.737436 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 930/1849] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:30:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:09.738508 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fdb121-f3b4-4c14-9140-85b7d6dbfb9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:09.742946 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fdb121-f3b4-4c14-9140-85b7d6dbfb9e admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:09.746578 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c96d1-4d6a-4169-a8b6-22446fde64f1 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:09.747251 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c96d1-4d6a-4169-a8b6-22446fde64f1 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:09.748198 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c96d1-4d6a-4169-a8b6-22446fde64f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:09.800108 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-512c96d1-4d6a-4169-a8b6-22446fde64f1 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:09.803344 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-512c96d1-4d6a-4169-a8b6-22446fde64f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:09.808083 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 920/1850] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:30:09 2022] POST /identity/v3/users => generated 295 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:30:09.813127 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fdb121-f3b4-4c14-9140-85b7d6dbfb9e admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:09.837366 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fdb121-f3b4-4c14-9140-85b7d6dbfb9e admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:09.837693 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 931/1851] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:30:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:09.845232 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512c96d1-4d6a-4169-a8b6-22446fde64f1 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:09.867510 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803d656-890d-4944-83c6-7849618e9730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:09.868986 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512c96d1-4d6a-4169-a8b6-22446fde64f1 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:09.869416 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803d656-890d-4944-83c6-7849618e9730 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:09.870116 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803d656-890d-4944-83c6-7849618e9730 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:09.870809 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803d656-890d-4944-83c6-7849618e9730 admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:09.872279 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e803d656-890d-4944-83c6-7849618e9730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:09.879546 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e803d656-890d-4944-83c6-7849618e9730 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:09.882387 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8ca4b-a20d-450b-9582-fbdd1fc92343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:09.884916 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8ca4b-a20d-450b-9582-fbdd1fc92343 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:09.885740 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8ca4b-a20d-450b-9582-fbdd1fc92343 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:09.886380 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8ca4b-a20d-450b-9582-fbdd1fc92343 admin admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:09.887990 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf8ca4b-a20d-450b-9582-fbdd1fc92343 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:30:09.889073 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf8ca4b-a20d-450b-9582-fbdd1fc92343 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:09.895796 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf8ca4b-a20d-450b-9582-fbdd1fc92343 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:09.932353 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 921/1852] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:30:09.934688 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803d656-890d-4944-83c6-7849618e9730 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:09.962399 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803d656-890d-4944-83c6-7849618e9730 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:09.972580 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254dc17c-0225-4288-ac89-7ac01d0a794d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:09.975360 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254dc17c-0225-4288-ac89-7ac01d0a794d admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:09.976595 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254dc17c-0225-4288-ac89-7ac01d0a794d admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:09.977532 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254dc17c-0225-4288-ac89-7ac01d0a794d admin admin] PATH_INFO: `/v3/projects/62c7c09e14b84fc4a68daebb5ce86c74/users/f260536b8d2645f2a88fadbccca57a4f/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:10.008448 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 932/1853] 10.222.0.91 () {58 vars in 1153 bytes} [Tue Aug 30 04:30:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:30:10.014713 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8ca4b-a20d-450b-9582-fbdd1fc92343 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:10.021803 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254dc17c-0225-4288-ac89-7ac01d0a794d admin admin] RBAC: Authorizing `identity:create_grant(project_id=62c7c09e14b84fc4a68daebb5ce86c74, user_id=f260536b8d2645f2a88fadbccca57a4f, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:10.025654 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254dc17c-0225-4288-ac89-7ac01d0a794d admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:10.051710 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8ca4b-a20d-450b-9582-fbdd1fc92343 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:10.090053 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 922/1854] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:30:09 2022] PUT /identity/v3/projects/62c7c09e14b84fc4a68daebb5ce86c74/users/f260536b8d2645f2a88fadbccca57a4f/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:10.097802 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254dc17c-0225-4288-ac89-7ac01d0a794d admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:10.229627 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23442dc-4c79-4135-a346-28d60e13a79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:10.230993 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23442dc-4c79-4135-a346-28d60e13a79b admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:10.231460 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23442dc-4c79-4135-a346-28d60e13a79b admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:10.232093 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23442dc-4c79-4135-a346-28d60e13a79b admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:10.234348 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23442dc-4c79-4135-a346-28d60e13a79b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:10.241858 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23442dc-4c79-4135-a346-28d60e13a79b admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:10.266284 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:10.288348 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254dc17c-0225-4288-ac89-7ac01d0a794d admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:10.305113 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cede731-a1c6-4b00-b826-7eefbb167dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:10.306407 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cede731-a1c6-4b00-b826-7eefbb167dcf admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:10.307035 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cede731-a1c6-4b00-b826-7eefbb167dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:10.307706 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cede731-a1c6-4b00-b826-7eefbb167dcf admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:10.309109 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cede731-a1c6-4b00-b826-7eefbb167dcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:10.313216 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cede731-a1c6-4b00-b826-7eefbb167dcf admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:10.349930 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 923/1855] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:30:10 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:30:10.352973 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cede731-a1c6-4b00-b826-7eefbb167dcf admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:10.369416 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 933/1856] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:30:10 2022] POST /identity/v3/projects => generated 385 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:30:10.370438 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23442dc-4c79-4135-a346-28d60e13a79b admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:10.385383 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cede731-a1c6-4b00-b826-7eefbb167dcf admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:10.515756 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23442dc-4c79-4135-a346-28d60e13a79b admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:10.525662 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf0b5a1-e9cc-4b71-b5dc-ee15af5dd8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:10.527981 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf0b5a1-e9cc-4b71-b5dc-ee15af5dd8d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:10.528826 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf0b5a1-e9cc-4b71-b5dc-ee15af5dd8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:10.530289 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf0b5a1-e9cc-4b71-b5dc-ee15af5dd8d4 admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:10.532420 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf0b5a1-e9cc-4b71-b5dc-ee15af5dd8d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:10.538599 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf0b5a1-e9cc-4b71-b5dc-ee15af5dd8d4 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:10.558274 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566480db-3db9-4112-af19-5d6f89811fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:10.559340 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566480db-3db9-4112-af19-5d6f89811fd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:10.559777 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566480db-3db9-4112-af19-5d6f89811fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:10.560335 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566480db-3db9-4112-af19-5d6f89811fd5 admin admin] PATH_INFO: `/v3/projects/62c7c09e14b84fc4a68daebb5ce86c74/users/f260536b8d2645f2a88fadbccca57a4f/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:10.563501 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566480db-3db9-4112-af19-5d6f89811fd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62c7c09e14b84fc4a68daebb5ce86c74, user_id=f260536b8d2645f2a88fadbccca57a4f, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:10.569625 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566480db-3db9-4112-af19-5d6f89811fd5 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:10.611951 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 934/1858] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:30:10 2022] POST /identity/v3/users => generated 293 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:30:10.611951 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf0b5a1-e9cc-4b71-b5dc-ee15af5dd8d4 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:10.615671 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 924/1858] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:30:10 2022] PUT /identity/v3/projects/62c7c09e14b84fc4a68daebb5ce86c74/users/f260536b8d2645f2a88fadbccca57a4f/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:10.619807 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3373c709-18da-4ba6-a092-19afe85cc985 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:10.620636 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3373c709-18da-4ba6-a092-19afe85cc985 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:10.621521 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3373c709-18da-4ba6-a092-19afe85cc985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:10.632550 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf0b5a1-e9cc-4b71-b5dc-ee15af5dd8d4 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:10.669767 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-3373c709-18da-4ba6-a092-19afe85cc985 None None] MFA Rules not processed for user `f260536b8d2645f2a88fadbccca57a4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:10.671387 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-3373c709-18da-4ba6-a092-19afe85cc985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:10.720847 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:10.859677 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 925/1859] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:30:10 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:10.885286 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61e97a1-e85d-43ef-9f2d-8b22d4c42f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:10.887013 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e97a1-e85d-43ef-9f2d-8b22d4c42f7c admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:10.891585 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3373c709-18da-4ba6-a092-19afe85cc985 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:10.891857 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e97a1-e85d-43ef-9f2d-8b22d4c42f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:10.892461 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e97a1-e85d-43ef-9f2d-8b22d4c42f7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:10.893858 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-3373c709-18da-4ba6-a092-19afe85cc985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:10.896227 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61e97a1-e85d-43ef-9f2d-8b22d4c42f7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:10.902717 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61e97a1-e85d-43ef-9f2d-8b22d4c42f7c admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:10.957912 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 935/1860] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:30:10 2022] GET /identity/v3/roles => generated 1420 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:30:10.960792 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61e97a1-e85d-43ef-9f2d-8b22d4c42f7c admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:11.008400 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61e97a1-e85d-43ef-9f2d-8b22d4c42f7c admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:11.030621 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5422b0-4dff-4f74-88f9-14436e513a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:11.031812 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5422b0-4dff-4f74-88f9-14436e513a8a admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:11.034569 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5422b0-4dff-4f74-88f9-14436e513a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:11.035309 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5422b0-4dff-4f74-88f9-14436e513a8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:11.041299 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5422b0-4dff-4f74-88f9-14436e513a8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:11.048544 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5422b0-4dff-4f74-88f9-14436e513a8a admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:11.097328 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 936/1861] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:30:10 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:30:11.112342 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3373c709-18da-4ba6-a092-19afe85cc985 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:11.116395 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5422b0-4dff-4f74-88f9-14436e513a8a admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:11.122647 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca9881-574f-4fa5-aa4b-5d158e7c202c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:11.124369 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca9881-574f-4fa5-aa4b-5d158e7c202c service cinder] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:11.125367 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca9881-574f-4fa5-aa4b-5d158e7c202c service cinder] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:11.126147 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca9881-574f-4fa5-aa4b-5d158e7c202c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:11.150683 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ca9881-574f-4fa5-aa4b-5d158e7c202c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:11.154028 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ca9881-574f-4fa5-aa4b-5d158e7c202c service cinder] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:11.174634 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5422b0-4dff-4f74-88f9-14436e513a8a admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:11.181952 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 926/1862] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:30:10 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:30:11.213242 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d0d573-76ac-4970-a7e1-5a74bf13bc1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:11.214478 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0d573-76ac-4970-a7e1-5a74bf13bc1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:11.217763 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0d573-76ac-4970-a7e1-5a74bf13bc1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:11.218356 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0d573-76ac-4970-a7e1-5a74bf13bc1c admin admin] PATH_INFO: `/v3/projects/6947817f514143a78261bdbc5906926b/users/24fecd14bad846acbf4231c2f055b8f0/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:11.332877 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d0d573-76ac-4970-a7e1-5a74bf13bc1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6947817f514143a78261bdbc5906926b, user_id=24fecd14bad846acbf4231c2f055b8f0, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:11.347518 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d0d573-76ac-4970-a7e1-5a74bf13bc1c admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:11.422232 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 937/1863] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:30:11 2022] PUT /identity/v3/projects/6947817f514143a78261bdbc5906926b/users/24fecd14bad846acbf4231c2f055b8f0/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:11.447627 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a5f52-82f5-4ab1-8b70-fb1613135b66 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:11.448385 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a5f52-82f5-4ab1-8b70-fb1613135b66 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:11.448960 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a5f52-82f5-4ab1-8b70-fb1613135b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:11.464993 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d0d573-76ac-4970-a7e1-5a74bf13bc1c admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:11.627018 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-002a5f52-82f5-4ab1-8b70-fb1613135b66 None None] MFA Rules not processed for user `24fecd14bad846acbf4231c2f055b8f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:11.629954 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-002a5f52-82f5-4ab1-8b70-fb1613135b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:11.692024 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:11.747680 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d0d573-76ac-4970-a7e1-5a74bf13bc1c admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:11.764329 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dae32d-1e2b-41c8-902a-3b1441bb2309 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:11.765024 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dae32d-1e2b-41c8-902a-3b1441bb2309 service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:11.765281 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dae32d-1e2b-41c8-902a-3b1441bb2309 service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:11.766786 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dae32d-1e2b-41c8-902a-3b1441bb2309 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:11.771251 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-32dae32d-1e2b-41c8-902a-3b1441bb2309 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:11.878125 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dae32d-1e2b-41c8-902a-3b1441bb2309 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:11.886707 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dae32d-1e2b-41c8-902a-3b1441bb2309 service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:11.901253 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 927/1864] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:30:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 456 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:11.912305 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a5f52-82f5-4ab1-8b70-fb1613135b66 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:11.913084 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 938/1865] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:30:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:30:11.915368 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-002a5f52-82f5-4ab1-8b70-fb1613135b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:11.964822 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a5f52-82f5-4ab1-8b70-fb1613135b66 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:11.983619 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9781a1bc-f11e-42b9-a823-dc5a1ca104f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:11.986516 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9781a1bc-f11e-42b9-a823-dc5a1ca104f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:11.989381 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9781a1bc-f11e-42b9-a823-dc5a1ca104f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:11.989871 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9781a1bc-f11e-42b9-a823-dc5a1ca104f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:12.041896 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9781a1bc-f11e-42b9-a823-dc5a1ca104f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:12.051654 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9781a1bc-f11e-42b9-a823-dc5a1ca104f6 service cinder] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:12.120124 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 928/1866] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:30:11 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:30:12.168978 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dae32d-1e2b-41c8-902a-3b1441bb2309 service cinder] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:12.172356 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-32dae32d-1e2b-41c8-902a-3b1441bb2309 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:12.353235 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dae32d-1e2b-41c8-902a-3b1441bb2309 service cinder] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:12.359254 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f38c77-8f3b-47f5-b1f3-12244a1845dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:12.360019 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f38c77-8f3b-47f5-b1f3-12244a1845dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:12.360323 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f38c77-8f3b-47f5-b1f3-12244a1845dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:12.360568 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f38c77-8f3b-47f5-b1f3-12244a1845dc admin admin] PATH_INFO: `/v3/projects/efd4c3b962d74138a4ea48f6b7f0ec3f` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:12.362071 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f38c77-8f3b-47f5-b1f3-12244a1845dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=efd4c3b962d74138a4ea48f6b7f0ec3f)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:12.378275 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f38c77-8f3b-47f5-b1f3-12244a1845dc admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:12.485840 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99e428-f6fd-4cdb-b42b-5902d4fa3f06 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:12.486453 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99e428-f6fd-4cdb-b42b-5902d4fa3f06 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:12.486660 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99e428-f6fd-4cdb-b42b-5902d4fa3f06 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:12.490273 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 929/1867] 10.222.0.91 () {54 vars in 921 bytes} [Tue Aug 30 04:30:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:30:12.520919 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a8345-8170-4096-8f6c-140d09c51563 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:12.521146 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-c8f38c77-8f3b-47f5-b1f3-12244a1845dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efd4c3b962d74138a4ea48f6b7f0ec3f', 'request_id': 'req-c8f38c77-8f3b-47f5-b1f3-12244a1845dc'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:12.521515 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a8345-8170-4096-8f6c-140d09c51563 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:12.521909 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a8345-8170-4096-8f6c-140d09c51563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:12.534596 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-c8f38c77-8f3b-47f5-b1f3-12244a1845dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efd4c3b962d74138a4ea48f6b7f0ec3f', 'request_id': 'req-c8f38c77-8f3b-47f5-b1f3-12244a1845dc'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:12.554662 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-c8f38c77-8f3b-47f5-b1f3-12244a1845dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efd4c3b962d74138a4ea48f6b7f0ec3f', 'request_id': 'req-c8f38c77-8f3b-47f5-b1f3-12244a1845dc'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:12.573400 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-2c0a8345-8170-4096-8f6c-140d09c51563 None None] MFA Rules not processed for user `d806295278ae4997b5c6968aa553290c`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:12.576626 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-2c0a8345-8170-4096-8f6c-140d09c51563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:12.586730 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-c8f38c77-8f3b-47f5-b1f3-12244a1845dc admin admin] The token cache is being invalidate because project efd4c3b962d74138a4ea48f6b7f0ec3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:30:12.587955 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-c8f38c77-8f3b-47f5-b1f3-12244a1845dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:12.589461 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-c8f38c77-8f3b-47f5-b1f3-12244a1845dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:12.602574 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 939/1868] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:30:12 2022] DELETE /identity/v3/projects/efd4c3b962d74138a4ea48f6b7f0ec3f => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:30:12.608671 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f38c77-8f3b-47f5-b1f3-12244a1845dc admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:12.611204 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-c8f38c77-8f3b-47f5-b1f3-12244a1845dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:12.668737 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:12.729869 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:12.769558 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 930/1869] 10.222.0.91 () {58 vars in 1018 bytes} [Tue Aug 30 04:30:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:12.799550 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a8345-8170-4096-8f6c-140d09c51563 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:12.802244 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-2c0a8345-8170-4096-8f6c-140d09c51563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:12.857693 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a8345-8170-4096-8f6c-140d09c51563 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:12.891390 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a6e728-1837-4d73-a019-865d5a6e3121 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd806295278ae4997b5c6968aa553290c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:12.892125 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a6e728-1837-4d73-a019-865d5a6e3121 service nova] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:12.892662 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a6e728-1837-4d73-a019-865d5a6e3121 service nova] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:12.892980 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a6e728-1837-4d73-a019-865d5a6e3121 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:12.906456 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a6e728-1837-4d73-a019-865d5a6e3121 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:12.908217 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a6e728-1837-4d73-a019-865d5a6e3121 service nova] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:12.938538 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f38c77-8f3b-47f5-b1f3-12244a1845dc admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:12.943281 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 931/1870] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:30:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:30:12.945746 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a6e728-1837-4d73-a019-865d5a6e3121 service nova] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:12.949417 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-90a6e728-1837-4d73-a019-865d5a6e3121 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:12.957401 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5107ddd-d15f-433b-b54e-5706dc429af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:12.961285 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5107ddd-d15f-433b-b54e-5706dc429af9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:12.961865 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5107ddd-d15f-433b-b54e-5706dc429af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:12.965979 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5107ddd-d15f-433b-b54e-5706dc429af9 admin admin] PATH_INFO: `/v3/users/090324081a1f424089f7f8747c753189` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:12.968533 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5107ddd-d15f-433b-b54e-5706dc429af9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=090324081a1f424089f7f8747c753189)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:12.978722 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5107ddd-d15f-433b-b54e-5706dc429af9 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:12.985547 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a6e728-1837-4d73-a019-865d5a6e3121 service nova] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:12.997061 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f304658-84f6-4cb7-a971-4f342999bada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:13.005192 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f304658-84f6-4cb7-a971-4f342999bada admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:13.005490 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f304658-84f6-4cb7-a971-4f342999bada admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:13.005773 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f304658-84f6-4cb7-a971-4f342999bada admin admin] PATH_INFO: `/v3/projects/194e4fb98c89450eab94a9df2b9a99a5` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:13.016903 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f304658-84f6-4cb7-a971-4f342999bada admin admin] RBAC: Authorizing `identity:delete_project(project_id=194e4fb98c89450eab94a9df2b9a99a5)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:13.018904 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f304658-84f6-4cb7-a971-4f342999bada admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:13.155702 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-9f304658-84f6-4cb7-a971-4f342999bada admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '194e4fb98c89450eab94a9df2b9a99a5', 'request_id': 'req-9f304658-84f6-4cb7-a971-4f342999bada'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:13.159978 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-e5107ddd-d15f-433b-b54e-5706dc429af9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '090324081a1f424089f7f8747c753189'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:13.170418 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-9f304658-84f6-4cb7-a971-4f342999bada admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '194e4fb98c89450eab94a9df2b9a99a5', 'request_id': 'req-9f304658-84f6-4cb7-a971-4f342999bada'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:13.191137 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-9f304658-84f6-4cb7-a971-4f342999bada admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '194e4fb98c89450eab94a9df2b9a99a5', 'request_id': 'req-9f304658-84f6-4cb7-a971-4f342999bada'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:13.192990 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-e5107ddd-d15f-433b-b54e-5706dc429af9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '090324081a1f424089f7f8747c753189'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:13.217192 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-e5107ddd-d15f-433b-b54e-5706dc429af9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '090324081a1f424089f7f8747c753189'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:13.220551 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-e5107ddd-d15f-433b-b54e-5706dc429af9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '090324081a1f424089f7f8747c753189'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:13.251617 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-9f304658-84f6-4cb7-a971-4f342999bada admin admin] The token cache is being invalidate because project 194e4fb98c89450eab94a9df2b9a99a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:30:13.255220 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-9f304658-84f6-4cb7-a971-4f342999bada admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:13.260496 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-9f304658-84f6-4cb7-a971-4f342999bada admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:13.269174 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 932/1871] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:30:12 2022] DELETE /identity/v3/projects/194e4fb98c89450eab94a9df2b9a99a5 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:13.277805 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80669afe-3f64-481b-b81e-f37b3f8cdf87 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:13.278757 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80669afe-3f64-481b-b81e-f37b3f8cdf87 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:13.279479 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80669afe-3f64-481b-b81e-f37b3f8cdf87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:13.294045 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-e5107ddd-d15f-433b-b54e-5706dc429af9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '090324081a1f424089f7f8747c753189'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:13.328021 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 940/1872] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:30:12 2022] DELETE /identity/v3/users/090324081a1f424089f7f8747c753189 => generated 0 bytes in 720 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:30:13.373196 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-80669afe-3f64-481b-b81e-f37b3f8cdf87 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:13.380389 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-80669afe-3f64-481b-b81e-f37b3f8cdf87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:13.682392 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 933/1873] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:30:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:13.686461 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c064d5-8746-428f-8265-7cb4f7add779 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:13.686966 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c064d5-8746-428f-8265-7cb4f7add779 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:13.687459 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c064d5-8746-428f-8265-7cb4f7add779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:13.816595 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-d9c064d5-8746-428f-8265-7cb4f7add779 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:13.819326 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-d9c064d5-8746-428f-8265-7cb4f7add779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:13.920319 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 941/1874] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:30:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:13.921849 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80669afe-3f64-481b-b81e-f37b3f8cdf87 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:13.963348 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80669afe-3f64-481b-b81e-f37b3f8cdf87 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:14.000276 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5432081-5e0d-4a83-9fa2-8100caee456e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:14.004585 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5432081-5e0d-4a83-9fa2-8100caee456e admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:14.004983 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5432081-5e0d-4a83-9fa2-8100caee456e admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:14.008328 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5432081-5e0d-4a83-9fa2-8100caee456e admin admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:14.009841 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5432081-5e0d-4a83-9fa2-8100caee456e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:30:14.013793 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5432081-5e0d-4a83-9fa2-8100caee456e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:14.027021 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5432081-5e0d-4a83-9fa2-8100caee456e admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:14.163690 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 934/1875] 10.222.0.91 () {58 vars in 1153 bytes} [Tue Aug 30 04:30:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:30:14.170152 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c064d5-8746-428f-8265-7cb4f7add779 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:14.186432 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c064d5-8746-428f-8265-7cb4f7add779 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:14.202435 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca65902-ddfa-4ae9-bef7-49ed113ca801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:14.203240 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca65902-ddfa-4ae9-bef7-49ed113ca801 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:14.203522 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca65902-ddfa-4ae9-bef7-49ed113ca801 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:14.203795 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca65902-ddfa-4ae9-bef7-49ed113ca801 admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:14.204488 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca65902-ddfa-4ae9-bef7-49ed113ca801 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:14.208152 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca65902-ddfa-4ae9-bef7-49ed113ca801 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:14.304690 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 942/1876] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:30:14 2022] POST /identity/v3/projects => generated 377 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:30:14.310253 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5432081-5e0d-4a83-9fa2-8100caee456e admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:14.330230 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5432081-5e0d-4a83-9fa2-8100caee456e admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:14.442536 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:14.603963 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576bbd2b-e150-4de3-a6ed-38a0def3b75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:14.606934 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576bbd2b-e150-4de3-a6ed-38a0def3b75b admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:14.607250 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576bbd2b-e150-4de3-a6ed-38a0def3b75b admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:14.607501 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576bbd2b-e150-4de3-a6ed-38a0def3b75b admin admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:14.613186 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576bbd2b-e150-4de3-a6ed-38a0def3b75b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:14.619621 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576bbd2b-e150-4de3-a6ed-38a0def3b75b admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:14.717675 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 935/1877] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:30:14 2022] POST /identity/v3/users => generated 289 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:30:14.724882 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca65902-ddfa-4ae9-bef7-49ed113ca801 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:14.750983 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca65902-ddfa-4ae9-bef7-49ed113ca801 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:14.794355 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19359dd7-6eb8-45a7-b6b6-0d9b265bca93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:14.795468 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19359dd7-6eb8-45a7-b6b6-0d9b265bca93 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:14.796287 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19359dd7-6eb8-45a7-b6b6-0d9b265bca93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:14.797103 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19359dd7-6eb8-45a7-b6b6-0d9b265bca93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:14.798520 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19359dd7-6eb8-45a7-b6b6-0d9b265bca93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:14.802642 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19359dd7-6eb8-45a7-b6b6-0d9b265bca93 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:14.830712 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 943/1878] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:30:14 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:30:14.838095 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576bbd2b-e150-4de3-a6ed-38a0def3b75b admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:14.855683 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576bbd2b-e150-4de3-a6ed-38a0def3b75b admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:14.864990 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6a6aa9-8fe2-4171-8193-3e04a402c5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:14.866368 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a6aa9-8fe2-4171-8193-3e04a402c5db admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:14.867069 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a6aa9-8fe2-4171-8193-3e04a402c5db admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:14.867661 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a6aa9-8fe2-4171-8193-3e04a402c5db admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:14.869037 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6a6aa9-8fe2-4171-8193-3e04a402c5db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:14.872798 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6a6aa9-8fe2-4171-8193-3e04a402c5db admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:14.903100 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 936/1879] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:30:14 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:30:14.904893 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19359dd7-6eb8-45a7-b6b6-0d9b265bca93 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:14.931085 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19359dd7-6eb8-45a7-b6b6-0d9b265bca93 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:14.937285 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e0550-8ef4-48fc-b22a-7752b48bb45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:14.938376 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e0550-8ef4-48fc-b22a-7752b48bb45b admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:14.939037 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e0550-8ef4-48fc-b22a-7752b48bb45b admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:14.939787 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e0550-8ef4-48fc-b22a-7752b48bb45b admin admin] PATH_INFO: `/v3/projects/697f493ce42f402ba41103eb0699f61f/users/e73d1396de4c48c1ba0f4bafbe665f80/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:14.964162 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152e0550-8ef4-48fc-b22a-7752b48bb45b admin admin] RBAC: Authorizing `identity:create_grant(project_id=697f493ce42f402ba41103eb0699f61f, user_id=e73d1396de4c48c1ba0f4bafbe665f80, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:14.968075 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152e0550-8ef4-48fc-b22a-7752b48bb45b admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:14.999456 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 944/1880] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:30:14 2022] PUT /identity/v3/projects/697f493ce42f402ba41103eb0699f61f/users/e73d1396de4c48c1ba0f4bafbe665f80/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:30:15.022994 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a659665c-de5a-479b-ae6b-8d60d04a3a4b None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:15.023809 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a659665c-de5a-479b-ae6b-8d60d04a3a4b None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:15.024394 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a659665c-de5a-479b-ae6b-8d60d04a3a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:15.085962 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-a659665c-de5a-479b-ae6b-8d60d04a3a4b None None] MFA Rules not processed for user `e73d1396de4c48c1ba0f4bafbe665f80`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:15.087603 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-a659665c-de5a-479b-ae6b-8d60d04a3a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:15.241077 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 937/1881] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:30:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:15.263890 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e0550-8ef4-48fc-b22a-7752b48bb45b admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:15.268756 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-152e0550-8ef4-48fc-b22a-7752b48bb45b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:15.371331 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:15.461703 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e0550-8ef4-48fc-b22a-7752b48bb45b admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:15.470369 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c9d6f-46b6-462c-8471-6d9fe3e9f8fb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2e1344bc54bf388e5ec025ab94c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:15.472047 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c9d6f-46b6-462c-8471-6d9fe3e9f8fb service glance] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:15.473064 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c9d6f-46b6-462c-8471-6d9fe3e9f8fb service glance] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:15.473762 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c9d6f-46b6-462c-8471-6d9fe3e9f8fb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:15.501964 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34c9d6f-46b6-462c-8471-6d9fe3e9f8fb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:15.507401 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34c9d6f-46b6-462c-8471-6d9fe3e9f8fb service glance] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:15.536013 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 945/1882] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:30:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:30:15.955199 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a659665c-de5a-479b-ae6b-8d60d04a3a4b None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:15.958036 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-a659665c-de5a-479b-ae6b-8d60d04a3a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:16.031886 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c9d6f-46b6-462c-8471-6d9fe3e9f8fb service glance] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:16.040714 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-c34c9d6f-46b6-462c-8471-6d9fe3e9f8fb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:16.284189 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c9d6f-46b6-462c-8471-6d9fe3e9f8fb service glance] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:16.297615 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f7851c-3a43-4cad-9373-2665da54a163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:16.297979 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a659665c-de5a-479b-ae6b-8d60d04a3a4b None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:16.299621 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7851c-3a43-4cad-9373-2665da54a163 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:16.300826 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7851c-3a43-4cad-9373-2665da54a163 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:16.301797 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7851c-3a43-4cad-9373-2665da54a163 admin admin] PATH_INFO: `/v3/users/24fecd14bad846acbf4231c2f055b8f0` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:16.305006 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f7851c-3a43-4cad-9373-2665da54a163 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24fecd14bad846acbf4231c2f055b8f0)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:16.312706 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f7851c-3a43-4cad-9373-2665da54a163 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:16.316169 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020edad2-f517-4127-babf-67fe0a762647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:16.317310 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020edad2-f517-4127-babf-67fe0a762647 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:16.317816 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020edad2-f517-4127-babf-67fe0a762647 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:16.318297 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020edad2-f517-4127-babf-67fe0a762647 admin admin] PATH_INFO: `/v3/projects/f300f3c364d54d0a8c74bbff0e7da4f6` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:16.321722 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020edad2-f517-4127-babf-67fe0a762647 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f300f3c364d54d0a8c74bbff0e7da4f6)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:16.330353 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020edad2-f517-4127-babf-67fe0a762647 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:16.538576 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:16.539422 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-b5f7851c-3a43-4cad-9373-2665da54a163 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24fecd14bad846acbf4231c2f055b8f0'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:16.583721 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-b5f7851c-3a43-4cad-9373-2665da54a163 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24fecd14bad846acbf4231c2f055b8f0'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:16.620550 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-020edad2-f517-4127-babf-67fe0a762647 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f300f3c364d54d0a8c74bbff0e7da4f6', 'request_id': 'req-020edad2-f517-4127-babf-67fe0a762647'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:16.632755 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-b5f7851c-3a43-4cad-9373-2665da54a163 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24fecd14bad846acbf4231c2f055b8f0'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:16.639617 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-b5f7851c-3a43-4cad-9373-2665da54a163 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24fecd14bad846acbf4231c2f055b8f0'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:16.673881 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-020edad2-f517-4127-babf-67fe0a762647 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f300f3c364d54d0a8c74bbff0e7da4f6', 'request_id': 'req-020edad2-f517-4127-babf-67fe0a762647'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:16.705665 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-020edad2-f517-4127-babf-67fe0a762647 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f300f3c364d54d0a8c74bbff0e7da4f6', 'request_id': 'req-020edad2-f517-4127-babf-67fe0a762647'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:16.733182 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-b5f7851c-3a43-4cad-9373-2665da54a163 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24fecd14bad846acbf4231c2f055b8f0'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:16.736858 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-020edad2-f517-4127-babf-67fe0a762647 admin admin] The token cache is being invalidate because project f300f3c364d54d0a8c74bbff0e7da4f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:30:16.737342 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-020edad2-f517-4127-babf-67fe0a762647 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:16.764657 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-020edad2-f517-4127-babf-67fe0a762647 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:16.782968 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 938/1883] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:30:15 2022] DELETE /identity/v3/projects/f300f3c364d54d0a8c74bbff0e7da4f6 => generated 0 bytes in 823 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:16.791418 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 946/1884] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:30:16 2022] DELETE /identity/v3/users/24fecd14bad846acbf4231c2f055b8f0 => generated 0 bytes in 755 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:16.791686 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c84114-2609-4e42-ae01-ad2719584c88 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:16.791686 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c84114-2609-4e42-ae01-ad2719584c88 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:16.793846 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c84114-2609-4e42-ae01-ad2719584c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:16.794065 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1c1a6-afda-4590-a0ad-4001abe6382b None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:16.809977 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1c1a6-afda-4590-a0ad-4001abe6382b None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:16.810566 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1c1a6-afda-4590-a0ad-4001abe6382b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:16.919462 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-77c84114-2609-4e42-ae01-ad2719584c88 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:16.922265 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-77c84114-2609-4e42-ae01-ad2719584c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:16.953940 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-bef1c1a6-afda-4590-a0ad-4001abe6382b None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:16.956183 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-bef1c1a6-afda-4590-a0ad-4001abe6382b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:17.109428 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:17.183026 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 947/1885] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:30:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:17.226624 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 939/1886] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:30:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:30:17.228293 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0064a-1026-4aad-a4d2-7e0bfef6c3f4 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:17.228809 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0064a-1026-4aad-a4d2-7e0bfef6c3f4 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:17.229245 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0064a-1026-4aad-a4d2-7e0bfef6c3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:17.274624 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-dcf0064a-1026-4aad-a4d2-7e0bfef6c3f4 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:17.277883 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-dcf0064a-1026-4aad-a4d2-7e0bfef6c3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:17.307697 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 948/1887] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:30:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:30:17.314569 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c84114-2609-4e42-ae01-ad2719584c88 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:17.347565 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c84114-2609-4e42-ae01-ad2719584c88 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:17.358174 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470f5e95-d7a8-4390-9b30-50b226603cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:17.359235 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f5e95-d7a8-4390-9b30-50b226603cc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:17.359700 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f5e95-d7a8-4390-9b30-50b226603cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:17.360201 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f5e95-d7a8-4390-9b30-50b226603cc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:17.361524 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470f5e95-d7a8-4390-9b30-50b226603cc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:30:17.362011 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470f5e95-d7a8-4390-9b30-50b226603cc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:17.366714 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470f5e95-d7a8-4390-9b30-50b226603cc2 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:17.415456 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf0064a-1026-4aad-a4d2-7e0bfef6c3f4 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:17.422765 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 940/1888] 10.222.0.91 () {58 vars in 1153 bytes} [Tue Aug 30 04:30:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:30:17.432178 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf0064a-1026-4aad-a4d2-7e0bfef6c3f4 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:17.440811 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287afc6b-fc4b-451e-b600-640ad00830cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:17.442159 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287afc6b-fc4b-451e-b600-640ad00830cf admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:17.442546 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287afc6b-fc4b-451e-b600-640ad00830cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:17.443018 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287afc6b-fc4b-451e-b600-640ad00830cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:17.444294 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287afc6b-fc4b-451e-b600-640ad00830cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:17.448365 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287afc6b-fc4b-451e-b600-640ad00830cf admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:17.542656 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470f5e95-d7a8-4390-9b30-50b226603cc2 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:17.557859 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 949/1889] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:30:17 2022] POST /identity/v3/projects => generated 381 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:30:17.569304 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470f5e95-d7a8-4390-9b30-50b226603cc2 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:17.683586 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287afc6b-fc4b-451e-b600-640ad00830cf admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:17.686136 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-287afc6b-fc4b-451e-b600-640ad00830cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:17.693642 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e3fd46-6949-4ea7-9684-42ce7dd216ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:17.697242 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e3fd46-6949-4ea7-9684-42ce7dd216ef admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:17.697791 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e3fd46-6949-4ea7-9684-42ce7dd216ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:17.698276 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e3fd46-6949-4ea7-9684-42ce7dd216ef admin admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:17.699570 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e3fd46-6949-4ea7-9684-42ce7dd216ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:17.703475 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e3fd46-6949-4ea7-9684-42ce7dd216ef admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:17.759702 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 941/1890] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:30:17 2022] POST /identity/v3/users => generated 291 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:30:17.761473 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e3fd46-6949-4ea7-9684-42ce7dd216ef admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:17.781175 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e3fd46-6949-4ea7-9684-42ce7dd216ef admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:17.792936 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c6e6f-7448-41cb-af65-91e56574fcf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:17.794995 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c6e6f-7448-41cb-af65-91e56574fcf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:17.794995 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c6e6f-7448-41cb-af65-91e56574fcf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:17.795334 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c6e6f-7448-41cb-af65-91e56574fcf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:17.796601 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509c6e6f-7448-41cb-af65-91e56574fcf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:17.799808 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509c6e6f-7448-41cb-af65-91e56574fcf3 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:17.815244 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287afc6b-fc4b-451e-b600-640ad00830cf admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:17.819677 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a97277-54b8-4513-9eae-2275da2653e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:17.820381 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a97277-54b8-4513-9eae-2275da2653e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:17.820656 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a97277-54b8-4513-9eae-2275da2653e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:17.821085 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a97277-54b8-4513-9eae-2275da2653e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:17.837122 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a97277-54b8-4513-9eae-2275da2653e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:17.838683 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a97277-54b8-4513-9eae-2275da2653e7 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:17.845999 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 942/1891] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:30:17 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:30:17.847608 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c6e6f-7448-41cb-af65-91e56574fcf3 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:17.859031 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 950/1892] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:30:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:30:17.874379 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c6e6f-7448-41cb-af65-91e56574fcf3 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:17.886150 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7757fb9-d49d-40b6-8eab-109d853ec639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:17.888437 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7757fb9-d49d-40b6-8eab-109d853ec639 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:17.888813 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7757fb9-d49d-40b6-8eab-109d853ec639 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:17.889250 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7757fb9-d49d-40b6-8eab-109d853ec639 admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:17.890378 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7757fb9-d49d-40b6-8eab-109d853ec639 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:17.891855 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7757fb9-d49d-40b6-8eab-109d853ec639 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:17.912040 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 943/1893] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:30:17 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:30:17.913281 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a97277-54b8-4513-9eae-2275da2653e7 service neutron] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:17.925726 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a97277-54b8-4513-9eae-2275da2653e7 service neutron] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:17.933118 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baeaf6d-43e3-4579-a488-09f37d311490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:17.934241 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baeaf6d-43e3-4579-a488-09f37d311490 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:17.934808 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baeaf6d-43e3-4579-a488-09f37d311490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:17.935871 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baeaf6d-43e3-4579-a488-09f37d311490 admin admin] PATH_INFO: `/v3/projects/f992de5cce41465092ee3d3a7499db53/users/6071e25a817c47c69924a09d231ffd1a/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:17.958608 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baeaf6d-43e3-4579-a488-09f37d311490 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f992de5cce41465092ee3d3a7499db53, user_id=6071e25a817c47c69924a09d231ffd1a, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:17.962071 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baeaf6d-43e3-4579-a488-09f37d311490 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:17.997597 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 951/1894] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:30:17 2022] PUT /identity/v3/projects/f992de5cce41465092ee3d3a7499db53/users/6071e25a817c47c69924a09d231ffd1a/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:18.021009 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b450a27-0685-488d-9e10-0de9875a1767 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:18.021458 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b450a27-0685-488d-9e10-0de9875a1767 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:18.022039 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b450a27-0685-488d-9e10-0de9875a1767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:18.168335 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-4b450a27-0685-488d-9e10-0de9875a1767 None None] MFA Rules not processed for user `6071e25a817c47c69924a09d231ffd1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:18.170536 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-4b450a27-0685-488d-9e10-0de9875a1767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:18.196173 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:18.381369 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 944/1895] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:30:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:18.383847 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baeaf6d-43e3-4579-a488-09f37d311490 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:18.556068 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baeaf6d-43e3-4579-a488-09f37d311490 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:18.564293 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9089a6-365d-412f-b8a6-feabcee148f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:18.565838 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9089a6-365d-412f-b8a6-feabcee148f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:18.566442 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9089a6-365d-412f-b8a6-feabcee148f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:18.567016 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9089a6-365d-412f-b8a6-feabcee148f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:18.568380 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9089a6-365d-412f-b8a6-feabcee148f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:18.573406 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9089a6-365d-412f-b8a6-feabcee148f4 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:18.665106 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b450a27-0685-488d-9e10-0de9875a1767 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:18.678502 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 952/1896] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:30:18 2022] POST /identity/v3/projects => generated 379 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:30:18.694552 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b450a27-0685-488d-9e10-0de9875a1767 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:18.876131 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b3f6a9-0bdb-4c68-a662-3856993552ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:18.877933 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3f6a9-0bdb-4c68-a662-3856993552ac admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:18.878401 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3f6a9-0bdb-4c68-a662-3856993552ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:18.878939 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3f6a9-0bdb-4c68-a662-3856993552ac admin admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:18.881654 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b3f6a9-0bdb-4c68-a662-3856993552ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:18.888390 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b3f6a9-0bdb-4c68-a662-3856993552ac admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:18.941030 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 945/1897] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:30:18 2022] POST /identity/v3/users => generated 296 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:30:18.947196 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9089a6-365d-412f-b8a6-feabcee148f4 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:18.964082 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9089a6-365d-412f-b8a6-feabcee148f4 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:18.970698 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048a0362-cc5b-4143-86ff-ca3b1516e6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:18.971434 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a0362-cc5b-4143-86ff-ca3b1516e6b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:18.971827 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a0362-cc5b-4143-86ff-ca3b1516e6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:18.974521 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a0362-cc5b-4143-86ff-ca3b1516e6b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:18.975659 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048a0362-cc5b-4143-86ff-ca3b1516e6b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:18.978692 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048a0362-cc5b-4143-86ff-ca3b1516e6b0 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:19.005983 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b3f6a9-0bdb-4c68-a662-3856993552ac admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:19.007852 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 953/1898] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:30:19.031133 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b3f6a9-0bdb-4c68-a662-3856993552ac admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:19.040393 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2adb26-02fa-4eb9-af88-a156f62bf709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:19.041472 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2adb26-02fa-4eb9-af88-a156f62bf709 admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:19.042162 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2adb26-02fa-4eb9-af88-a156f62bf709 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:19.042642 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2adb26-02fa-4eb9-af88-a156f62bf709 admin admin] PATH_INFO: `/v3/projects/aa2ca91af4594d89ac483d528f22cf20/users/c8cbf962b64e4232b789aadbc361968f/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:19.080108 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2adb26-02fa-4eb9-af88-a156f62bf709 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa2ca91af4594d89ac483d528f22cf20, user_id=c8cbf962b64e4232b789aadbc361968f, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:19.086178 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2adb26-02fa-4eb9-af88-a156f62bf709 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:19.119236 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048a0362-cc5b-4143-86ff-ca3b1516e6b0 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:19.123820 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-048a0362-cc5b-4143-86ff-ca3b1516e6b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:19.128179 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 946/1899] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:30:19 2022] PUT /identity/v3/projects/aa2ca91af4594d89ac483d528f22cf20/users/c8cbf962b64e4232b789aadbc361968f/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:30:19.141851 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2adb26-02fa-4eb9-af88-a156f62bf709 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:19.164562 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:19.182437 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048a0362-cc5b-4143-86ff-ca3b1516e6b0 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:19.398155 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ee5b9-0f41-4a99-84a1-768c8a99cea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:19.399195 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ee5b9-0f41-4a99-84a1-768c8a99cea7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:19.399717 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ee5b9-0f41-4a99-84a1-768c8a99cea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:19.400207 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ee5b9-0f41-4a99-84a1-768c8a99cea7 admin admin] PATH_INFO: `/v3/projects/6947817f514143a78261bdbc5906926b` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:19.402500 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068ee5b9-0f41-4a99-84a1-768c8a99cea7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6947817f514143a78261bdbc5906926b)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:19.403426 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2adb26-02fa-4eb9-af88-a156f62bf709 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:19.419327 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068ee5b9-0f41-4a99-84a1-768c8a99cea7 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:19.433503 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848912b4-97fb-4bc7-9920-47abfaf433aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:19.438350 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848912b4-97fb-4bc7-9920-47abfaf433aa admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:19.438817 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848912b4-97fb-4bc7-9920-47abfaf433aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:19.440229 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848912b4-97fb-4bc7-9920-47abfaf433aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:19.441550 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848912b4-97fb-4bc7-9920-47abfaf433aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:19.464635 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848912b4-97fb-4bc7-9920-47abfaf433aa admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:19.481436 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 947/1900] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:30:19 2022] GET /identity/v3/roles => generated 1420 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:30:19.486296 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848912b4-97fb-4bc7-9920-47abfaf433aa admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:19.503737 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848912b4-97fb-4bc7-9920-47abfaf433aa admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:19.515067 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7357cc3-da24-4e6b-97d9-824ee07b4d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:19.517007 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7357cc3-da24-4e6b-97d9-824ee07b4d01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:19.517514 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7357cc3-da24-4e6b-97d9-824ee07b4d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:19.518015 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7357cc3-da24-4e6b-97d9-824ee07b4d01 admin admin] PATH_INFO: `/v3/projects/aa2ca91af4594d89ac483d528f22cf20/users/c8cbf962b64e4232b789aadbc361968f/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:19.523987 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7357cc3-da24-4e6b-97d9-824ee07b4d01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa2ca91af4594d89ac483d528f22cf20, user_id=c8cbf962b64e4232b789aadbc361968f, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:19.531815 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7357cc3-da24-4e6b-97d9-824ee07b4d01 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:19.540209 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:19.571998 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 948/1901] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:30:19 2022] PUT /identity/v3/projects/aa2ca91af4594d89ac483d528f22cf20/users/c8cbf962b64e4232b789aadbc361968f/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:30:19.592367 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10965a98-2393-465a-bfca-af8844c5ac82 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:19.594098 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10965a98-2393-465a-bfca-af8844c5ac82 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:19.594434 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10965a98-2393-465a-bfca-af8844c5ac82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:19.662905 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-068ee5b9-0f41-4a99-84a1-768c8a99cea7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6947817f514143a78261bdbc5906926b', 'request_id': 'req-068ee5b9-0f41-4a99-84a1-768c8a99cea7'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:19.671496 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-068ee5b9-0f41-4a99-84a1-768c8a99cea7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6947817f514143a78261bdbc5906926b', 'request_id': 'req-068ee5b9-0f41-4a99-84a1-768c8a99cea7'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:19.689811 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-068ee5b9-0f41-4a99-84a1-768c8a99cea7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6947817f514143a78261bdbc5906926b', 'request_id': 'req-068ee5b9-0f41-4a99-84a1-768c8a99cea7'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:19.695726 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-10965a98-2393-465a-bfca-af8844c5ac82 None None] MFA Rules not processed for user `c8cbf962b64e4232b789aadbc361968f`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:19.697090 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-10965a98-2393-465a-bfca-af8844c5ac82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:19.717646 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-068ee5b9-0f41-4a99-84a1-768c8a99cea7 admin admin] The token cache is being invalidate because project 6947817f514143a78261bdbc5906926b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:30:19.718106 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-068ee5b9-0f41-4a99-84a1-768c8a99cea7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:19.719633 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-068ee5b9-0f41-4a99-84a1-768c8a99cea7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:19.721733 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 954/1902] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:30:19 2022] DELETE /identity/v3/projects/6947817f514143a78261bdbc5906926b => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:30:19.729576 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95bdf4-78d7-49c0-97ae-05bdf908cdff None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:19.730810 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95bdf4-78d7-49c0-97ae-05bdf908cdff None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:19.731655 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95bdf4-78d7-49c0-97ae-05bdf908cdff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:19.806452 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 949/1903] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:30:19 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:30:19.825137 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-4a95bdf4-78d7-49c0-97ae-05bdf908cdff None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:19.828633 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-4a95bdf4-78d7-49c0-97ae-05bdf908cdff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:19.837174 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10965a98-2393-465a-bfca-af8844c5ac82 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:19.838939 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-10965a98-2393-465a-bfca-af8844c5ac82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:19.946405 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10965a98-2393-465a-bfca-af8844c5ac82 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:19.953112 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91affc88-06f6-4de9-9590-3000b0411ce5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:19.953768 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91affc88-06f6-4de9-9590-3000b0411ce5 service cinder] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:19.954041 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91affc88-06f6-4de9-9590-3000b0411ce5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:19.954309 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91affc88-06f6-4de9-9590-3000b0411ce5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:19.971041 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91affc88-06f6-4de9-9590-3000b0411ce5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:19.973730 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91affc88-06f6-4de9-9590-3000b0411ce5 service cinder] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:19.986114 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 950/1904] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:30:19 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:30:20.004056 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 955/1905] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:30:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:20.015048 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d98e67-1ea7-4233-9b2f-6a82674a92bd None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:20.015048 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d98e67-1ea7-4233-9b2f-6a82674a92bd None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:20.015636 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d98e67-1ea7-4233-9b2f-6a82674a92bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:20.084875 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-79d98e67-1ea7-4233-9b2f-6a82674a92bd None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:20.088476 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-79d98e67-1ea7-4233-9b2f-6a82674a92bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:20.112695 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 951/1906] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:30:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:20.118059 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a95bdf4-78d7-49c0-97ae-05bdf908cdff None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:20.137966 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a95bdf4-78d7-49c0-97ae-05bdf908cdff None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:20.143733 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b18e19c-0227-44a5-a487-8c7698d99691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:20.144692 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18e19c-0227-44a5-a487-8c7698d99691 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:20.144969 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18e19c-0227-44a5-a487-8c7698d99691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:20.145237 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18e19c-0227-44a5-a487-8c7698d99691 admin admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:20.145930 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b18e19c-0227-44a5-a487-8c7698d99691 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:30:20.146213 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b18e19c-0227-44a5-a487-8c7698d99691 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:20.147897 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b18e19c-0227-44a5-a487-8c7698d99691 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:20.169900 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 956/1907] 10.222.0.91 () {58 vars in 1153 bytes} [Tue Aug 30 04:30:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:30:20.176499 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d98e67-1ea7-4233-9b2f-6a82674a92bd None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:20.201580 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d98e67-1ea7-4233-9b2f-6a82674a92bd None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:20.217679 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b4c653-ce82-481b-8628-f19b7cd522f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:20.218799 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4c653-ce82-481b-8628-f19b7cd522f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:20.219299 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4c653-ce82-481b-8628-f19b7cd522f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:20.219792 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4c653-ce82-481b-8628-f19b7cd522f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:20.224924 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b4c653-ce82-481b-8628-f19b7cd522f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:20.243800 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b4c653-ce82-481b-8628-f19b7cd522f5 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:20.320116 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 952/1908] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:30:20 2022] POST /identity/v3/projects => generated 373 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:30:20.325254 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b18e19c-0227-44a5-a487-8c7698d99691 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:20.343395 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b18e19c-0227-44a5-a487-8c7698d99691 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:20.399380 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:20.632435 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d8a15-f501-4493-8e31-d9c2784cbdb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:20.634801 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d8a15-f501-4493-8e31-d9c2784cbdb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:20.637400 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d8a15-f501-4493-8e31-d9c2784cbdb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:20.644762 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d8a15-f501-4493-8e31-d9c2784cbdb0 admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:20.652254 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733d8a15-f501-4493-8e31-d9c2784cbdb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:20.657859 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733d8a15-f501-4493-8e31-d9c2784cbdb0 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:20.737799 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 957/1909] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:30:20 2022] POST /identity/v3/users => generated 287 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:30:20.743235 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b4c653-ce82-481b-8628-f19b7cd522f5 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:20.778802 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b4c653-ce82-481b-8628-f19b7cd522f5 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:20.785295 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4854c49f-cf85-496f-b509-e58f6db121af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:20.786915 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854c49f-cf85-496f-b509-e58f6db121af admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:20.787397 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854c49f-cf85-496f-b509-e58f6db121af admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:20.787848 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854c49f-cf85-496f-b509-e58f6db121af admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:20.789533 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4854c49f-cf85-496f-b509-e58f6db121af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:20.791938 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4854c49f-cf85-496f-b509-e58f6db121af admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:20.807338 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 953/1910] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:30:20 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:30:20.812987 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d8a15-f501-4493-8e31-d9c2784cbdb0 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:20.827063 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d8a15-f501-4493-8e31-d9c2784cbdb0 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:20.840941 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4719047-75ae-4bd5-bf46-f71b14e88432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:20.841587 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4719047-75ae-4bd5-bf46-f71b14e88432 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:20.841870 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4719047-75ae-4bd5-bf46-f71b14e88432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:20.842252 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4719047-75ae-4bd5-bf46-f71b14e88432 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:20.842945 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4719047-75ae-4bd5-bf46-f71b14e88432 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:20.845467 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4719047-75ae-4bd5-bf46-f71b14e88432 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:20.876103 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 958/1911] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:30:20 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:30:20.881101 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4854c49f-cf85-496f-b509-e58f6db121af admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:20.895429 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4854c49f-cf85-496f-b509-e58f6db121af admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:20.902425 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af07dbb-b1c4-4013-809c-931f1497cab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:20.904149 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af07dbb-b1c4-4013-809c-931f1497cab9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:20.904149 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af07dbb-b1c4-4013-809c-931f1497cab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:20.904149 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af07dbb-b1c4-4013-809c-931f1497cab9 admin admin] PATH_INFO: `/v3/projects/92b93bd6951d461ba2f6586f3566699d/users/0ad11e9c9afd47f2833edac5f0b83c61/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:20.928884 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af07dbb-b1c4-4013-809c-931f1497cab9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92b93bd6951d461ba2f6586f3566699d, user_id=0ad11e9c9afd47f2833edac5f0b83c61, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:20.932543 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af07dbb-b1c4-4013-809c-931f1497cab9 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:20.957361 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 954/1912] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:30:20 2022] PUT /identity/v3/projects/92b93bd6951d461ba2f6586f3566699d/users/0ad11e9c9afd47f2833edac5f0b83c61/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:20.969613 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306addb8-247f-41e5-80ca-e1bc14382ecb None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:20.969993 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306addb8-247f-41e5-80ca-e1bc14382ecb None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:20.970453 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306addb8-247f-41e5-80ca-e1bc14382ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:21.021978 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-306addb8-247f-41e5-80ca-e1bc14382ecb None None] MFA Rules not processed for user `0ad11e9c9afd47f2833edac5f0b83c61`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:21.022883 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-306addb8-247f-41e5-80ca-e1bc14382ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:21.173697 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 959/1913] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:30:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:21.193882 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af07dbb-b1c4-4013-809c-931f1497cab9 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:21.195193 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306addb8-247f-41e5-80ca-e1bc14382ecb None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:21.259320 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:21.311755 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306addb8-247f-41e5-80ca-e1bc14382ecb None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:21.326963 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd32de6-cea3-4136-8bb1-458d561120ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:21.328074 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd32de6-cea3-4136-8bb1-458d561120ee service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:21.328548 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd32de6-cea3-4136-8bb1-458d561120ee service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:21.329007 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd32de6-cea3-4136-8bb1-458d561120ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:21.350437 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd32de6-cea3-4136-8bb1-458d561120ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:21.351617 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd32de6-cea3-4136-8bb1-458d561120ee service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:21.371197 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 960/1914] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:30:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:30:21.385493 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af07dbb-b1c4-4013-809c-931f1497cab9 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:21.392407 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb838c14-f04c-4309-b546-2a51c45a598c tempest-VolumeQuotaClassesTest-528064916 tempest-VolumeQuotaClassesTest-528064916-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8cbf962b64e4232b789aadbc361968f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa2ca91af4594d89ac483d528f22cf20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:21.393065 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb838c14-f04c-4309-b546-2a51c45a598c tempest-VolumeQuotaClassesTest-528064916 tempest-VolumeQuotaClassesTest-528064916-project-admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:21.393352 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb838c14-f04c-4309-b546-2a51c45a598c tempest-VolumeQuotaClassesTest-528064916 tempest-VolumeQuotaClassesTest-528064916-project-admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:21.393788 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb838c14-f04c-4309-b546-2a51c45a598c tempest-VolumeQuotaClassesTest-528064916 tempest-VolumeQuotaClassesTest-528064916-project-admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:21.394945 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb838c14-f04c-4309-b546-2a51c45a598c tempest-VolumeQuotaClassesTest-528064916 tempest-VolumeQuotaClassesTest-528064916-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:30:21.395222 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb838c14-f04c-4309-b546-2a51c45a598c tempest-VolumeQuotaClassesTest-528064916 tempest-VolumeQuotaClassesTest-528064916-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:21.397881 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb838c14-f04c-4309-b546-2a51c45a598c tempest-VolumeQuotaClassesTest-528064916 tempest-VolumeQuotaClassesTest-528064916-project-admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:21.415882 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 955/1915] 10.222.0.91 () {58 vars in 1153 bytes} [Tue Aug 30 04:30:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:30:21.421354 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd32de6-cea3-4136-8bb1-458d561120ee service cinder] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:21.444761 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd32de6-cea3-4136-8bb1-458d561120ee service cinder] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:21.449905 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d2617-07d2-49a6-8470-40d6fa4edb3b tempest-VolumeQuotaClassesTest-528064916 tempest-VolumeQuotaClassesTest-528064916-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8cbf962b64e4232b789aadbc361968f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa2ca91af4594d89ac483d528f22cf20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:21.450672 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d2617-07d2-49a6-8470-40d6fa4edb3b tempest-VolumeQuotaClassesTest-528064916 tempest-VolumeQuotaClassesTest-528064916-project-admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:21.451211 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d2617-07d2-49a6-8470-40d6fa4edb3b tempest-VolumeQuotaClassesTest-528064916 tempest-VolumeQuotaClassesTest-528064916-project-admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:21.451560 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d2617-07d2-49a6-8470-40d6fa4edb3b tempest-VolumeQuotaClassesTest-528064916 tempest-VolumeQuotaClassesTest-528064916-project-admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:21.452350 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875d2617-07d2-49a6-8470-40d6fa4edb3b tempest-VolumeQuotaClassesTest-528064916 tempest-VolumeQuotaClassesTest-528064916-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:21.454991 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875d2617-07d2-49a6-8470-40d6fa4edb3b tempest-VolumeQuotaClassesTest-528064916 tempest-VolumeQuotaClassesTest-528064916-project-admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:21.505961 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 961/1916] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:30:21 2022] POST /identity/v3/projects => generated 354 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:30:21.512199 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb838c14-f04c-4309-b546-2a51c45a598c tempest-VolumeQuotaClassesTest-528064916 tempest-VolumeQuotaClassesTest-528064916-project-admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:21.545170 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb838c14-f04c-4309-b546-2a51c45a598c tempest-VolumeQuotaClassesTest-528064916 tempest-VolumeQuotaClassesTest-528064916-project-admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:21.650180 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96603ce3-32f8-4b28-a25f-946493e15293 tempest-VolumeQuotaClassesTest-528064916 tempest-VolumeQuotaClassesTest-528064916-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8cbf962b64e4232b789aadbc361968f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa2ca91af4594d89ac483d528f22cf20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:21.654594 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96603ce3-32f8-4b28-a25f-946493e15293 tempest-VolumeQuotaClassesTest-528064916 tempest-VolumeQuotaClassesTest-528064916-project-admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:21.655162 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96603ce3-32f8-4b28-a25f-946493e15293 tempest-VolumeQuotaClassesTest-528064916 tempest-VolumeQuotaClassesTest-528064916-project-admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:21.655654 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96603ce3-32f8-4b28-a25f-946493e15293 tempest-VolumeQuotaClassesTest-528064916 tempest-VolumeQuotaClassesTest-528064916-project-admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:21.657873 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96603ce3-32f8-4b28-a25f-946493e15293 tempest-VolumeQuotaClassesTest-528064916 tempest-VolumeQuotaClassesTest-528064916-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:30:21.658358 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96603ce3-32f8-4b28-a25f-946493e15293 tempest-VolumeQuotaClassesTest-528064916 tempest-VolumeQuotaClassesTest-528064916-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:21.661131 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96603ce3-32f8-4b28-a25f-946493e15293 tempest-VolumeQuotaClassesTest-528064916 tempest-VolumeQuotaClassesTest-528064916-project-admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:21.688055 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 956/1917] 10.222.0.91 () {58 vars in 1153 bytes} [Tue Aug 30 04:30:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:30:21.761220 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d2617-07d2-49a6-8470-40d6fa4edb3b tempest-VolumeQuotaClassesTest-528064916 tempest-VolumeQuotaClassesTest-528064916-project-admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:21.783336 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d2617-07d2-49a6-8470-40d6fa4edb3b tempest-VolumeQuotaClassesTest-528064916 tempest-VolumeQuotaClassesTest-528064916-project-admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:21.792002 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989b9d1-bd9c-456c-a4e2-8a760a9c42be tempest-VolumeQuotaClassesTest-528064916 tempest-VolumeQuotaClassesTest-528064916-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8cbf962b64e4232b789aadbc361968f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa2ca91af4594d89ac483d528f22cf20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:21.792707 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989b9d1-bd9c-456c-a4e2-8a760a9c42be tempest-VolumeQuotaClassesTest-528064916 tempest-VolumeQuotaClassesTest-528064916-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:21.792973 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989b9d1-bd9c-456c-a4e2-8a760a9c42be tempest-VolumeQuotaClassesTest-528064916 tempest-VolumeQuotaClassesTest-528064916-project-admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:21.793269 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989b9d1-bd9c-456c-a4e2-8a760a9c42be tempest-VolumeQuotaClassesTest-528064916 tempest-VolumeQuotaClassesTest-528064916-project-admin] PATH_INFO: `/v3/projects/30415d9123604f2e95a054619d59519c` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:21.794942 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e989b9d1-bd9c-456c-a4e2-8a760a9c42be tempest-VolumeQuotaClassesTest-528064916 tempest-VolumeQuotaClassesTest-528064916-project-admin] RBAC: Authorizing `identity:delete_project(project_id=30415d9123604f2e95a054619d59519c)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:21.797061 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e989b9d1-bd9c-456c-a4e2-8a760a9c42be tempest-VolumeQuotaClassesTest-528064916 tempest-VolumeQuotaClassesTest-528064916-project-admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:21.807563 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:21.895249 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-e989b9d1-bd9c-456c-a4e2-8a760a9c42be tempest-VolumeQuotaClassesTest-528064916 tempest-VolumeQuotaClassesTest-528064916-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30415d9123604f2e95a054619d59519c', 'request_id': 'req-e989b9d1-bd9c-456c-a4e2-8a760a9c42be'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:21.916042 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-e989b9d1-bd9c-456c-a4e2-8a760a9c42be tempest-VolumeQuotaClassesTest-528064916 tempest-VolumeQuotaClassesTest-528064916-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30415d9123604f2e95a054619d59519c', 'request_id': 'req-e989b9d1-bd9c-456c-a4e2-8a760a9c42be'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:21.924975 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-e989b9d1-bd9c-456c-a4e2-8a760a9c42be tempest-VolumeQuotaClassesTest-528064916 tempest-VolumeQuotaClassesTest-528064916-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30415d9123604f2e95a054619d59519c', 'request_id': 'req-e989b9d1-bd9c-456c-a4e2-8a760a9c42be'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:21.975595 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-e989b9d1-bd9c-456c-a4e2-8a760a9c42be tempest-VolumeQuotaClassesTest-528064916 tempest-VolumeQuotaClassesTest-528064916-project-admin] The token cache is being invalidate because project 30415d9123604f2e95a054619d59519c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:30:21.977581 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-e989b9d1-bd9c-456c-a4e2-8a760a9c42be tempest-VolumeQuotaClassesTest-528064916 tempest-VolumeQuotaClassesTest-528064916-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:21.979586 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-e989b9d1-bd9c-456c-a4e2-8a760a9c42be tempest-VolumeQuotaClassesTest-528064916 tempest-VolumeQuotaClassesTest-528064916-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:22.000485 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 962/1918] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:30:21 2022] DELETE /identity/v3/projects/30415d9123604f2e95a054619d59519c => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:22.493237 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96603ce3-32f8-4b28-a25f-946493e15293 tempest-VolumeQuotaClassesTest-528064916 tempest-VolumeQuotaClassesTest-528064916-project-admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:22.496619 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-96603ce3-32f8-4b28-a25f-946493e15293 tempest-VolumeQuotaClassesTest-528064916 tempest-VolumeQuotaClassesTest-528064916-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:22.529863 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989b9d1-bd9c-456c-a4e2-8a760a9c42be tempest-VolumeQuotaClassesTest-528064916 tempest-VolumeQuotaClassesTest-528064916-project-admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:22.531728 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-e989b9d1-bd9c-456c-a4e2-8a760a9c42be tempest-VolumeQuotaClassesTest-528064916 tempest-VolumeQuotaClassesTest-528064916-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:22.628289 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96603ce3-32f8-4b28-a25f-946493e15293 tempest-VolumeQuotaClassesTest-528064916 tempest-VolumeQuotaClassesTest-528064916-project-admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:22.642759 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989b9d1-bd9c-456c-a4e2-8a760a9c42be tempest-VolumeQuotaClassesTest-528064916 tempest-VolumeQuotaClassesTest-528064916-project-admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:22.655093 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe4b21-98e3-434c-bcbe-b42c1c67cfc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:22.655669 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08391c5-a41a-48c2-90c0-06b6c9894fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:22.656101 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe4b21-98e3-434c-bcbe-b42c1c67cfc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:22.656337 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe4b21-98e3-434c-bcbe-b42c1c67cfc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:22.656617 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe4b21-98e3-434c-bcbe-b42c1c67cfc3 admin admin] PATH_INFO: `/v3/users/f72940749cb6402397e99deab5ce820d` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:22.656927 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08391c5-a41a-48c2-90c0-06b6c9894fbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:22.657465 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08391c5-a41a-48c2-90c0-06b6c9894fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:22.657944 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08391c5-a41a-48c2-90c0-06b6c9894fbd admin admin] PATH_INFO: `/v3/users/6071e25a817c47c69924a09d231ffd1a` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:22.659298 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefe4b21-98e3-434c-bcbe-b42c1c67cfc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f72940749cb6402397e99deab5ce820d)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:22.660191 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08391c5-a41a-48c2-90c0-06b6c9894fbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=6071e25a817c47c69924a09d231ffd1a)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:22.663478 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefe4b21-98e3-434c-bcbe-b42c1c67cfc3 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:22.664805 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08391c5-a41a-48c2-90c0-06b6c9894fbd admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:22.740570 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-c08391c5-a41a-48c2-90c0-06b6c9894fbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6071e25a817c47c69924a09d231ffd1a'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:22.753044 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-c08391c5-a41a-48c2-90c0-06b6c9894fbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6071e25a817c47c69924a09d231ffd1a'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:22.764392 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-fefe4b21-98e3-434c-bcbe-b42c1c67cfc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f72940749cb6402397e99deab5ce820d'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:22.764656 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-c08391c5-a41a-48c2-90c0-06b6c9894fbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6071e25a817c47c69924a09d231ffd1a'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:22.765103 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-fefe4b21-98e3-434c-bcbe-b42c1c67cfc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f72940749cb6402397e99deab5ce820d'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:22.765218 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-c08391c5-a41a-48c2-90c0-06b6c9894fbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6071e25a817c47c69924a09d231ffd1a'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:22.765767 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-fefe4b21-98e3-434c-bcbe-b42c1c67cfc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f72940749cb6402397e99deab5ce820d'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:22.769157 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:22.781063 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-fefe4b21-98e3-434c-bcbe-b42c1c67cfc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f72940749cb6402397e99deab5ce820d'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:22.794114 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-c08391c5-a41a-48c2-90c0-06b6c9894fbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6071e25a817c47c69924a09d231ffd1a'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:22.802346 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 963/1919] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:30:22 2022] DELETE /identity/v3/users/6071e25a817c47c69924a09d231ffd1a => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:22.803719 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-fefe4b21-98e3-434c-bcbe-b42c1c67cfc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f72940749cb6402397e99deab5ce820d'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:22.807324 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff96778-6cff-4d79-ae94-eda711ea616c None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:22.807628 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff96778-6cff-4d79-ae94-eda711ea616c None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:22.807862 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff96778-6cff-4d79-ae94-eda711ea616c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:22.822051 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 957/1920] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:30:22 2022] DELETE /identity/v3/users/f72940749cb6402397e99deab5ce820d => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:30:22.827605 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3069f-02ba-4853-9d4f-515d4589d501 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:22.828054 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3069f-02ba-4853-9d4f-515d4589d501 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:22.828496 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3069f-02ba-4853-9d4f-515d4589d501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:22.833647 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-4ff96778-6cff-4d79-ae94-eda711ea616c None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:22.835168 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-4ff96778-6cff-4d79-ae94-eda711ea616c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:22.846896 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:22.852379 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-6fd3069f-02ba-4853-9d4f-515d4589d501 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:22.853674 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-6fd3069f-02ba-4853-9d4f-515d4589d501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:22.924878 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 964/1921] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:30:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:30:22.936610 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff96778-6cff-4d79-ae94-eda711ea616c None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:22.938372 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-4ff96778-6cff-4d79-ae94-eda711ea616c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:22.941829 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 958/1922] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:30:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:30:22.956504 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd3069f-02ba-4853-9d4f-515d4589d501 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:22.959062 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-6fd3069f-02ba-4853-9d4f-515d4589d501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:23.030931 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff96778-6cff-4d79-ae94-eda711ea616c None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:23.035320 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a7b0e-4caa-4706-9723-a1fefec0aa91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:23.035648 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd3069f-02ba-4853-9d4f-515d4589d501 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:23.036181 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a7b0e-4caa-4706-9723-a1fefec0aa91 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:23.036922 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a7b0e-4caa-4706-9723-a1fefec0aa91 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:23.037204 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a7b0e-4caa-4706-9723-a1fefec0aa91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:23.041507 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89475e7d-c518-46c3-b009-eaa705a43170 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:23.042154 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89475e7d-c518-46c3-b009-eaa705a43170 service neutron] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:23.042432 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89475e7d-c518-46c3-b009-eaa705a43170 service neutron] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:23.042708 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89475e7d-c518-46c3-b009-eaa705a43170 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:23.048124 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181a7b0e-4caa-4706-9723-a1fefec0aa91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:23.049682 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181a7b0e-4caa-4706-9723-a1fefec0aa91 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:23.055398 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89475e7d-c518-46c3-b009-eaa705a43170 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:23.057041 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89475e7d-c518-46c3-b009-eaa705a43170 service neutron] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:23.061181 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 965/1923] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:30:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:30:23.071835 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 959/1924] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:30:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:30:23.283560 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47719711-4336-49a5-8bbc-97843bb19716 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:23.284504 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47719711-4336-49a5-8bbc-97843bb19716 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:23.285075 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47719711-4336-49a5-8bbc-97843bb19716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:23.338195 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-47719711-4336-49a5-8bbc-97843bb19716 None None] MFA Rules not processed for user `0ad11e9c9afd47f2833edac5f0b83c61`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:23.342534 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-47719711-4336-49a5-8bbc-97843bb19716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:23.512501 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 966/1925] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:30:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:23.979541 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89475e7d-c518-46c3-b009-eaa705a43170 service neutron] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:23.981572 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-89475e7d-c518-46c3-b009-eaa705a43170 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:24.038724 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89475e7d-c518-46c3-b009-eaa705a43170 service neutron] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:24.052322 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ea445-76f5-4580-9ed9-acd218489b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:24.054328 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ea445-76f5-4580-9ed9-acd218489b43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:24.055083 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ea445-76f5-4580-9ed9-acd218489b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:24.055715 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ea445-76f5-4580-9ed9-acd218489b43 admin admin] PATH_INFO: `/v3/projects/f992de5cce41465092ee3d3a7499db53` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:24.058043 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078ea445-76f5-4580-9ed9-acd218489b43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f992de5cce41465092ee3d3a7499db53)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:24.060979 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078ea445-76f5-4580-9ed9-acd218489b43 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:24.160111 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-078ea445-76f5-4580-9ed9-acd218489b43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f992de5cce41465092ee3d3a7499db53', 'request_id': 'req-078ea445-76f5-4580-9ed9-acd218489b43'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:24.175007 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-078ea445-76f5-4580-9ed9-acd218489b43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f992de5cce41465092ee3d3a7499db53', 'request_id': 'req-078ea445-76f5-4580-9ed9-acd218489b43'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:24.195243 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-078ea445-76f5-4580-9ed9-acd218489b43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f992de5cce41465092ee3d3a7499db53', 'request_id': 'req-078ea445-76f5-4580-9ed9-acd218489b43'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:24.203610 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:24.225838 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-078ea445-76f5-4580-9ed9-acd218489b43 admin admin] The token cache is being invalidate because project f992de5cce41465092ee3d3a7499db53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:30:24.227571 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-078ea445-76f5-4580-9ed9-acd218489b43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:24.232481 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-078ea445-76f5-4580-9ed9-acd218489b43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:24.237960 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 960/1926] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:30:23 2022] DELETE /identity/v3/projects/f992de5cce41465092ee3d3a7499db53 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:24.243826 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47719711-4336-49a5-8bbc-97843bb19716 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:24.275038 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47719711-4336-49a5-8bbc-97843bb19716 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:24.389056 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ea445-76f5-4580-9ed9-acd218489b43 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:24.391555 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-078ea445-76f5-4580-9ed9-acd218489b43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:24.454209 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3730cb5b-011d-4d02-99ba-09d6f3521cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:24.456058 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730cb5b-011d-4d02-99ba-09d6f3521cdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:24.457074 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730cb5b-011d-4d02-99ba-09d6f3521cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:24.458250 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730cb5b-011d-4d02-99ba-09d6f3521cdf admin admin] PATH_INFO: `/v3/users/c8cbf962b64e4232b789aadbc361968f` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:24.461777 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3730cb5b-011d-4d02-99ba-09d6f3521cdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8cbf962b64e4232b789aadbc361968f)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:24.484284 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3730cb5b-011d-4d02-99ba-09d6f3521cdf admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:24.491719 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:24.556826 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ea445-76f5-4580-9ed9-acd218489b43 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:24.571117 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3013292-7135-4ae4-96e6-d49a8736f3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:24.572497 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3013292-7135-4ae4-96e6-d49a8736f3a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:24.573314 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3013292-7135-4ae4-96e6-d49a8736f3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:24.573863 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3013292-7135-4ae4-96e6-d49a8736f3a8 admin admin] PATH_INFO: `/v3/projects/bed39aec22484edbb93f01e30ff111a7` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:24.576385 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3013292-7135-4ae4-96e6-d49a8736f3a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bed39aec22484edbb93f01e30ff111a7)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:24.581164 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3013292-7135-4ae4-96e6-d49a8736f3a8 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:24.603086 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-3730cb5b-011d-4d02-99ba-09d6f3521cdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8cbf962b64e4232b789aadbc361968f'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:24.633015 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-3730cb5b-011d-4d02-99ba-09d6f3521cdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8cbf962b64e4232b789aadbc361968f'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:24.650714 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-3730cb5b-011d-4d02-99ba-09d6f3521cdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8cbf962b64e4232b789aadbc361968f'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:24.652488 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-3730cb5b-011d-4d02-99ba-09d6f3521cdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8cbf962b64e4232b789aadbc361968f'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:24.716238 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-3730cb5b-011d-4d02-99ba-09d6f3521cdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8cbf962b64e4232b789aadbc361968f'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:24.732193 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-e3013292-7135-4ae4-96e6-d49a8736f3a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bed39aec22484edbb93f01e30ff111a7', 'request_id': 'req-e3013292-7135-4ae4-96e6-d49a8736f3a8'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:24.746179 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-e3013292-7135-4ae4-96e6-d49a8736f3a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bed39aec22484edbb93f01e30ff111a7', 'request_id': 'req-e3013292-7135-4ae4-96e6-d49a8736f3a8'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:24.748888 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 967/1927] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:30:24 2022] DELETE /identity/v3/users/c8cbf962b64e4232b789aadbc361968f => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:24.781979 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-e3013292-7135-4ae4-96e6-d49a8736f3a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bed39aec22484edbb93f01e30ff111a7', 'request_id': 'req-e3013292-7135-4ae4-96e6-d49a8736f3a8'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:24.822810 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-e3013292-7135-4ae4-96e6-d49a8736f3a8 admin admin] The token cache is being invalidate because project bed39aec22484edbb93f01e30ff111a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:30:24.823996 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-e3013292-7135-4ae4-96e6-d49a8736f3a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:24.827472 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-e3013292-7135-4ae4-96e6-d49a8736f3a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:24.833134 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 961/1928] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:30:24 2022] DELETE /identity/v3/projects/bed39aec22484edbb93f01e30ff111a7 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:24.838951 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3730cb5b-011d-4d02-99ba-09d6f3521cdf admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:24.841887 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-3730cb5b-011d-4d02-99ba-09d6f3521cdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:25.014241 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3730cb5b-011d-4d02-99ba-09d6f3521cdf admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:25.034791 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca8017a-9e8a-4322-8633-35f435c5f342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:25.034791 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8017a-9e8a-4322-8633-35f435c5f342 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:25.036609 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8017a-9e8a-4322-8633-35f435c5f342 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:25.037263 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8017a-9e8a-4322-8633-35f435c5f342 admin admin] PATH_INFO: `/v3/users/f260536b8d2645f2a88fadbccca57a4f` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:25.044376 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca8017a-9e8a-4322-8633-35f435c5f342 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f260536b8d2645f2a88fadbccca57a4f)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:25.052359 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca8017a-9e8a-4322-8633-35f435c5f342 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:25.226723 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-fca8017a-9e8a-4322-8633-35f435c5f342 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f260536b8d2645f2a88fadbccca57a4f'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:25.277459 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-fca8017a-9e8a-4322-8633-35f435c5f342 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f260536b8d2645f2a88fadbccca57a4f'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:25.298849 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-fca8017a-9e8a-4322-8633-35f435c5f342 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f260536b8d2645f2a88fadbccca57a4f'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:25.300963 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-fca8017a-9e8a-4322-8633-35f435c5f342 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f260536b8d2645f2a88fadbccca57a4f'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:25.345548 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-fca8017a-9e8a-4322-8633-35f435c5f342 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f260536b8d2645f2a88fadbccca57a4f'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:25.360346 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 968/1929] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:30:24 2022] DELETE /identity/v3/users/f260536b8d2645f2a88fadbccca57a4f => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:25.360673 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:26.060845 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3013292-7135-4ae4-96e6-d49a8736f3a8 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:26.064316 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-e3013292-7135-4ae4-96e6-d49a8736f3a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:26.190481 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3013292-7135-4ae4-96e6-d49a8736f3a8 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:26.271737 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:26.353683 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce0f03d-b295-4c82-a947-8f8dc30dab66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:26.353683 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0f03d-b295-4c82-a947-8f8dc30dab66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:26.353683 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0f03d-b295-4c82-a947-8f8dc30dab66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:26.353683 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0f03d-b295-4c82-a947-8f8dc30dab66 admin admin] PATH_INFO: `/v3/projects/aa2ca91af4594d89ac483d528f22cf20` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:26.354387 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce0f03d-b295-4c82-a947-8f8dc30dab66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa2ca91af4594d89ac483d528f22cf20)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:26.358545 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce0f03d-b295-4c82-a947-8f8dc30dab66 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:26.523707 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-cce0f03d-b295-4c82-a947-8f8dc30dab66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa2ca91af4594d89ac483d528f22cf20', 'request_id': 'req-cce0f03d-b295-4c82-a947-8f8dc30dab66'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:26.543577 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-cce0f03d-b295-4c82-a947-8f8dc30dab66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa2ca91af4594d89ac483d528f22cf20', 'request_id': 'req-cce0f03d-b295-4c82-a947-8f8dc30dab66'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:26.563556 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-cce0f03d-b295-4c82-a947-8f8dc30dab66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa2ca91af4594d89ac483d528f22cf20', 'request_id': 'req-cce0f03d-b295-4c82-a947-8f8dc30dab66'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:26.600074 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-cce0f03d-b295-4c82-a947-8f8dc30dab66 admin admin] The token cache is being invalidate because project aa2ca91af4594d89ac483d528f22cf20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:30:26.602902 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-cce0f03d-b295-4c82-a947-8f8dc30dab66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:26.610787 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-cce0f03d-b295-4c82-a947-8f8dc30dab66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:26.634632 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 962/1930] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:30:26 2022] DELETE /identity/v3/projects/aa2ca91af4594d89ac483d528f22cf20 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:26.636812 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982eb01-dd01-4af9-9dff-357d278756c3 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:26.637600 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982eb01-dd01-4af9-9dff-357d278756c3 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:26.637733 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982eb01-dd01-4af9-9dff-357d278756c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:26.679045 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce0f03d-b295-4c82-a947-8f8dc30dab66 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:26.681531 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-cce0f03d-b295-4c82-a947-8f8dc30dab66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:26.714453 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-4982eb01-dd01-4af9-9dff-357d278756c3 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:26.719338 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-4982eb01-dd01-4af9-9dff-357d278756c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:26.937226 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce0f03d-b295-4c82-a947-8f8dc30dab66 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:26.944413 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84432c58-b2bf-4755-aefa-d916a144311f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:26.945704 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84432c58-b2bf-4755-aefa-d916a144311f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:26.946592 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84432c58-b2bf-4755-aefa-d916a144311f admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:26.946767 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84432c58-b2bf-4755-aefa-d916a144311f admin admin] PATH_INFO: `/v3/projects/62c7c09e14b84fc4a68daebb5ce86c74` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:26.948415 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84432c58-b2bf-4755-aefa-d916a144311f admin admin] RBAC: Authorizing `identity:delete_project(project_id=62c7c09e14b84fc4a68daebb5ce86c74)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:26.951612 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84432c58-b2bf-4755-aefa-d916a144311f admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:26.966041 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 969/1931] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:30:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:26.982731 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959f6a7-b394-42e7-80f0-52cdd6d0c467 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:26.983476 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959f6a7-b394-42e7-80f0-52cdd6d0c467 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:26.984142 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959f6a7-b394-42e7-80f0-52cdd6d0c467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:27.013463 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-4959f6a7-b394-42e7-80f0-52cdd6d0c467 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:27.014478 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-4959f6a7-b394-42e7-80f0-52cdd6d0c467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:27.056734 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-84432c58-b2bf-4755-aefa-d916a144311f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62c7c09e14b84fc4a68daebb5ce86c74', 'request_id': 'req-84432c58-b2bf-4755-aefa-d916a144311f'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:27.073120 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-84432c58-b2bf-4755-aefa-d916a144311f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62c7c09e14b84fc4a68daebb5ce86c74', 'request_id': 'req-84432c58-b2bf-4755-aefa-d916a144311f'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:27.088265 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-84432c58-b2bf-4755-aefa-d916a144311f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62c7c09e14b84fc4a68daebb5ce86c74', 'request_id': 'req-84432c58-b2bf-4755-aefa-d916a144311f'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:27.092640 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:27.114347 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-84432c58-b2bf-4755-aefa-d916a144311f admin admin] The token cache is being invalidate because project 62c7c09e14b84fc4a68daebb5ce86c74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:30:27.114929 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-84432c58-b2bf-4755-aefa-d916a144311f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:27.116031 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-84432c58-b2bf-4755-aefa-d916a144311f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:27.133278 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 963/1932] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:30:26 2022] DELETE /identity/v3/projects/62c7c09e14b84fc4a68daebb5ce86c74 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:30:27.136449 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a23d4b-512d-4752-b5b9-87dd57c05ffc None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:27.136987 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a23d4b-512d-4752-b5b9-87dd57c05ffc None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:27.138273 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a23d4b-512d-4752-b5b9-87dd57c05ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:27.190603 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-87a23d4b-512d-4752-b5b9-87dd57c05ffc None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:27.194627 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 970/1933] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:30:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:27.194788 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-87a23d4b-512d-4752-b5b9-87dd57c05ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:27.196482 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4959f6a7-b394-42e7-80f0-52cdd6d0c467 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:27.207519 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 964/1934] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:30:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:27.217378 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7058e-9c6f-4c36-9f93-298fc43f053e None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:27.217996 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7058e-9c6f-4c36-9f93-298fc43f053e None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:27.218127 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4959f6a7-b394-42e7-80f0-52cdd6d0c467 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:27.220585 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7058e-9c6f-4c36-9f93-298fc43f053e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:27.231196 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab52096-c8e1-4ce2-87d2-de6252e66d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:27.232349 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab52096-c8e1-4ce2-87d2-de6252e66d5c admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:27.232666 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab52096-c8e1-4ce2-87d2-de6252e66d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:27.233173 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab52096-c8e1-4ce2-87d2-de6252e66d5c admin admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:27.234139 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab52096-c8e1-4ce2-87d2-de6252e66d5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:30:27.234616 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab52096-c8e1-4ce2-87d2-de6252e66d5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:27.236531 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab52096-c8e1-4ce2-87d2-de6252e66d5c admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:27.260435 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 971/1935] 10.222.0.91 () {58 vars in 1153 bytes} [Tue Aug 30 04:30:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:30:27.262636 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab52096-c8e1-4ce2-87d2-de6252e66d5c admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:27.267895 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-b7a7058e-9c6f-4c36-9f93-298fc43f053e None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:27.271746 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-b7a7058e-9c6f-4c36-9f93-298fc43f053e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:27.279595 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab52096-c8e1-4ce2-87d2-de6252e66d5c admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:27.286750 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e5d1a-7917-49df-b2fc-5c67e9140f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:27.287487 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e5d1a-7917-49df-b2fc-5c67e9140f14 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:27.287815 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e5d1a-7917-49df-b2fc-5c67e9140f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:27.288144 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e5d1a-7917-49df-b2fc-5c67e9140f14 admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:27.289016 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97e5d1a-7917-49df-b2fc-5c67e9140f14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:27.292978 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97e5d1a-7917-49df-b2fc-5c67e9140f14 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:27.312193 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 965/1936] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:30:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:27.322153 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a7058e-9c6f-4c36-9f93-298fc43f053e None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:27.357626 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a7058e-9c6f-4c36-9f93-298fc43f053e None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:27.359945 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6725199a-7f7d-4364-8c6b-93597ea91fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:27.361285 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725199a-7f7d-4364-8c6b-93597ea91fb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:27.361730 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725199a-7f7d-4364-8c6b-93597ea91fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:27.362631 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725199a-7f7d-4364-8c6b-93597ea91fb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:27.364194 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6725199a-7f7d-4364-8c6b-93597ea91fb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:30:27.364656 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6725199a-7f7d-4364-8c6b-93597ea91fb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:27.370789 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6725199a-7f7d-4364-8c6b-93597ea91fb2 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:27.386431 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 972/1937] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:30:27 2022] POST /identity/v3/projects => generated 375 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:30:27.397192 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e5d1a-7917-49df-b2fc-5c67e9140f14 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:27.409062 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 966/1938] 10.222.0.91 () {58 vars in 1153 bytes} [Tue Aug 30 04:30:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:30:27.412400 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6725199a-7f7d-4364-8c6b-93597ea91fb2 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:27.438046 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6725199a-7f7d-4364-8c6b-93597ea91fb2 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:27.524861 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e5d1a-7917-49df-b2fc-5c67e9140f14 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:27.530306 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc52f593-0a37-4bfe-a049-12c478622761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:27.531070 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52f593-0a37-4bfe-a049-12c478622761 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:27.531403 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52f593-0a37-4bfe-a049-12c478622761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:27.531735 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52f593-0a37-4bfe-a049-12c478622761 admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:27.532701 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc52f593-0a37-4bfe-a049-12c478622761 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:27.534846 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc52f593-0a37-4bfe-a049-12c478622761 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:27.549739 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:27.570915 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bde86c-11ab-44d1-b5ad-843f8ebf24f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:27.572431 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bde86c-11ab-44d1-b5ad-843f8ebf24f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:27.572940 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bde86c-11ab-44d1-b5ad-843f8ebf24f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:27.573624 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bde86c-11ab-44d1-b5ad-843f8ebf24f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:27.574806 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bde86c-11ab-44d1-b5ad-843f8ebf24f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:27.580608 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 973/1939] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:30:27 2022] POST /identity/v3/users => generated 288 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:30:27.580881 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bde86c-11ab-44d1-b5ad-843f8ebf24f8 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:27.583210 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc52f593-0a37-4bfe-a049-12c478622761 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:27.602880 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc52f593-0a37-4bfe-a049-12c478622761 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:27.609952 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54326aa0-20da-47ea-b52c-b36bbc021938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:27.610927 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54326aa0-20da-47ea-b52c-b36bbc021938 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:27.611340 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54326aa0-20da-47ea-b52c-b36bbc021938 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:27.611706 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54326aa0-20da-47ea-b52c-b36bbc021938 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:27.612658 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54326aa0-20da-47ea-b52c-b36bbc021938 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:27.615819 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54326aa0-20da-47ea-b52c-b36bbc021938 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:27.641483 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 974/1940] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:30:27.648984 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54326aa0-20da-47ea-b52c-b36bbc021938 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:27.657099 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 967/1941] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:30:27 2022] POST /identity/v3/projects => generated 385 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:30:27.659123 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bde86c-11ab-44d1-b5ad-843f8ebf24f8 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:27.668335 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54326aa0-20da-47ea-b52c-b36bbc021938 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:27.810653 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204916b-b3e1-4441-8d87-fe8effbc14bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:27.811752 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204916b-b3e1-4441-8d87-fe8effbc14bf admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:27.812247 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204916b-b3e1-4441-8d87-fe8effbc14bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:27.812714 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204916b-b3e1-4441-8d87-fe8effbc14bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:27.813895 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a204916b-b3e1-4441-8d87-fe8effbc14bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:27.817077 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a204916b-b3e1-4441-8d87-fe8effbc14bf admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:27.826101 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bde86c-11ab-44d1-b5ad-843f8ebf24f8 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:27.838705 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 975/1942] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:30:27.844214 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204916b-b3e1-4441-8d87-fe8effbc14bf admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:27.847414 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e20790a-431d-47a7-86b8-5913cfcf6ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:27.847811 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20790a-431d-47a7-86b8-5913cfcf6ee9 admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:27.848124 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20790a-431d-47a7-86b8-5913cfcf6ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:27.848400 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20790a-431d-47a7-86b8-5913cfcf6ee9 admin admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:27.849068 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e20790a-431d-47a7-86b8-5913cfcf6ee9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:27.851688 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e20790a-431d-47a7-86b8-5913cfcf6ee9 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:27.876686 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204916b-b3e1-4441-8d87-fe8effbc14bf admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:27.882578 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 968/1943] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:30:27 2022] POST /identity/v3/users => generated 293 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:30:27.888068 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b2a2ab-8ee2-4149-b42a-4e3ad91c3b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:27.888762 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e20790a-431d-47a7-86b8-5913cfcf6ee9 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:27.890228 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2a2ab-8ee2-4149-b42a-4e3ad91c3b2b admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:27.890704 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2a2ab-8ee2-4149-b42a-4e3ad91c3b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:27.891976 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2a2ab-8ee2-4149-b42a-4e3ad91c3b2b admin admin] PATH_INFO: `/v3/projects/0c65b63ddb8441d1991aeed716101750/users/4f44639a1bff4822b5871e18622156ee/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:27.902691 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e20790a-431d-47a7-86b8-5913cfcf6ee9 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:27.908086 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b88136-46af-4b88-8630-942538340528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:27.908882 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b88136-46af-4b88-8630-942538340528 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:27.909318 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b88136-46af-4b88-8630-942538340528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:27.909691 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b88136-46af-4b88-8630-942538340528 admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:27.911126 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b88136-46af-4b88-8630-942538340528 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:27.913307 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b88136-46af-4b88-8630-942538340528 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:27.926661 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 969/1944] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:30:27.933582 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b88136-46af-4b88-8630-942538340528 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:27.946196 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b88136-46af-4b88-8630-942538340528 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:27.964319 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b2a2ab-8ee2-4149-b42a-4e3ad91c3b2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c65b63ddb8441d1991aeed716101750, user_id=4f44639a1bff4822b5871e18622156ee, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:27.968972 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a290e16-805d-4101-b9be-db79c67fdc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:27.969627 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a290e16-805d-4101-b9be-db79c67fdc73 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:27.969910 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a290e16-805d-4101-b9be-db79c67fdc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:27.970194 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a290e16-805d-4101-b9be-db79c67fdc73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:27.970885 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a290e16-805d-4101-b9be-db79c67fdc73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:27.971170 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b2a2ab-8ee2-4149-b42a-4e3ad91c3b2b admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:27.973451 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a290e16-805d-4101-b9be-db79c67fdc73 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:27.998931 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 970/1945] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:30:28.005168 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a290e16-805d-4101-b9be-db79c67fdc73 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:28.011190 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 976/1946] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:30:27 2022] PUT /identity/v3/projects/0c65b63ddb8441d1991aeed716101750/users/4f44639a1bff4822b5871e18622156ee/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:28.030714 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9070cd1-bb12-41c5-817d-76e1880c44a6 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:28.031742 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9070cd1-bb12-41c5-817d-76e1880c44a6 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:28.032654 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9070cd1-bb12-41c5-817d-76e1880c44a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:28.053431 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a290e16-805d-4101-b9be-db79c67fdc73 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:28.091459 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:28.122293 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-a9070cd1-bb12-41c5-817d-76e1880c44a6 None None] MFA Rules not processed for user `4f44639a1bff4822b5871e18622156ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:28.123899 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-a9070cd1-bb12-41c5-817d-76e1880c44a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:28.322938 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72fe44-aa2c-4125-ad34-222100571157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:28.326829 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72fe44-aa2c-4125-ad34-222100571157 admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:28.326829 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72fe44-aa2c-4125-ad34-222100571157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:28.326829 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72fe44-aa2c-4125-ad34-222100571157 admin admin] PATH_INFO: `/v3/projects/602c6c483047468e8112176b770ba24b/users/16cfddda87eb4fef849175aaebfc5124/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:28.335651 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 977/1947] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:30:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:30:28.342427 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9070cd1-bb12-41c5-817d-76e1880c44a6 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:28.345482 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a72fe44-aa2c-4125-ad34-222100571157 admin admin] RBAC: Authorizing `identity:create_grant(project_id=602c6c483047468e8112176b770ba24b, user_id=16cfddda87eb4fef849175aaebfc5124, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:28.348531 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a72fe44-aa2c-4125-ad34-222100571157 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:28.383172 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9070cd1-bb12-41c5-817d-76e1880c44a6 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:28.409606 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 971/1948] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:30:28 2022] PUT /identity/v3/projects/602c6c483047468e8112176b770ba24b/users/16cfddda87eb4fef849175aaebfc5124/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:30:28.459629 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768029e-2ef6-42d0-b3c4-9111e56d0c87 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:28.460067 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768029e-2ef6-42d0-b3c4-9111e56d0c87 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:28.461123 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768029e-2ef6-42d0-b3c4-9111e56d0c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:28.503060 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:28.539133 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-2768029e-2ef6-42d0-b3c4-9111e56d0c87 None None] MFA Rules not processed for user `16cfddda87eb4fef849175aaebfc5124`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:28.539133 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-2768029e-2ef6-42d0-b3c4-9111e56d0c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:28.601842 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa04984-058f-43b7-a784-12a565cfb616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:28.602718 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa04984-058f-43b7-a784-12a565cfb616 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:28.603012 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa04984-058f-43b7-a784-12a565cfb616 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:28.603899 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa04984-058f-43b7-a784-12a565cfb616 admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:28.604966 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa04984-058f-43b7-a784-12a565cfb616 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:28.609571 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa04984-058f-43b7-a784-12a565cfb616 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:28.688008 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 978/1949] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:30:28 2022] POST /identity/v3/projects => generated 373 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:30:28.697421 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa04984-058f-43b7-a784-12a565cfb616 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:28.710787 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 972/1950] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:30:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:28.716831 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2768029e-2ef6-42d0-b3c4-9111e56d0c87 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:28.739759 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2768029e-2ef6-42d0-b3c4-9111e56d0c87 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:28.886650 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa04984-058f-43b7-a784-12a565cfb616 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:28.892612 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb53f37-5f0c-4e10-96ad-12337ccbd577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:28.893664 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb53f37-5f0c-4e10-96ad-12337ccbd577 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:28.894134 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb53f37-5f0c-4e10-96ad-12337ccbd577 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:28.894710 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb53f37-5f0c-4e10-96ad-12337ccbd577 admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:28.896407 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb53f37-5f0c-4e10-96ad-12337ccbd577 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:28.898389 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb53f37-5f0c-4e10-96ad-12337ccbd577 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:28.933828 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ff738-6f08-4e63-8e41-845607776704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:28.934681 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ff738-6f08-4e63-8e41-845607776704 admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:28.934965 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ff738-6f08-4e63-8e41-845607776704 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:28.935560 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ff738-6f08-4e63-8e41-845607776704 admin admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:28.936374 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33ff738-6f08-4e63-8e41-845607776704 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:28.939223 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33ff738-6f08-4e63-8e41-845607776704 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:28.939416 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 979/1951] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:30:28 2022] POST /identity/v3/users => generated 293 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:30:28.944876 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb53f37-5f0c-4e10-96ad-12337ccbd577 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:28.957012 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb53f37-5f0c-4e10-96ad-12337ccbd577 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:28.962807 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af468e-498b-4740-912b-277f98e1bcc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:28.963453 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af468e-498b-4740-912b-277f98e1bcc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:28.963730 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af468e-498b-4740-912b-277f98e1bcc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:28.964036 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af468e-498b-4740-912b-277f98e1bcc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:28.965613 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af468e-498b-4740-912b-277f98e1bcc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:28.967417 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af468e-498b-4740-912b-277f98e1bcc7 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:28.984350 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 973/1952] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:30:28 2022] POST /identity/v3/projects => generated 385 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:30:28.985359 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ff738-6f08-4e63-8e41-845607776704 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:28.989737 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 980/1953] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:30:28 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:30:28.994135 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af468e-498b-4740-912b-277f98e1bcc7 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:29.005210 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af468e-498b-4740-912b-277f98e1bcc7 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:29.016533 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:29.089602 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ff738-6f08-4e63-8e41-845607776704 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:29.113452 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c392322f-1881-4861-8c2c-b83876a83b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:29.113452 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392322f-1881-4861-8c2c-b83876a83b0b admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:29.113452 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392322f-1881-4861-8c2c-b83876a83b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:29.113452 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392322f-1881-4861-8c2c-b83876a83b0b admin admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:29.114543 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c392322f-1881-4861-8c2c-b83876a83b0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:29.119154 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c392322f-1881-4861-8c2c-b83876a83b0b admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:29.126448 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60931416-5c10-43f2-8dc3-21fbb23379fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:29.127301 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60931416-5c10-43f2-8dc3-21fbb23379fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:29.127810 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60931416-5c10-43f2-8dc3-21fbb23379fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:29.128094 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60931416-5c10-43f2-8dc3-21fbb23379fc admin admin] PATH_INFO: `/v3/projects/7dedf69da77747379c9735e0fb415273/users/777c03365343404393a292619b60b7c4/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:29.173964 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60931416-5c10-43f2-8dc3-21fbb23379fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dedf69da77747379c9735e0fb415273, user_id=777c03365343404393a292619b60b7c4, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:29.180463 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60931416-5c10-43f2-8dc3-21fbb23379fc admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:29.182359 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 974/1954] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:30:28 2022] POST /identity/v3/users => generated 299 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:30:29.191324 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c392322f-1881-4861-8c2c-b83876a83b0b admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:29.205893 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c392322f-1881-4861-8c2c-b83876a83b0b admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:29.211163 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 981/1955] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:30:28 2022] PUT /identity/v3/projects/7dedf69da77747379c9735e0fb415273/users/777c03365343404393a292619b60b7c4/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:30:29.217680 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60931416-5c10-43f2-8dc3-21fbb23379fc admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:29.292928 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:29.314206 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4862abb-f7d1-4186-a4b8-6b907541e9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:29.315357 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4862abb-f7d1-4186-a4b8-6b907541e9a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:29.315950 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4862abb-f7d1-4186-a4b8-6b907541e9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:29.317101 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4862abb-f7d1-4186-a4b8-6b907541e9a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:29.318362 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4862abb-f7d1-4186-a4b8-6b907541e9a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:29.321596 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4862abb-f7d1-4186-a4b8-6b907541e9a8 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:29.334457 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60931416-5c10-43f2-8dc3-21fbb23379fc admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:29.340624 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb701db-844d-4d04-944f-561be67a1e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:29.341170 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb701db-844d-4d04-944f-561be67a1e5a admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:29.341445 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb701db-844d-4d04-944f-561be67a1e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:29.341727 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb701db-844d-4d04-944f-561be67a1e5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:29.342390 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb701db-844d-4d04-944f-561be67a1e5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:29.343039 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 975/1956] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:30:29 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:30:29.344484 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb701db-844d-4d04-944f-561be67a1e5a admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:29.347848 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4862abb-f7d1-4186-a4b8-6b907541e9a8 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:29.362098 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4862abb-f7d1-4186-a4b8-6b907541e9a8 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:29.368485 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 982/1957] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:30:29 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:30:29.370489 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb701db-844d-4d04-944f-561be67a1e5a admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:29.370651 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be4c8d3-900e-4fd3-82b5-6ed616f8e22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:29.371601 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be4c8d3-900e-4fd3-82b5-6ed616f8e22e admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:29.372112 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be4c8d3-900e-4fd3-82b5-6ed616f8e22e admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:29.372488 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be4c8d3-900e-4fd3-82b5-6ed616f8e22e admin admin] PATH_INFO: `/v3/projects/4c1a2fb36ed84cf48e44f8f806b20089/users/c9a157ef01c74f3fa070ae2a322b181f/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:29.388634 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb701db-844d-4d04-944f-561be67a1e5a admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:29.397043 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb1376c-0a55-4162-9626-3c2d80aa2660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:29.398271 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1376c-0a55-4162-9626-3c2d80aa2660 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:29.398756 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1376c-0a55-4162-9626-3c2d80aa2660 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:29.399236 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1376c-0a55-4162-9626-3c2d80aa2660 admin admin] PATH_INFO: `/v3/projects/7dedf69da77747379c9735e0fb415273/users/777c03365343404393a292619b60b7c4/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:29.402908 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb1376c-0a55-4162-9626-3c2d80aa2660 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dedf69da77747379c9735e0fb415273, user_id=777c03365343404393a292619b60b7c4, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:29.403353 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be4c8d3-900e-4fd3-82b5-6ed616f8e22e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c1a2fb36ed84cf48e44f8f806b20089, user_id=c9a157ef01c74f3fa070ae2a322b181f, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:29.406393 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be4c8d3-900e-4fd3-82b5-6ed616f8e22e admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:29.408157 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb1376c-0a55-4162-9626-3c2d80aa2660 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:29.427115 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 976/1958] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:30:29 2022] PUT /identity/v3/projects/4c1a2fb36ed84cf48e44f8f806b20089/users/c9a157ef01c74f3fa070ae2a322b181f/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:29.433093 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be4c8d3-900e-4fd3-82b5-6ed616f8e22e admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:29.443966 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 983/1959] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:30:29 2022] PUT /identity/v3/projects/7dedf69da77747379c9735e0fb415273/users/777c03365343404393a292619b60b7c4/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:29.452753 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7c186-68ba-4205-a461-8d31f59ceaf0 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:29.453886 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7c186-68ba-4205-a461-8d31f59ceaf0 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:29.454096 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7c186-68ba-4205-a461-8d31f59ceaf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:29.527166 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-64f7c186-68ba-4205-a461-8d31f59ceaf0 None None] MFA Rules not processed for user `777c03365343404393a292619b60b7c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:29.528943 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-64f7c186-68ba-4205-a461-8d31f59ceaf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:29.545117 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be4c8d3-900e-4fd3-82b5-6ed616f8e22e admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:29.588089 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:29.703818 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ce31d-e735-4798-97c5-25de087045a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:29.704800 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ce31d-e735-4798-97c5-25de087045a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:29.704924 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ce31d-e735-4798-97c5-25de087045a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:29.705148 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ce31d-e735-4798-97c5-25de087045a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:29.705806 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65ce31d-e735-4798-97c5-25de087045a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:29.707490 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65ce31d-e735-4798-97c5-25de087045a9 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:29.736723 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 977/1960] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:30:29 2022] GET /identity/v3/roles => generated 1420 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:30:29.742297 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ce31d-e735-4798-97c5-25de087045a9 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:29.746502 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 984/1961] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:30:29 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:30:29.761040 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f7c186-68ba-4205-a461-8d31f59ceaf0 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:29.763941 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ce31d-e735-4798-97c5-25de087045a9 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:29.766509 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-64f7c186-68ba-4205-a461-8d31f59ceaf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:29.772634 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff075472-7e5e-48ca-ad9d-f65efe665b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:29.773652 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff075472-7e5e-48ca-ad9d-f65efe665b1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:29.775105 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff075472-7e5e-48ca-ad9d-f65efe665b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:29.775495 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff075472-7e5e-48ca-ad9d-f65efe665b1f admin admin] PATH_INFO: `/v3/projects/4c1a2fb36ed84cf48e44f8f806b20089/users/c9a157ef01c74f3fa070ae2a322b181f/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:29.778731 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff075472-7e5e-48ca-ad9d-f65efe665b1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c1a2fb36ed84cf48e44f8f806b20089, user_id=c9a157ef01c74f3fa070ae2a322b181f, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:29.782742 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff075472-7e5e-48ca-ad9d-f65efe665b1f admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:29.849208 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 978/1962] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:30:29 2022] PUT /identity/v3/projects/4c1a2fb36ed84cf48e44f8f806b20089/users/c9a157ef01c74f3fa070ae2a322b181f/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:30:29.863550 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e48ea-8885-457c-bd9c-c797cda348d6 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:29.864359 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e48ea-8885-457c-bd9c-c797cda348d6 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:29.864868 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e48ea-8885-457c-bd9c-c797cda348d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:29.946377 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-241e48ea-8885-457c-bd9c-c797cda348d6 None None] MFA Rules not processed for user `c9a157ef01c74f3fa070ae2a322b181f`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:29.950174 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-241e48ea-8885-457c-bd9c-c797cda348d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:29.973435 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f7c186-68ba-4205-a461-8d31f59ceaf0 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:30.063301 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 979/1963] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:30:29 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:30:30.081372 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e48ea-8885-457c-bd9c-c797cda348d6 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:30.083548 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-241e48ea-8885-457c-bd9c-c797cda348d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:30.179894 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e48ea-8885-457c-bd9c-c797cda348d6 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:30.187704 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb0235-411b-4534-a9b1-12488af807d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:30.188929 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb0235-411b-4534-a9b1-12488af807d2 service cinder] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:30.189394 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb0235-411b-4534-a9b1-12488af807d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:30.189934 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb0235-411b-4534-a9b1-12488af807d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:30.237331 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bb0235-411b-4534-a9b1-12488af807d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:30.242323 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a48235b-4af7-41ef-b915-eb73d0da2986 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:30.243622 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bb0235-411b-4534-a9b1-12488af807d2 service cinder] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:30.247652 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48235b-4af7-41ef-b915-eb73d0da2986 service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:30.249210 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48235b-4af7-41ef-b915-eb73d0da2986 service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:30.250945 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48235b-4af7-41ef-b915-eb73d0da2986 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:30.300521 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:30.326270 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 980/1964] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:30:30 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:30:30.457811 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb0235-411b-4534-a9b1-12488af807d2 service cinder] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:30.491350 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a48235b-4af7-41ef-b915-eb73d0da2986 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:30.493065 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a48235b-4af7-41ef-b915-eb73d0da2986 service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:30.505655 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 985/1965] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:30:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 745 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:30:30.546958 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:30.604153 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb0235-411b-4534-a9b1-12488af807d2 service cinder] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:30.615805 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99278210-fa67-4844-af78-733af02501fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:30.616865 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99278210-fa67-4844-af78-733af02501fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:30.617425 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99278210-fa67-4844-af78-733af02501fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:30.617914 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99278210-fa67-4844-af78-733af02501fa admin admin] PATH_INFO: `/v3/users/16cfddda87eb4fef849175aaebfc5124` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:30.622015 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99278210-fa67-4844-af78-733af02501fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=16cfddda87eb4fef849175aaebfc5124)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:30.627438 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99278210-fa67-4844-af78-733af02501fa admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:30.762814 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-99278210-fa67-4844-af78-733af02501fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16cfddda87eb4fef849175aaebfc5124'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:30.766100 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-99278210-fa67-4844-af78-733af02501fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16cfddda87eb4fef849175aaebfc5124'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:30.769013 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-99278210-fa67-4844-af78-733af02501fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16cfddda87eb4fef849175aaebfc5124'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:30.789244 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-99278210-fa67-4844-af78-733af02501fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16cfddda87eb4fef849175aaebfc5124'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:30.821960 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-99278210-fa67-4844-af78-733af02501fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16cfddda87eb4fef849175aaebfc5124'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:30.844130 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 981/1966] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:30:30 2022] DELETE /identity/v3/users/16cfddda87eb4fef849175aaebfc5124 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:30.849067 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27dc5eb-8b95-4b5d-b497-14f59a47f278 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:30.850146 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27dc5eb-8b95-4b5d-b497-14f59a47f278 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:30.850423 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27dc5eb-8b95-4b5d-b497-14f59a47f278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:30.879235 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-b27dc5eb-8b95-4b5d-b497-14f59a47f278 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:30.893399 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-b27dc5eb-8b95-4b5d-b497-14f59a47f278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:31.086951 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 986/1967] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:30:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:31.233306 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99278210-fa67-4844-af78-733af02501fa admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:31.235730 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-99278210-fa67-4844-af78-733af02501fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:31.446299 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99278210-fa67-4844-af78-733af02501fa admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:31.453839 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed77f21-a7d0-49a1-99e3-1972c40d5102 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:31.454490 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed77f21-a7d0-49a1-99e3-1972c40d5102 service neutron] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:31.454766 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed77f21-a7d0-49a1-99e3-1972c40d5102 service neutron] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:31.455037 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed77f21-a7d0-49a1-99e3-1972c40d5102 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:31.466708 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed77f21-a7d0-49a1-99e3-1972c40d5102 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:31.468685 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed77f21-a7d0-49a1-99e3-1972c40d5102 service neutron] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:31.481079 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 982/1968] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:30:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:30:32.885997 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27dc5eb-8b95-4b5d-b497-14f59a47f278 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:32.892606 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-b27dc5eb-8b95-4b5d-b497-14f59a47f278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:32.929900 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27dc5eb-8b95-4b5d-b497-14f59a47f278 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:32.937454 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d265bc29-1ccf-40f7-8fa0-ef0c7714348f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:32.938267 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265bc29-1ccf-40f7-8fa0-ef0c7714348f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:32.938997 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265bc29-1ccf-40f7-8fa0-ef0c7714348f admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:32.939565 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265bc29-1ccf-40f7-8fa0-ef0c7714348f admin admin] PATH_INFO: `/v3/projects/602c6c483047468e8112176b770ba24b` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:32.942890 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d265bc29-1ccf-40f7-8fa0-ef0c7714348f admin admin] RBAC: Authorizing `identity:delete_project(project_id=602c6c483047468e8112176b770ba24b)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:32.945492 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d265bc29-1ccf-40f7-8fa0-ef0c7714348f admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:33.087575 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-d265bc29-1ccf-40f7-8fa0-ef0c7714348f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '602c6c483047468e8112176b770ba24b', 'request_id': 'req-d265bc29-1ccf-40f7-8fa0-ef0c7714348f'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:33.107049 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-d265bc29-1ccf-40f7-8fa0-ef0c7714348f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '602c6c483047468e8112176b770ba24b', 'request_id': 'req-d265bc29-1ccf-40f7-8fa0-ef0c7714348f'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:33.132069 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-d265bc29-1ccf-40f7-8fa0-ef0c7714348f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '602c6c483047468e8112176b770ba24b', 'request_id': 'req-d265bc29-1ccf-40f7-8fa0-ef0c7714348f'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:33.178718 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-d265bc29-1ccf-40f7-8fa0-ef0c7714348f admin admin] The token cache is being invalidate because project 602c6c483047468e8112176b770ba24b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:30:33.179327 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-d265bc29-1ccf-40f7-8fa0-ef0c7714348f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:33.180779 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-d265bc29-1ccf-40f7-8fa0-ef0c7714348f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:33.183451 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 987/1969] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:30:32 2022] DELETE /identity/v3/projects/602c6c483047468e8112176b770ba24b => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:33.190870 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed77f21-a7d0-49a1-99e3-1972c40d5102 service neutron] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:33.212280 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed77f21-a7d0-49a1-99e3-1972c40d5102 service neutron] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:33.352682 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:33.395609 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a5a48-7172-4bed-9ad6-5cd99e09292e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:33.399485 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a5a48-7172-4bed-9ad6-5cd99e09292e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:33.400639 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a5a48-7172-4bed-9ad6-5cd99e09292e admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:33.404738 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a5a48-7172-4bed-9ad6-5cd99e09292e admin admin] PATH_INFO: `/v3/users/c9a157ef01c74f3fa070ae2a322b181f` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:33.408126 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23a5a48-7172-4bed-9ad6-5cd99e09292e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9a157ef01c74f3fa070ae2a322b181f)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:33.412529 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23a5a48-7172-4bed-9ad6-5cd99e09292e admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:33.538975 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-f23a5a48-7172-4bed-9ad6-5cd99e09292e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9a157ef01c74f3fa070ae2a322b181f'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:33.539796 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-f23a5a48-7172-4bed-9ad6-5cd99e09292e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9a157ef01c74f3fa070ae2a322b181f'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:33.540530 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-f23a5a48-7172-4bed-9ad6-5cd99e09292e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9a157ef01c74f3fa070ae2a322b181f'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:33.553346 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-f23a5a48-7172-4bed-9ad6-5cd99e09292e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9a157ef01c74f3fa070ae2a322b181f'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:33.587087 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-f23a5a48-7172-4bed-9ad6-5cd99e09292e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9a157ef01c74f3fa070ae2a322b181f'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:33.633887 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 983/1970] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:30:33 2022] DELETE /identity/v3/users/c9a157ef01c74f3fa070ae2a322b181f => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:33.772347 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d265bc29-1ccf-40f7-8fa0-ef0c7714348f admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:33.774424 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-d265bc29-1ccf-40f7-8fa0-ef0c7714348f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:33.805675 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d265bc29-1ccf-40f7-8fa0-ef0c7714348f admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:33.899673 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:33.962549 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7c0cf9-0603-47e3-b05d-db29073a5ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:33.964990 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c0cf9-0603-47e3-b05d-db29073a5ca6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:33.964990 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c0cf9-0603-47e3-b05d-db29073a5ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:33.965351 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c0cf9-0603-47e3-b05d-db29073a5ca6 admin admin] PATH_INFO: `/v3/users/4f44639a1bff4822b5871e18622156ee` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:33.967654 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7c0cf9-0603-47e3-b05d-db29073a5ca6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f44639a1bff4822b5871e18622156ee)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:33.971967 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7c0cf9-0603-47e3-b05d-db29073a5ca6 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:34.072542 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-7a7c0cf9-0603-47e3-b05d-db29073a5ca6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f44639a1bff4822b5871e18622156ee'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:34.086368 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-7a7c0cf9-0603-47e3-b05d-db29073a5ca6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f44639a1bff4822b5871e18622156ee'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:34.098979 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-7a7c0cf9-0603-47e3-b05d-db29073a5ca6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f44639a1bff4822b5871e18622156ee'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:34.099787 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-7a7c0cf9-0603-47e3-b05d-db29073a5ca6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f44639a1bff4822b5871e18622156ee'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:34.127158 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-7a7c0cf9-0603-47e3-b05d-db29073a5ca6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f44639a1bff4822b5871e18622156ee'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:34.163078 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 988/1971] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:30:33 2022] DELETE /identity/v3/users/4f44639a1bff4822b5871e18622156ee => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:34.168351 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7884fa-daee-45bc-bb58-e3d671d1fd07 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:34.168825 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7884fa-daee-45bc-bb58-e3d671d1fd07 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:34.169563 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7884fa-daee-45bc-bb58-e3d671d1fd07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:34.204546 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-4d7884fa-daee-45bc-bb58-e3d671d1fd07 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:34.216532 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-4d7884fa-daee-45bc-bb58-e3d671d1fd07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:34.237829 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7c0cf9-0603-47e3-b05d-db29073a5ca6 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:34.240923 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-7a7c0cf9-0603-47e3-b05d-db29073a5ca6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:34.399592 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7c0cf9-0603-47e3-b05d-db29073a5ca6 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:34.409564 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dbeb18-8215-4380-b5d7-a3bf3da167e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:34.411633 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dbeb18-8215-4380-b5d7-a3bf3da167e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:34.412300 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dbeb18-8215-4380-b5d7-a3bf3da167e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:34.414299 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dbeb18-8215-4380-b5d7-a3bf3da167e4 admin admin] PATH_INFO: `/v3/projects/4c1a2fb36ed84cf48e44f8f806b20089` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:34.418797 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dbeb18-8215-4380-b5d7-a3bf3da167e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c1a2fb36ed84cf48e44f8f806b20089)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:34.440047 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dbeb18-8215-4380-b5d7-a3bf3da167e4 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:34.446720 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 984/1972] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:30:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:34.464135 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7884fa-daee-45bc-bb58-e3d671d1fd07 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:34.476773 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-4d7884fa-daee-45bc-bb58-e3d671d1fd07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:34.586596 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-b2dbeb18-8215-4380-b5d7-a3bf3da167e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c1a2fb36ed84cf48e44f8f806b20089', 'request_id': 'req-b2dbeb18-8215-4380-b5d7-a3bf3da167e4'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:34.604418 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-b2dbeb18-8215-4380-b5d7-a3bf3da167e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c1a2fb36ed84cf48e44f8f806b20089', 'request_id': 'req-b2dbeb18-8215-4380-b5d7-a3bf3da167e4'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:34.609281 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:34.618634 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-b2dbeb18-8215-4380-b5d7-a3bf3da167e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c1a2fb36ed84cf48e44f8f806b20089', 'request_id': 'req-b2dbeb18-8215-4380-b5d7-a3bf3da167e4'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:34.650141 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-b2dbeb18-8215-4380-b5d7-a3bf3da167e4 admin admin] The token cache is being invalidate because project 4c1a2fb36ed84cf48e44f8f806b20089 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:30:34.650445 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-b2dbeb18-8215-4380-b5d7-a3bf3da167e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:34.657185 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-b2dbeb18-8215-4380-b5d7-a3bf3da167e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:34.661238 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 989/1973] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:30:34 2022] DELETE /identity/v3/projects/4c1a2fb36ed84cf48e44f8f806b20089 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:30:34.668203 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390de3c9-dead-4a52-ae4d-cd239beb9297 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:34.668589 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390de3c9-dead-4a52-ae4d-cd239beb9297 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:34.668933 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390de3c9-dead-4a52-ae4d-cd239beb9297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:34.672068 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7884fa-daee-45bc-bb58-e3d671d1fd07 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:34.699448 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-390de3c9-dead-4a52-ae4d-cd239beb9297 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:34.701128 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-390de3c9-dead-4a52-ae4d-cd239beb9297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:34.805211 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:34.817664 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 990/1974] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:30:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:34.826836 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7214817-d44a-428d-bdb0-7c006400ba21 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:34.827180 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7214817-d44a-428d-bdb0-7c006400ba21 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:34.827403 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7214817-d44a-428d-bdb0-7c006400ba21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:34.901212 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-b7214817-d44a-428d-bdb0-7c006400ba21 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:34.902506 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-b7214817-d44a-428d-bdb0-7c006400ba21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:34.918060 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41c0c2a-fc06-486f-81b3-332d7ffdc461 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:34.918816 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c0c2a-fc06-486f-81b3-332d7ffdc461 service neutron] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:34.920250 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c0c2a-fc06-486f-81b3-332d7ffdc461 service neutron] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:34.920250 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c0c2a-fc06-486f-81b3-332d7ffdc461 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:34.924475 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-d41c0c2a-fc06-486f-81b3-332d7ffdc461 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:34.944074 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 991/1975] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:30:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:30:34.946625 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7214817-d44a-428d-bdb0-7c006400ba21 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:34.961504 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41c0c2a-fc06-486f-81b3-332d7ffdc461 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:34.963153 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41c0c2a-fc06-486f-81b3-332d7ffdc461 service neutron] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:34.989642 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 985/1976] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:30:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:30:35.002390 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7214817-d44a-428d-bdb0-7c006400ba21 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:35.017948 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb728e-e30a-4650-83b8-1e03749947fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:35.021053 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb728e-e30a-4650-83b8-1e03749947fe admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:35.027200 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb728e-e30a-4650-83b8-1e03749947fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:35.028472 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb728e-e30a-4650-83b8-1e03749947fe admin admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:35.030803 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cb728e-e30a-4650-83b8-1e03749947fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:30:35.031526 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cb728e-e30a-4650-83b8-1e03749947fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:35.038018 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cb728e-e30a-4650-83b8-1e03749947fe admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:35.093229 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 992/1977] 10.222.0.91 () {58 vars in 1153 bytes} [Tue Aug 30 04:30:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:30:35.095003 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41c0c2a-fc06-486f-81b3-332d7ffdc461 service neutron] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:35.116183 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41c0c2a-fc06-486f-81b3-332d7ffdc461 service neutron] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:35.132384 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7fc00f-78df-4b3a-8270-dc12014001c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:35.133442 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7fc00f-78df-4b3a-8270-dc12014001c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:35.134030 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7fc00f-78df-4b3a-8270-dc12014001c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:35.134468 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7fc00f-78df-4b3a-8270-dc12014001c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:35.135596 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7fc00f-78df-4b3a-8270-dc12014001c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:35.140651 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7fc00f-78df-4b3a-8270-dc12014001c1 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:35.224727 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 986/1978] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:30:35 2022] POST /identity/v3/projects => generated 377 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:30:35.225430 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb728e-e30a-4650-83b8-1e03749947fe admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:35.294964 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb728e-e30a-4650-83b8-1e03749947fe admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:35.437024 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f18061-4f02-42a9-aca4-d34f9319f225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:35.437691 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f18061-4f02-42a9-aca4-d34f9319f225 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:35.438011 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f18061-4f02-42a9-aca4-d34f9319f225 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:35.438294 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f18061-4f02-42a9-aca4-d34f9319f225 admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:35.439807 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f18061-4f02-42a9-aca4-d34f9319f225 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:35.441284 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f18061-4f02-42a9-aca4-d34f9319f225 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:35.494714 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 993/1979] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:30:35 2022] POST /identity/v3/users => generated 289 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:30:35.497028 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7fc00f-78df-4b3a-8270-dc12014001c1 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:35.515224 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7fc00f-78df-4b3a-8270-dc12014001c1 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:35.534558 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e57ee67-0562-4bc8-a273-196b9aedad06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:35.535763 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e57ee67-0562-4bc8-a273-196b9aedad06 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:35.537104 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e57ee67-0562-4bc8-a273-196b9aedad06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:35.537585 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e57ee67-0562-4bc8-a273-196b9aedad06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:35.541489 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e57ee67-0562-4bc8-a273-196b9aedad06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:35.543470 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e57ee67-0562-4bc8-a273-196b9aedad06 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:35.575676 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f18061-4f02-42a9-aca4-d34f9319f225 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:35.576431 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 987/1980] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:30:35 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:30:35.588788 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f18061-4f02-42a9-aca4-d34f9319f225 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:35.595393 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7673c339-2d63-4495-a162-58f56ea84274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:35.596895 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7673c339-2d63-4495-a162-58f56ea84274 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:35.596895 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7673c339-2d63-4495-a162-58f56ea84274 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:35.596895 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7673c339-2d63-4495-a162-58f56ea84274 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:35.598397 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7673c339-2d63-4495-a162-58f56ea84274 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:35.600442 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7673c339-2d63-4495-a162-58f56ea84274 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:35.620406 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 994/1981] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:30:35 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:30:35.620723 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e57ee67-0562-4bc8-a273-196b9aedad06 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:35.637211 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e57ee67-0562-4bc8-a273-196b9aedad06 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:35.663870 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79282de5-43aa-4979-a31c-541ed618e104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:35.665222 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79282de5-43aa-4979-a31c-541ed618e104 admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:35.665715 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79282de5-43aa-4979-a31c-541ed618e104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:35.666236 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79282de5-43aa-4979-a31c-541ed618e104 admin admin] PATH_INFO: `/v3/projects/67dcbd1b18464dbbb33bb4674f661018/users/e374b7ba51ab4bf1a5076ef4d8ef8dcb/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:35.708411 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79282de5-43aa-4979-a31c-541ed618e104 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67dcbd1b18464dbbb33bb4674f661018, user_id=e374b7ba51ab4bf1a5076ef4d8ef8dcb, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:35.721291 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79282de5-43aa-4979-a31c-541ed618e104 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:35.761417 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 988/1982] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:30:35 2022] PUT /identity/v3/projects/67dcbd1b18464dbbb33bb4674f661018/users/e374b7ba51ab4bf1a5076ef4d8ef8dcb/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:35.764598 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05213b09-ed9e-493b-b56c-b3284b904620 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:35.765402 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05213b09-ed9e-493b-b56c-b3284b904620 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:35.765980 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05213b09-ed9e-493b-b56c-b3284b904620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:35.833777 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-05213b09-ed9e-493b-b56c-b3284b904620 None None] MFA Rules not processed for user `e374b7ba51ab4bf1a5076ef4d8ef8dcb`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:35.835495 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-05213b09-ed9e-493b-b56c-b3284b904620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:35.913280 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:36.033601 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 995/1983] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:30:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:36.039195 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79282de5-43aa-4979-a31c-541ed618e104 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:36.201795 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05213b09-ed9e-493b-b56c-b3284b904620 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:36.205875 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-05213b09-ed9e-493b-b56c-b3284b904620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:36.267717 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79282de5-43aa-4979-a31c-541ed618e104 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:36.273624 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47f3050-24b1-4227-a10f-2a5b252c5b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:36.274265 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f3050-24b1-4227-a10f-2a5b252c5b12 admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:36.274531 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f3050-24b1-4227-a10f-2a5b252c5b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:36.274960 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f3050-24b1-4227-a10f-2a5b252c5b12 admin admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:36.276061 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47f3050-24b1-4227-a10f-2a5b252c5b12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:36.278585 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47f3050-24b1-4227-a10f-2a5b252c5b12 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:36.354953 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 989/1984] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:30:36 2022] POST /identity/v3/projects => generated 379 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:30:36.360914 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47f3050-24b1-4227-a10f-2a5b252c5b12 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:36.458185 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05213b09-ed9e-493b-b56c-b3284b904620 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:36.498119 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47f3050-24b1-4227-a10f-2a5b252c5b12 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:36.509776 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decddea9-1bcf-425a-9395-10b1df785f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:36.512726 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decddea9-1bcf-425a-9395-10b1df785f8a admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:36.513268 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decddea9-1bcf-425a-9395-10b1df785f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:36.513683 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decddea9-1bcf-425a-9395-10b1df785f8a admin admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:36.514703 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decddea9-1bcf-425a-9395-10b1df785f8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:36.520670 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decddea9-1bcf-425a-9395-10b1df785f8a admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:36.542505 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:36.571472 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 990/1985] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:30:36 2022] POST /identity/v3/users => generated 290 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:30:36.577578 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decddea9-1bcf-425a-9395-10b1df785f8a admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:36.593017 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decddea9-1bcf-425a-9395-10b1df785f8a admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:36.600369 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc67ff-8c1c-4dfd-8cc3-de6ae4fe8d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:36.601667 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc67ff-8c1c-4dfd-8cc3-de6ae4fe8d5f admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:36.602151 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21282df1-6532-4a9f-b13c-edf6ab7b67cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:36.602842 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21282df1-6532-4a9f-b13c-edf6ab7b67cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:36.603041 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc67ff-8c1c-4dfd-8cc3-de6ae4fe8d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:36.603164 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21282df1-6532-4a9f-b13c-edf6ab7b67cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:36.603489 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21282df1-6532-4a9f-b13c-edf6ab7b67cc admin admin] PATH_INFO: `/v3/users/e73d1396de4c48c1ba0f4bafbe665f80` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:36.603776 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc67ff-8c1c-4dfd-8cc3-de6ae4fe8d5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:36.604844 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21282df1-6532-4a9f-b13c-edf6ab7b67cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e73d1396de4c48c1ba0f4bafbe665f80)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:36.605011 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bc67ff-8c1c-4dfd-8cc3-de6ae4fe8d5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:36.607111 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21282df1-6532-4a9f-b13c-edf6ab7b67cc admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:36.609404 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bc67ff-8c1c-4dfd-8cc3-de6ae4fe8d5f admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:36.639262 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 991/1986] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:30:36.645258 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc67ff-8c1c-4dfd-8cc3-de6ae4fe8d5f admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:36.672571 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc67ff-8c1c-4dfd-8cc3-de6ae4fe8d5f admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:36.688625 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf4893-0ed6-48ae-93a5-03423d63fff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:36.689277 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf4893-0ed6-48ae-93a5-03423d63fff7 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:36.689607 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf4893-0ed6-48ae-93a5-03423d63fff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:36.689841 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf4893-0ed6-48ae-93a5-03423d63fff7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:36.690750 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cf4893-0ed6-48ae-93a5-03423d63fff7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:36.693135 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cf4893-0ed6-48ae-93a5-03423d63fff7 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:36.776046 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 992/1987] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:30:36.776046 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf4893-0ed6-48ae-93a5-03423d63fff7 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:36.800867 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-21282df1-6532-4a9f-b13c-edf6ab7b67cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e73d1396de4c48c1ba0f4bafbe665f80'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:36.840465 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf4893-0ed6-48ae-93a5-03423d63fff7 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:36.843604 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-21282df1-6532-4a9f-b13c-edf6ab7b67cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e73d1396de4c48c1ba0f4bafbe665f80'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:36.854808 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93135268-8a7d-4302-8ece-03bd0a984869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:36.857082 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93135268-8a7d-4302-8ece-03bd0a984869 admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:36.857909 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93135268-8a7d-4302-8ece-03bd0a984869 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:36.858534 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93135268-8a7d-4302-8ece-03bd0a984869 admin admin] PATH_INFO: `/v3/projects/b6f800ca537b49f2ae4a3f90cede5ca5/users/2966bdb8b781457ba99c65618ce2c99a/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:36.868441 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-21282df1-6532-4a9f-b13c-edf6ab7b67cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e73d1396de4c48c1ba0f4bafbe665f80'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:36.869523 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-21282df1-6532-4a9f-b13c-edf6ab7b67cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e73d1396de4c48c1ba0f4bafbe665f80'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:36.893266 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93135268-8a7d-4302-8ece-03bd0a984869 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6f800ca537b49f2ae4a3f90cede5ca5, user_id=2966bdb8b781457ba99c65618ce2c99a, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:36.900104 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93135268-8a7d-4302-8ece-03bd0a984869 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:36.910266 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-21282df1-6532-4a9f-b13c-edf6ab7b67cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e73d1396de4c48c1ba0f4bafbe665f80'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:36.915323 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:36.925871 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 996/1988] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:30:36 2022] DELETE /identity/v3/users/e73d1396de4c48c1ba0f4bafbe665f80 => generated 0 bytes in 725 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:36.938905 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 993/1989] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:30:36 2022] PUT /identity/v3/projects/b6f800ca537b49f2ae4a3f90cede5ca5/users/2966bdb8b781457ba99c65618ce2c99a/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:36.946567 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66abe4-c35d-4d7a-82db-aebbf8f55d02 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:36.956896 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66abe4-c35d-4d7a-82db-aebbf8f55d02 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:36.957283 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc107333-0094-4813-8907-73aebf15ba21 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:36.957775 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc107333-0094-4813-8907-73aebf15ba21 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:36.957950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66abe4-c35d-4d7a-82db-aebbf8f55d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:36.958248 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc107333-0094-4813-8907-73aebf15ba21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:37.021188 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-1b66abe4-c35d-4d7a-82db-aebbf8f55d02 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:37.024101 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-1b66abe4-c35d-4d7a-82db-aebbf8f55d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:37.042969 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-cc107333-0094-4813-8907-73aebf15ba21 None None] MFA Rules not processed for user `2966bdb8b781457ba99c65618ce2c99a`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:37.045953 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-cc107333-0094-4813-8907-73aebf15ba21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:37.227452 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 997/1990] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:30:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:37.261327 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 994/1991] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:30:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:37.267614 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66abe4-c35d-4d7a-82db-aebbf8f55d02 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:37.269837 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-1b66abe4-c35d-4d7a-82db-aebbf8f55d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:37.284315 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66abe4-c35d-4d7a-82db-aebbf8f55d02 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:37.292711 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3bd538-12a1-4869-b61d-563c08816add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:37.293747 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3bd538-12a1-4869-b61d-563c08816add admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:37.294188 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3bd538-12a1-4869-b61d-563c08816add admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:37.294648 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3bd538-12a1-4869-b61d-563c08816add admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:37.295523 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3bd538-12a1-4869-b61d-563c08816add admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:37.297833 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3bd538-12a1-4869-b61d-563c08816add admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:37.324390 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc107333-0094-4813-8907-73aebf15ba21 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:37.326996 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-cc107333-0094-4813-8907-73aebf15ba21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:37.362550 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 998/1992] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:30:37 2022] POST /identity/v3/projects => generated 379 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:30:37.368830 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3bd538-12a1-4869-b61d-563c08816add admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:37.433989 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc107333-0094-4813-8907-73aebf15ba21 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:37.506622 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3bd538-12a1-4869-b61d-563c08816add admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:37.538865 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf01a4-eada-4166-b111-fe03813d1fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:37.539650 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf01a4-eada-4166-b111-fe03813d1fab admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:37.540696 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf01a4-eada-4166-b111-fe03813d1fab admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:37.542911 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf01a4-eada-4166-b111-fe03813d1fab admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:37.544894 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf01a4-eada-4166-b111-fe03813d1fab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:37.560562 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf01a4-eada-4166-b111-fe03813d1fab admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:37.581764 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f36b63-a6c8-41aa-bdd8-aeee54f40b57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:37.583090 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f36b63-a6c8-41aa-bdd8-aeee54f40b57 service neutron] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:37.583090 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f36b63-a6c8-41aa-bdd8-aeee54f40b57 service neutron] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:37.583426 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f36b63-a6c8-41aa-bdd8-aeee54f40b57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:37.602844 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:37.607674 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f36b63-a6c8-41aa-bdd8-aeee54f40b57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:37.609547 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f36b63-a6c8-41aa-bdd8-aeee54f40b57 service neutron] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:37.641382 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 999/1993] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:30:37 2022] POST /identity/v3/users => generated 296 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:30:37.641382 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf01a4-eada-4166-b111-fe03813d1fab admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:37.641382 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-1bcf01a4-eada-4166-b111-fe03813d1fab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:37.645702 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 995/1994] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:30:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:30:37.646783 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f36b63-a6c8-41aa-bdd8-aeee54f40b57 service neutron] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:37.680239 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f36b63-a6c8-41aa-bdd8-aeee54f40b57 service neutron] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:37.686322 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf01a4-eada-4166-b111-fe03813d1fab admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:37.696746 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f5a6d-40f9-4a33-a3d0-0ba350abca6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:37.697831 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f5a6d-40f9-4a33-a3d0-0ba350abca6a admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:37.698339 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f5a6d-40f9-4a33-a3d0-0ba350abca6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:37.698814 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f5a6d-40f9-4a33-a3d0-0ba350abca6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:37.699697 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1f5a6d-40f9-4a33-a3d0-0ba350abca6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:37.701800 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1f5a6d-40f9-4a33-a3d0-0ba350abca6a admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:37.704112 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c59aa2-3adb-495d-9f67-ffc75c94ca8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:37.705879 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c59aa2-3adb-495d-9f67-ffc75c94ca8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:37.706286 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c59aa2-3adb-495d-9f67-ffc75c94ca8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:37.706757 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c59aa2-3adb-495d-9f67-ffc75c94ca8c admin admin] PATH_INFO: `/v3/projects/0c65b63ddb8441d1991aeed716101750` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:37.714367 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c59aa2-3adb-495d-9f67-ffc75c94ca8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c65b63ddb8441d1991aeed716101750)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:37.716486 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c59aa2-3adb-495d-9f67-ffc75c94ca8c admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:37.751076 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 996/1995] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:30:37.752824 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f5a6d-40f9-4a33-a3d0-0ba350abca6a admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:37.779196 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f5a6d-40f9-4a33-a3d0-0ba350abca6a admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:37.796712 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c66a5-a992-46eb-9e5b-29526435feb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:37.798049 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c66a5-a992-46eb-9e5b-29526435feb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:37.798618 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c66a5-a992-46eb-9e5b-29526435feb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:37.799360 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c66a5-a992-46eb-9e5b-29526435feb2 admin admin] PATH_INFO: `/v3/projects/880d3544029f4d71bf668b68e23e5898/users/33a04e31dce8415d920918b7ada2354d/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:37.843519 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064c66a5-a992-46eb-9e5b-29526435feb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=880d3544029f4d71bf668b68e23e5898, user_id=33a04e31dce8415d920918b7ada2354d, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:37.851950 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064c66a5-a992-46eb-9e5b-29526435feb2 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:37.855247 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-89c59aa2-3adb-495d-9f67-ffc75c94ca8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c65b63ddb8441d1991aeed716101750', 'request_id': 'req-89c59aa2-3adb-495d-9f67-ffc75c94ca8c'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:37.880683 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-89c59aa2-3adb-495d-9f67-ffc75c94ca8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c65b63ddb8441d1991aeed716101750', 'request_id': 'req-89c59aa2-3adb-495d-9f67-ffc75c94ca8c'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:37.907875 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 997/1996] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:30:37 2022] PUT /identity/v3/projects/880d3544029f4d71bf668b68e23e5898/users/33a04e31dce8415d920918b7ada2354d/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:37.917423 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c66a5-a992-46eb-9e5b-29526435feb2 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:37.919224 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-89c59aa2-3adb-495d-9f67-ffc75c94ca8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c65b63ddb8441d1991aeed716101750', 'request_id': 'req-89c59aa2-3adb-495d-9f67-ffc75c94ca8c'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:37.927359 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:37.974025 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-89c59aa2-3adb-495d-9f67-ffc75c94ca8c admin admin] The token cache is being invalidate because project 0c65b63ddb8441d1991aeed716101750 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:30:37.974973 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-89c59aa2-3adb-495d-9f67-ffc75c94ca8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:37.980970 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-89c59aa2-3adb-495d-9f67-ffc75c94ca8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:37.986278 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1000/1997] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:30:37 2022] DELETE /identity/v3/projects/0c65b63ddb8441d1991aeed716101750 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:37.991832 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c59aa2-3adb-495d-9f67-ffc75c94ca8c admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:37.995122 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-89c59aa2-3adb-495d-9f67-ffc75c94ca8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:38.160636 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c66a5-a992-46eb-9e5b-29526435feb2 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:38.192759 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4459566-799e-4495-b87a-f1a489039549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:38.194786 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4459566-799e-4495-b87a-f1a489039549 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:38.197428 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4459566-799e-4495-b87a-f1a489039549 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:38.198325 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4459566-799e-4495-b87a-f1a489039549 admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:38.200936 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4459566-799e-4495-b87a-f1a489039549 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:38.211158 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4459566-799e-4495-b87a-f1a489039549 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:38.219692 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c59aa2-3adb-495d-9f67-ffc75c94ca8c admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:38.242255 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896b64b-e20f-4d59-86e0-42269ee45583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:38.246929 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896b64b-e20f-4d59-86e0-42269ee45583 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:38.248965 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896b64b-e20f-4d59-86e0-42269ee45583 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:38.249637 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896b64b-e20f-4d59-86e0-42269ee45583 admin admin] PATH_INFO: `/v3/users/777c03365343404393a292619b60b7c4` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:38.258273 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b896b64b-e20f-4d59-86e0-42269ee45583 admin admin] RBAC: Authorizing `identity:delete_user(user_id=777c03365343404393a292619b60b7c4)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:38.273052 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b896b64b-e20f-4d59-86e0-42269ee45583 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:38.273322 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 998/1998] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:30:38.275941 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4459566-799e-4495-b87a-f1a489039549 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:38.280596 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-b4459566-799e-4495-b87a-f1a489039549 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:38.314360 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4459566-799e-4495-b87a-f1a489039549 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:38.334098 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b785d5ea-d6fe-4704-ade0-c49ab8d2e5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:38.335652 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785d5ea-d6fe-4704-ade0-c49ab8d2e5a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:38.336294 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785d5ea-d6fe-4704-ade0-c49ab8d2e5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:38.336838 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785d5ea-d6fe-4704-ade0-c49ab8d2e5a0 admin admin] PATH_INFO: `/v3/projects/880d3544029f4d71bf668b68e23e5898/users/33a04e31dce8415d920918b7ada2354d/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:38.340794 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b785d5ea-d6fe-4704-ade0-c49ab8d2e5a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=880d3544029f4d71bf668b68e23e5898, user_id=33a04e31dce8415d920918b7ada2354d, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:38.346641 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b785d5ea-d6fe-4704-ade0-c49ab8d2e5a0 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:38.390023 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 999/1999] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:30:38 2022] PUT /identity/v3/projects/880d3544029f4d71bf668b68e23e5898/users/33a04e31dce8415d920918b7ada2354d/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:38.413340 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5573028-fd3c-4803-b72d-f1b5d8a55d8a None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:38.414071 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5573028-fd3c-4803-b72d-f1b5d8a55d8a None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:38.414424 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5573028-fd3c-4803-b72d-f1b5d8a55d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:38.503153 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-b896b64b-e20f-4d59-86e0-42269ee45583 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '777c03365343404393a292619b60b7c4'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:38.524685 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-b896b64b-e20f-4d59-86e0-42269ee45583 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '777c03365343404393a292619b60b7c4'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:38.547119 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-d5573028-fd3c-4803-b72d-f1b5d8a55d8a None None] MFA Rules not processed for user `33a04e31dce8415d920918b7ada2354d`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:38.548914 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-d5573028-fd3c-4803-b72d-f1b5d8a55d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:38.556362 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-b896b64b-e20f-4d59-86e0-42269ee45583 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '777c03365343404393a292619b60b7c4'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:38.559463 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-b896b64b-e20f-4d59-86e0-42269ee45583 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '777c03365343404393a292619b60b7c4'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:38.626344 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-b896b64b-e20f-4d59-86e0-42269ee45583 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '777c03365343404393a292619b60b7c4'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:38.653719 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1001/2000] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:30:37 2022] DELETE /identity/v3/users/777c03365343404393a292619b60b7c4 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:38.820860 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1000/2001] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:30:38 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:38.833948 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896b64b-e20f-4d59-86e0-42269ee45583 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:38.845986 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-b896b64b-e20f-4d59-86e0-42269ee45583 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:39.056916 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896b64b-e20f-4d59-86e0-42269ee45583 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:39.067561 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a487e-bb3a-439d-9509-a6d4bf64dfad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:39.070275 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a487e-bb3a-439d-9509-a6d4bf64dfad service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:39.072157 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a487e-bb3a-439d-9509-a6d4bf64dfad service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:39.074970 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a487e-bb3a-439d-9509-a6d4bf64dfad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:39.172997 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:39.288709 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5573028-fd3c-4803-b72d-f1b5d8a55d8a None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:39.291112 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-d5573028-fd3c-4803-b72d-f1b5d8a55d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:39.297634 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84a487e-bb3a-439d-9509-a6d4bf64dfad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:39.299863 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84a487e-bb3a-439d-9509-a6d4bf64dfad service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:39.313814 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1002/2002] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:30:38 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:30:39.446164 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a487e-bb3a-439d-9509-a6d4bf64dfad service cinder] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:39.448137 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-c84a487e-bb3a-439d-9509-a6d4bf64dfad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:39.462030 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:39.468112 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a487e-bb3a-439d-9509-a6d4bf64dfad service cinder] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:39.475947 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47189df-a580-4273-a4df-5465ffebe441 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:39.477695 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47189df-a580-4273-a4df-5465ffebe441 service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:39.478736 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47189df-a580-4273-a4df-5465ffebe441 service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:39.478917 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47189df-a580-4273-a4df-5465ffebe441 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:39.488216 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-d47189df-a580-4273-a4df-5465ffebe441 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:39.570322 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5573028-fd3c-4803-b72d-f1b5d8a55d8a None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:39.659238 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47189df-a580-4273-a4df-5465ffebe441 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:39.662011 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47189df-a580-4273-a4df-5465ffebe441 service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:39.679137 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1003/2003] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:30:39 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:30:39.723993 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47189df-a580-4273-a4df-5465ffebe441 service cinder] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:39.728713 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-d47189df-a580-4273-a4df-5465ffebe441 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:39.838671 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591dbe4c-26a8-4762-8ef4-01c5ef8a2d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:39.839837 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591dbe4c-26a8-4762-8ef4-01c5ef8a2d81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:39.840356 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591dbe4c-26a8-4762-8ef4-01c5ef8a2d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:39.843012 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591dbe4c-26a8-4762-8ef4-01c5ef8a2d81 admin admin] PATH_INFO: `/v3/projects/697f493ce42f402ba41103eb0699f61f` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:39.850159 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591dbe4c-26a8-4762-8ef4-01c5ef8a2d81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=697f493ce42f402ba41103eb0699f61f)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:39.857788 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47189df-a580-4273-a4df-5465ffebe441 service cinder] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:39.865789 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591dbe4c-26a8-4762-8ef4-01c5ef8a2d81 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:39.868450 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8ce2dc-9251-45bc-9965-f0f5cea73dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:39.869139 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ce2dc-9251-45bc-9965-f0f5cea73dde admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:39.869585 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ce2dc-9251-45bc-9965-f0f5cea73dde admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:39.869867 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ce2dc-9251-45bc-9965-f0f5cea73dde admin admin] PATH_INFO: `/v3/projects/7dedf69da77747379c9735e0fb415273` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:39.871282 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8ce2dc-9251-45bc-9965-f0f5cea73dde admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dedf69da77747379c9735e0fb415273)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:39.873756 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8ce2dc-9251-45bc-9965-f0f5cea73dde admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:40.024505 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-591dbe4c-26a8-4762-8ef4-01c5ef8a2d81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '697f493ce42f402ba41103eb0699f61f', 'request_id': 'req-591dbe4c-26a8-4762-8ef4-01c5ef8a2d81'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:40.033361 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-591dbe4c-26a8-4762-8ef4-01c5ef8a2d81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '697f493ce42f402ba41103eb0699f61f', 'request_id': 'req-591dbe4c-26a8-4762-8ef4-01c5ef8a2d81'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:40.064624 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-591dbe4c-26a8-4762-8ef4-01c5ef8a2d81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '697f493ce42f402ba41103eb0699f61f', 'request_id': 'req-591dbe4c-26a8-4762-8ef4-01c5ef8a2d81'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:40.072087 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-be8ce2dc-9251-45bc-9965-f0f5cea73dde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dedf69da77747379c9735e0fb415273', 'request_id': 'req-be8ce2dc-9251-45bc-9965-f0f5cea73dde'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:40.108942 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-be8ce2dc-9251-45bc-9965-f0f5cea73dde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dedf69da77747379c9735e0fb415273', 'request_id': 'req-be8ce2dc-9251-45bc-9965-f0f5cea73dde'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:40.111832 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-591dbe4c-26a8-4762-8ef4-01c5ef8a2d81 admin admin] The token cache is being invalidate because project 697f493ce42f402ba41103eb0699f61f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:30:40.115135 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-591dbe4c-26a8-4762-8ef4-01c5ef8a2d81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:40.120042 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-591dbe4c-26a8-4762-8ef4-01c5ef8a2d81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:40.132315 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1001/2004] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:30:39 2022] DELETE /identity/v3/projects/697f493ce42f402ba41103eb0699f61f => generated 0 bytes in 845 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:40.133080 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:40.136074 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-be8ce2dc-9251-45bc-9965-f0f5cea73dde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dedf69da77747379c9735e0fb415273', 'request_id': 'req-be8ce2dc-9251-45bc-9965-f0f5cea73dde'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:40.140484 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4003512-4ae9-485e-9207-cb4391a1e3bd None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:40.141963 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4003512-4ae9-485e-9207-cb4391a1e3bd None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:40.143857 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4003512-4ae9-485e-9207-cb4391a1e3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:40.171586 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-be8ce2dc-9251-45bc-9965-f0f5cea73dde admin admin] The token cache is being invalidate because project 7dedf69da77747379c9735e0fb415273 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:30:40.171990 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-be8ce2dc-9251-45bc-9965-f0f5cea73dde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:40.172832 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-be8ce2dc-9251-45bc-9965-f0f5cea73dde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:40.176749 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1004/2005] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:30:39 2022] DELETE /identity/v3/projects/7dedf69da77747379c9735e0fb415273 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:40.191008 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e077b56-a57f-4a68-a1da-29fa14d60163 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:40.191857 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e077b56-a57f-4a68-a1da-29fa14d60163 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:40.192323 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e077b56-a57f-4a68-a1da-29fa14d60163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:40.214222 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-b4003512-4ae9-485e-9207-cb4391a1e3bd None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:40.218095 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-b4003512-4ae9-485e-9207-cb4391a1e3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:40.288031 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-9e077b56-a57f-4a68-a1da-29fa14d60163 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:40.292366 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-9e077b56-a57f-4a68-a1da-29fa14d60163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:40.526278 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1005/2006] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:30:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:40.544396 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac877cf-8b09-469b-a937-e9477180d2a7 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:40.548023 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac877cf-8b09-469b-a937-e9477180d2a7 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:40.551151 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac877cf-8b09-469b-a937-e9477180d2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:40.602304 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1002/2007] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:30:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 457 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:40.612446 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67506e05-26c0-4d59-8ddd-d7c5e2511d2a None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:40.620065 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67506e05-26c0-4d59-8ddd-d7c5e2511d2a None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:40.620065 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67506e05-26c0-4d59-8ddd-d7c5e2511d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:40.738840 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-9ac877cf-8b09-469b-a937-e9477180d2a7 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:40.745364 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:40.756385 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-9ac877cf-8b09-469b-a937-e9477180d2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:40.845067 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-67506e05-26c0-4d59-8ddd-d7c5e2511d2a None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:40.846877 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-67506e05-26c0-4d59-8ddd-d7c5e2511d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:40.879568 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1006/2008] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:30:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:40.885968 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac877cf-8b09-469b-a937-e9477180d2a7 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:40.931639 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1003/2009] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:30:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:30:40.932096 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac877cf-8b09-469b-a937-e9477180d2a7 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:40.933319 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67506e05-26c0-4d59-8ddd-d7c5e2511d2a None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:40.964283 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a7890-5fe2-4e7e-bb1b-6d320ac38b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:40.969894 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67506e05-26c0-4d59-8ddd-d7c5e2511d2a None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:40.970140 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a7890-5fe2-4e7e-bb1b-6d320ac38b5a admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:40.974319 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a7890-5fe2-4e7e-bb1b-6d320ac38b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:40.976080 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a7890-5fe2-4e7e-bb1b-6d320ac38b5a admin admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:40.978702 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0a7890-5fe2-4e7e-bb1b-6d320ac38b5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:30:40.982477 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0a7890-5fe2-4e7e-bb1b-6d320ac38b5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:40.987769 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1199556c-7f27-4827-93e0-c6516cde3f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:40.993257 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0a7890-5fe2-4e7e-bb1b-6d320ac38b5a admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:40.995285 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1199556c-7f27-4827-93e0-c6516cde3f1a admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:40.996146 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1199556c-7f27-4827-93e0-c6516cde3f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:40.996956 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1199556c-7f27-4827-93e0-c6516cde3f1a admin admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:40.998092 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1199556c-7f27-4827-93e0-c6516cde3f1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:30:40.998612 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1199556c-7f27-4827-93e0-c6516cde3f1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:41.003470 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1199556c-7f27-4827-93e0-c6516cde3f1a admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:41.037818 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1007/2010] 10.222.0.91 () {58 vars in 1153 bytes} [Tue Aug 30 04:30:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:30:41.044389 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a7890-5fe2-4e7e-bb1b-6d320ac38b5a admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:41.066886 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a7890-5fe2-4e7e-bb1b-6d320ac38b5a admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:41.078543 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1004/2011] 10.222.0.91 () {58 vars in 1153 bytes} [Tue Aug 30 04:30:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:30:41.080348 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1199556c-7f27-4827-93e0-c6516cde3f1a admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:41.083736 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ee2aa0-5d26-4338-991b-5d1e455be6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:41.084863 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee2aa0-5d26-4338-991b-5d1e455be6a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:41.085701 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee2aa0-5d26-4338-991b-5d1e455be6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:41.086338 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee2aa0-5d26-4338-991b-5d1e455be6a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:41.087488 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ee2aa0-5d26-4338-991b-5d1e455be6a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:41.092723 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ee2aa0-5d26-4338-991b-5d1e455be6a5 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:41.121183 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1199556c-7f27-4827-93e0-c6516cde3f1a admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:41.133245 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8976cd-fbbb-4c16-ae8a-e837112f6450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:41.134138 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8976cd-fbbb-4c16-ae8a-e837112f6450 admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:41.134823 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8976cd-fbbb-4c16-ae8a-e837112f6450 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:41.135308 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8976cd-fbbb-4c16-ae8a-e837112f6450 admin admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:41.136509 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8976cd-fbbb-4c16-ae8a-e837112f6450 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:41.142010 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8976cd-fbbb-4c16-ae8a-e837112f6450 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:41.208211 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1005/2012] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:30:41 2022] POST /identity/v3/projects => generated 371 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:30:41.215046 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8976cd-fbbb-4c16-ae8a-e837112f6450 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:41.218314 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1008/2013] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:30:41 2022] POST /identity/v3/projects => generated 375 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:30:41.225799 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ee2aa0-5d26-4338-991b-5d1e455be6a5 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:41.396865 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8976cd-fbbb-4c16-ae8a-e837112f6450 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:41.401613 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ee2aa0-5d26-4338-991b-5d1e455be6a5 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:41.414543 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4810c5c-a86c-4cc1-b9a2-d2a089139136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:41.416058 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4810c5c-a86c-4cc1-b9a2-d2a089139136 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:41.416627 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4810c5c-a86c-4cc1-b9a2-d2a089139136 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:41.419019 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8cb4fc-dcb9-44f0-aad0-26110554d38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:41.419240 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4810c5c-a86c-4cc1-b9a2-d2a089139136 admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:41.420466 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4810c5c-a86c-4cc1-b9a2-d2a089139136 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:41.420801 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8cb4fc-dcb9-44f0-aad0-26110554d38d admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:41.421114 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8cb4fc-dcb9-44f0-aad0-26110554d38d admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:41.421393 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8cb4fc-dcb9-44f0-aad0-26110554d38d admin admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:41.422078 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8cb4fc-dcb9-44f0-aad0-26110554d38d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:41.424876 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4810c5c-a86c-4cc1-b9a2-d2a089139136 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:41.431680 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8cb4fc-dcb9-44f0-aad0-26110554d38d admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:41.473385 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1009/2014] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:30:41 2022] POST /identity/v3/users => generated 288 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:30:41.476223 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1006/2015] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:30:41 2022] POST /identity/v3/users => generated 286 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:30:41.479339 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4810c5c-a86c-4cc1-b9a2-d2a089139136 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:41.483475 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8cb4fc-dcb9-44f0-aad0-26110554d38d admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:41.497966 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4810c5c-a86c-4cc1-b9a2-d2a089139136 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:41.505655 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4453832b-7564-4231-a364-5284c453de74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:41.505971 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8cb4fc-dcb9-44f0-aad0-26110554d38d admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:41.506496 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4453832b-7564-4231-a364-5284c453de74 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:41.506778 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4453832b-7564-4231-a364-5284c453de74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:41.507187 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4453832b-7564-4231-a364-5284c453de74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:41.507878 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4453832b-7564-4231-a364-5284c453de74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:41.509789 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4453832b-7564-4231-a364-5284c453de74 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:41.517661 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1751cef5-4176-4e50-b943-8938455e9c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:41.519455 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751cef5-4176-4e50-b943-8938455e9c80 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:41.520315 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751cef5-4176-4e50-b943-8938455e9c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:41.520808 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751cef5-4176-4e50-b943-8938455e9c80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:41.522088 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1751cef5-4176-4e50-b943-8938455e9c80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:41.525256 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1751cef5-4176-4e50-b943-8938455e9c80 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:41.534108 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1010/2016] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:30:41 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:30:41.538477 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4453832b-7564-4231-a364-5284c453de74 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:41.548937 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1007/2017] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:30:41 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:30:41.553826 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1751cef5-4176-4e50-b943-8938455e9c80 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:41.557129 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4453832b-7564-4231-a364-5284c453de74 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:41.565632 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb549fe-67fb-444c-ad4a-ff38d82e154c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:41.567060 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb549fe-67fb-444c-ad4a-ff38d82e154c admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:41.567852 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb549fe-67fb-444c-ad4a-ff38d82e154c admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:41.568497 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb549fe-67fb-444c-ad4a-ff38d82e154c admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:41.568610 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1751cef5-4176-4e50-b943-8938455e9c80 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:41.569638 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb549fe-67fb-444c-ad4a-ff38d82e154c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:41.571944 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb549fe-67fb-444c-ad4a-ff38d82e154c admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:41.577655 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de17ca7-0988-4b44-a38b-05328f87cfcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:41.578350 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de17ca7-0988-4b44-a38b-05328f87cfcf admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:41.579458 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de17ca7-0988-4b44-a38b-05328f87cfcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:41.579742 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de17ca7-0988-4b44-a38b-05328f87cfcf admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:41.580568 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de17ca7-0988-4b44-a38b-05328f87cfcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:41.582953 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de17ca7-0988-4b44-a38b-05328f87cfcf admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:41.593535 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1011/2018] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:30:41 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:30:41.597026 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb549fe-67fb-444c-ad4a-ff38d82e154c admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:41.608438 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1008/2019] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:30:41 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:30:41.609647 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de17ca7-0988-4b44-a38b-05328f87cfcf admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:41.611538 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb549fe-67fb-444c-ad4a-ff38d82e154c admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:41.618939 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b5d848-afbd-4bd8-a32f-4d3e52062bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:41.621169 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5d848-afbd-4bd8-a32f-4d3e52062bc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:41.621960 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5d848-afbd-4bd8-a32f-4d3e52062bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:41.622380 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5d848-afbd-4bd8-a32f-4d3e52062bc5 admin admin] PATH_INFO: `/v3/projects/40a006662b86417ca2c5b846268e271c/users/eab8453bb3014dd3ba8b269f4d8949ee/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:41.627981 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de17ca7-0988-4b44-a38b-05328f87cfcf admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:41.642080 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e9e75-5dc4-46a7-abe5-7cd3c58797a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:41.642862 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e9e75-5dc4-46a7-abe5-7cd3c58797a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:41.643137 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e9e75-5dc4-46a7-abe5-7cd3c58797a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:41.643515 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e9e75-5dc4-46a7-abe5-7cd3c58797a8 admin admin] PATH_INFO: `/v3/projects/2d111af148f74f0c879c80c3c1362fa6/users/38ae8826cf63480192553823e830591f/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:41.653493 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:41.663386 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b5d848-afbd-4bd8-a32f-4d3e52062bc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40a006662b86417ca2c5b846268e271c, user_id=eab8453bb3014dd3ba8b269f4d8949ee, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:41.670741 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2e9e75-5dc4-46a7-abe5-7cd3c58797a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d111af148f74f0c879c80c3c1362fa6, user_id=38ae8826cf63480192553823e830591f, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:41.674742 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2e9e75-5dc4-46a7-abe5-7cd3c58797a8 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:41.678594 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b5d848-afbd-4bd8-a32f-4d3e52062bc5 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:41.699245 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1009/2020] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:30:41 2022] PUT /identity/v3/projects/2d111af148f74f0c879c80c3c1362fa6/users/38ae8826cf63480192553823e830591f/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:41.712310 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93475e-ddf3-4e02-8e8c-fb894f598946 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:41.712655 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93475e-ddf3-4e02-8e8c-fb894f598946 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:41.712877 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93475e-ddf3-4e02-8e8c-fb894f598946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:41.723305 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1012/2021] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:30:41 2022] PUT /identity/v3/projects/40a006662b86417ca2c5b846268e271c/users/eab8453bb3014dd3ba8b269f4d8949ee/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:30:41.736702 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9587eed-42ce-4622-8ef5-e05412d3174d None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:41.737238 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9587eed-42ce-4622-8ef5-e05412d3174d None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:41.737720 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9587eed-42ce-4622-8ef5-e05412d3174d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:41.765587 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-8d93475e-ddf3-4e02-8e8c-fb894f598946 None None] MFA Rules not processed for user `38ae8826cf63480192553823e830591f`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:41.767743 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-8d93475e-ddf3-4e02-8e8c-fb894f598946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:41.803731 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-d9587eed-42ce-4622-8ef5-e05412d3174d None None] MFA Rules not processed for user `eab8453bb3014dd3ba8b269f4d8949ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:41.806505 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-d9587eed-42ce-4622-8ef5-e05412d3174d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:41.979503 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:41.990108 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1013/2022] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:30:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:42.015484 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1010/2023] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:30:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:42.023814 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9587eed-42ce-4622-8ef5-e05412d3174d None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:42.026160 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-d9587eed-42ce-4622-8ef5-e05412d3174d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:42.039321 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d93475e-ddf3-4e02-8e8c-fb894f598946 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:42.043036 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-8d93475e-ddf3-4e02-8e8c-fb894f598946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:42.209951 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d93475e-ddf3-4e02-8e8c-fb894f598946 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:42.219747 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c48c92-06f4-4eda-a2a4-343758cf5193 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:42.220448 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c48c92-06f4-4eda-a2a4-343758cf5193 service cinder] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:42.221512 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c48c92-06f4-4eda-a2a4-343758cf5193 service cinder] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:42.221811 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c48c92-06f4-4eda-a2a4-343758cf5193 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:42.251376 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c48c92-06f4-4eda-a2a4-343758cf5193 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:42.253121 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c48c92-06f4-4eda-a2a4-343758cf5193 service cinder] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:42.273753 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9587eed-42ce-4622-8ef5-e05412d3174d None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:42.287061 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f513f031-c961-46ab-872d-a523e2b6bc1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:42.287972 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f513f031-c961-46ab-872d-a523e2b6bc1e service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:42.288129 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f513f031-c961-46ab-872d-a523e2b6bc1e service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:42.288645 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f513f031-c961-46ab-872d-a523e2b6bc1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:42.302356 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1011/2024] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:30:42 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:30:42.321283 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f513f031-c961-46ab-872d-a523e2b6bc1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:42.323199 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f513f031-c961-46ab-872d-a523e2b6bc1e service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:42.348254 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1014/2025] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:30:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:30:42.370267 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c48c92-06f4-4eda-a2a4-343758cf5193 service cinder] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:42.572741 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c48c92-06f4-4eda-a2a4-343758cf5193 service cinder] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:42.591276 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283f778d-5e08-4ebd-9374-ba91fa81141c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:42.591276 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f778d-5e08-4ebd-9374-ba91fa81141c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:42.592172 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f778d-5e08-4ebd-9374-ba91fa81141c admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:42.592482 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f778d-5e08-4ebd-9374-ba91fa81141c admin admin] PATH_INFO: `/v3/users/38ae8826cf63480192553823e830591f` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:42.595041 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283f778d-5e08-4ebd-9374-ba91fa81141c admin admin] RBAC: Authorizing `identity:delete_user(user_id=38ae8826cf63480192553823e830591f)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:42.603449 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283f778d-5e08-4ebd-9374-ba91fa81141c admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:42.800903 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-283f778d-5e08-4ebd-9374-ba91fa81141c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38ae8826cf63480192553823e830591f'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:42.808006 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-283f778d-5e08-4ebd-9374-ba91fa81141c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38ae8826cf63480192553823e830591f'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:42.811110 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-283f778d-5e08-4ebd-9374-ba91fa81141c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38ae8826cf63480192553823e830591f'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:42.847807 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-283f778d-5e08-4ebd-9374-ba91fa81141c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38ae8826cf63480192553823e830591f'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:42.878290 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-283f778d-5e08-4ebd-9374-ba91fa81141c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38ae8826cf63480192553823e830591f'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:42.898431 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1012/2026] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:30:42 2022] DELETE /identity/v3/users/38ae8826cf63480192553823e830591f => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:42.903100 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfda128-831d-4732-9d4f-f3daead288a0 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:42.903525 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfda128-831d-4732-9d4f-f3daead288a0 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:42.903976 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfda128-831d-4732-9d4f-f3daead288a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:42.983562 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-cbfda128-831d-4732-9d4f-f3daead288a0 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:42.988281 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-cbfda128-831d-4732-9d4f-f3daead288a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:43.266058 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1015/2027] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:30:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:43.409738 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283f778d-5e08-4ebd-9374-ba91fa81141c admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:43.413969 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-283f778d-5e08-4ebd-9374-ba91fa81141c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:43.506807 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:43.611102 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283f778d-5e08-4ebd-9374-ba91fa81141c admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:43.618453 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c2856-26dc-4b93-9467-8492fa275af1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:43.619110 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c2856-26dc-4b93-9467-8492fa275af1 service neutron] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:43.619465 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c2856-26dc-4b93-9467-8492fa275af1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:43.619743 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c2856-26dc-4b93-9467-8492fa275af1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:43.635234 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413c2856-26dc-4b93-9467-8492fa275af1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:43.636916 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413c2856-26dc-4b93-9467-8492fa275af1 service neutron] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:43.654750 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1013/2028] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:30:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:30:44.405845 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfda128-831d-4732-9d4f-f3daead288a0 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:44.408313 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-cbfda128-831d-4732-9d4f-f3daead288a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:44.446507 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfda128-831d-4732-9d4f-f3daead288a0 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:44.453147 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146bcdb1-4fe7-4562-ae58-cfad166f2f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:44.454286 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146bcdb1-4fe7-4562-ae58-cfad166f2f37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:44.455059 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146bcdb1-4fe7-4562-ae58-cfad166f2f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:44.456560 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146bcdb1-4fe7-4562-ae58-cfad166f2f37 admin admin] PATH_INFO: `/v3/projects/2d111af148f74f0c879c80c3c1362fa6` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:44.472644 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146bcdb1-4fe7-4562-ae58-cfad166f2f37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d111af148f74f0c879c80c3c1362fa6)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:44.479306 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146bcdb1-4fe7-4562-ae58-cfad166f2f37 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:44.515126 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:44.555766 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-146bcdb1-4fe7-4562-ae58-cfad166f2f37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d111af148f74f0c879c80c3c1362fa6', 'request_id': 'req-146bcdb1-4fe7-4562-ae58-cfad166f2f37'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:44.563734 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-146bcdb1-4fe7-4562-ae58-cfad166f2f37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d111af148f74f0c879c80c3c1362fa6', 'request_id': 'req-146bcdb1-4fe7-4562-ae58-cfad166f2f37'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:44.575779 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-146bcdb1-4fe7-4562-ae58-cfad166f2f37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d111af148f74f0c879c80c3c1362fa6', 'request_id': 'req-146bcdb1-4fe7-4562-ae58-cfad166f2f37'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:44.603436 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-146bcdb1-4fe7-4562-ae58-cfad166f2f37 admin admin] The token cache is being invalidate because project 2d111af148f74f0c879c80c3c1362fa6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:30:44.603436 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-146bcdb1-4fe7-4562-ae58-cfad166f2f37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:44.603820 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-146bcdb1-4fe7-4562-ae58-cfad166f2f37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:44.610440 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1016/2029] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:30:44 2022] DELETE /identity/v3/projects/2d111af148f74f0c879c80c3c1362fa6 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:44.613045 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad61ab6-edc0-4993-b1d4-8a9642d2fb44 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:44.613490 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad61ab6-edc0-4993-b1d4-8a9642d2fb44 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:44.614116 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad61ab6-edc0-4993-b1d4-8a9642d2fb44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:44.708412 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-8ad61ab6-edc0-4993-b1d4-8a9642d2fb44 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:44.711130 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-8ad61ab6-edc0-4993-b1d4-8a9642d2fb44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:44.857503 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1014/2030] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:30:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:44.871690 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f6c3f-dec3-424e-94e2-5eea8f0b91f5 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:44.872447 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f6c3f-dec3-424e-94e2-5eea8f0b91f5 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:44.872727 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f6c3f-dec3-424e-94e2-5eea8f0b91f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:44.933963 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad61ab6-edc0-4993-b1d4-8a9642d2fb44 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:44.935848 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-8ad61ab6-edc0-4993-b1d4-8a9642d2fb44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:44.951789 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-c57f6c3f-dec3-424e-94e2-5eea8f0b91f5 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:44.959893 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-c57f6c3f-dec3-424e-94e2-5eea8f0b91f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:44.965134 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad61ab6-edc0-4993-b1d4-8a9642d2fb44 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:44.987668 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d47048-4003-4dc4-849e-e22cefa6ffe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:44.992684 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d47048-4003-4dc4-849e-e22cefa6ffe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:44.996472 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1017/2031] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:30:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:44.999196 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d47048-4003-4dc4-849e-e22cefa6ffe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:44.999661 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d47048-4003-4dc4-849e-e22cefa6ffe0 admin admin] PATH_INFO: `/v3/users/e374b7ba51ab4bf1a5076ef4d8ef8dcb` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:45.002734 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f6c3f-dec3-424e-94e2-5eea8f0b91f5 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:45.005556 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d47048-4003-4dc4-849e-e22cefa6ffe0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e374b7ba51ab4bf1a5076ef4d8ef8dcb)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:45.032289 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d47048-4003-4dc4-849e-e22cefa6ffe0 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:45.041119 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f6c3f-dec3-424e-94e2-5eea8f0b91f5 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:45.061942 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64880033-734a-482a-b525-a74fe5f2b500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:45.063050 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64880033-734a-482a-b525-a74fe5f2b500 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:45.067581 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64880033-734a-482a-b525-a74fe5f2b500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:45.068204 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64880033-734a-482a-b525-a74fe5f2b500 admin admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:45.069970 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64880033-734a-482a-b525-a74fe5f2b500 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:30:45.076107 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64880033-734a-482a-b525-a74fe5f2b500 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:45.079443 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64880033-734a-482a-b525-a74fe5f2b500 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:45.127099 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1018/2032] 10.222.0.91 () {58 vars in 1153 bytes} [Tue Aug 30 04:30:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:30:45.135208 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64880033-734a-482a-b525-a74fe5f2b500 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:45.181815 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64880033-734a-482a-b525-a74fe5f2b500 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:45.213009 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfbc0b5-0109-4cb5-949b-3a4642da8454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:45.214074 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfbc0b5-0109-4cb5-949b-3a4642da8454 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:45.214575 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfbc0b5-0109-4cb5-949b-3a4642da8454 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:45.215177 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfbc0b5-0109-4cb5-949b-3a4642da8454 admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:45.216531 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfbc0b5-0109-4cb5-949b-3a4642da8454 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:45.220379 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfbc0b5-0109-4cb5-949b-3a4642da8454 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:45.221528 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-65d47048-4003-4dc4-849e-e22cefa6ffe0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e374b7ba51ab4bf1a5076ef4d8ef8dcb'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:45.224256 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-65d47048-4003-4dc4-849e-e22cefa6ffe0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e374b7ba51ab4bf1a5076ef4d8ef8dcb'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:45.228676 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-65d47048-4003-4dc4-849e-e22cefa6ffe0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e374b7ba51ab4bf1a5076ef4d8ef8dcb'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:45.250967 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-65d47048-4003-4dc4-849e-e22cefa6ffe0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e374b7ba51ab4bf1a5076ef4d8ef8dcb'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:45.282318 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-65d47048-4003-4dc4-849e-e22cefa6ffe0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e374b7ba51ab4bf1a5076ef4d8ef8dcb'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:45.310446 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1015/2033] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:30:44 2022] DELETE /identity/v3/users/e374b7ba51ab4bf1a5076ef4d8ef8dcb => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:45.316752 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1019/2034] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:30:45 2022] POST /identity/v3/projects => generated 383 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:30:45.318276 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5347bc-1b32-4edf-8ce9-fe8f372723cc None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:45.318597 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5347bc-1b32-4edf-8ce9-fe8f372723cc None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:45.318853 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5347bc-1b32-4edf-8ce9-fe8f372723cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:45.321005 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfbc0b5-0109-4cb5-949b-3a4642da8454 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:45.325108 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-9bfbc0b5-0109-4cb5-949b-3a4642da8454 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:45.373631 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-da5347bc-1b32-4edf-8ce9-fe8f372723cc None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:45.377517 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-da5347bc-1b32-4edf-8ce9-fe8f372723cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:45.448910 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfbc0b5-0109-4cb5-949b-3a4642da8454 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:45.452764 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:45.458852 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19655317-0dd0-49c1-a06e-0eece5d0c798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:45.459590 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19655317-0dd0-49c1-a06e-0eece5d0c798 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:45.459872 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19655317-0dd0-49c1-a06e-0eece5d0c798 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:45.460178 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19655317-0dd0-49c1-a06e-0eece5d0c798 admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:45.461034 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19655317-0dd0-49c1-a06e-0eece5d0c798 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:45.463443 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19655317-0dd0-49c1-a06e-0eece5d0c798 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:45.498198 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1020/2035] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:30:45 2022] POST /identity/v3/users => generated 292 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:30:45.505908 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19655317-0dd0-49c1-a06e-0eece5d0c798 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:45.514118 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1016/2036] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:30:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:45.521317 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5347bc-1b32-4edf-8ce9-fe8f372723cc None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:45.524520 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-da5347bc-1b32-4edf-8ce9-fe8f372723cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:45.531839 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19655317-0dd0-49c1-a06e-0eece5d0c798 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:45.559444 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e9ba18-0cf7-4dbe-8716-5dce4f67d6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:45.560916 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9ba18-0cf7-4dbe-8716-5dce4f67d6fd admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:45.561316 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9ba18-0cf7-4dbe-8716-5dce4f67d6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:45.561802 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9ba18-0cf7-4dbe-8716-5dce4f67d6fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:45.563023 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e9ba18-0cf7-4dbe-8716-5dce4f67d6fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:45.566336 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e9ba18-0cf7-4dbe-8716-5dce4f67d6fd admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:45.610192 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1021/2037] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:30:45.622590 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e9ba18-0cf7-4dbe-8716-5dce4f67d6fd admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:45.646711 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e9ba18-0cf7-4dbe-8716-5dce4f67d6fd admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:45.658100 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d16e7-d173-4019-b41c-bce6e417d9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:45.658842 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d16e7-d173-4019-b41c-bce6e417d9f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:45.658969 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5347bc-1b32-4edf-8ce9-fe8f372723cc None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:45.659646 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d16e7-d173-4019-b41c-bce6e417d9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:45.659646 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d16e7-d173-4019-b41c-bce6e417d9f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:45.660240 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314d16e7-d173-4019-b41c-bce6e417d9f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:45.662235 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314d16e7-d173-4019-b41c-bce6e417d9f1 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:45.664525 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6e875d-b6cc-4f48-aed8-12c36ebb4121 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:45.665675 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e875d-b6cc-4f48-aed8-12c36ebb4121 service neutron] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:45.666066 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e875d-b6cc-4f48-aed8-12c36ebb4121 service neutron] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:45.667078 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e875d-b6cc-4f48-aed8-12c36ebb4121 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:45.677755 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1022/2038] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:30:45.683075 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d16e7-d173-4019-b41c-bce6e417d9f1 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:45.685688 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6e875d-b6cc-4f48-aed8-12c36ebb4121 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:45.688415 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6e875d-b6cc-4f48-aed8-12c36ebb4121 service neutron] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:45.698931 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d16e7-d173-4019-b41c-bce6e417d9f1 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:45.708065 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313e7482-f603-4f0b-8456-2131c78b0f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:45.709276 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e7482-f603-4f0b-8456-2131c78b0f90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:45.709737 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e7482-f603-4f0b-8456-2131c78b0f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:45.710951 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e7482-f603-4f0b-8456-2131c78b0f90 admin admin] PATH_INFO: `/v3/projects/9322fbe1939b46c3aee2418884f81e9a/users/f237249974584d938baf71727ea3a162/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:45.711743 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1017/2039] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:30:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:30:45.739989 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313e7482-f603-4f0b-8456-2131c78b0f90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9322fbe1939b46c3aee2418884f81e9a, user_id=f237249974584d938baf71727ea3a162, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:45.744176 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313e7482-f603-4f0b-8456-2131c78b0f90 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:45.764452 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1023/2040] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:30:45 2022] PUT /identity/v3/projects/9322fbe1939b46c3aee2418884f81e9a/users/f237249974584d938baf71727ea3a162/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:45.771502 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952c6ca-375c-4366-ba17-a53242ec20e7 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:45.772003 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952c6ca-375c-4366-ba17-a53242ec20e7 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:45.772471 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952c6ca-375c-4366-ba17-a53242ec20e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:45.800667 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-0952c6ca-375c-4366-ba17-a53242ec20e7 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:45.802577 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-0952c6ca-375c-4366-ba17-a53242ec20e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:45.942943 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1018/2041] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:30:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:45.969770 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313e7482-f603-4f0b-8456-2131c78b0f90 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:46.003043 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:46.161841 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313e7482-f603-4f0b-8456-2131c78b0f90 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:46.180875 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b15354c-7c4b-44f8-a666-f14ad06728e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:46.181674 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15354c-7c4b-44f8-a666-f14ad06728e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:46.182081 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15354c-7c4b-44f8-a666-f14ad06728e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:46.182538 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15354c-7c4b-44f8-a666-f14ad06728e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:46.202234 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b15354c-7c4b-44f8-a666-f14ad06728e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:46.205368 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b15354c-7c4b-44f8-a666-f14ad06728e1 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:46.227810 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1024/2042] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:30:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:30:46.361207 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0952c6ca-375c-4366-ba17-a53242ec20e7 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:46.363076 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-0952c6ca-375c-4366-ba17-a53242ec20e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:46.391024 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0952c6ca-375c-4366-ba17-a53242ec20e7 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:46.414027 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1099b3-7dc6-47ee-b968-2c9f15f39be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:46.414706 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1099b3-7dc6-47ee-b968-2c9f15f39be3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:46.415539 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1099b3-7dc6-47ee-b968-2c9f15f39be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:46.415539 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1099b3-7dc6-47ee-b968-2c9f15f39be3 admin admin] PATH_INFO: `/v3/projects/67dcbd1b18464dbbb33bb4674f661018` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:46.417212 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1099b3-7dc6-47ee-b968-2c9f15f39be3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67dcbd1b18464dbbb33bb4674f661018)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:46.419341 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1099b3-7dc6-47ee-b968-2c9f15f39be3 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:46.606249 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-fd1099b3-7dc6-47ee-b968-2c9f15f39be3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67dcbd1b18464dbbb33bb4674f661018', 'request_id': 'req-fd1099b3-7dc6-47ee-b968-2c9f15f39be3'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:46.658555 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-fd1099b3-7dc6-47ee-b968-2c9f15f39be3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67dcbd1b18464dbbb33bb4674f661018', 'request_id': 'req-fd1099b3-7dc6-47ee-b968-2c9f15f39be3'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:46.689707 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-fd1099b3-7dc6-47ee-b968-2c9f15f39be3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67dcbd1b18464dbbb33bb4674f661018', 'request_id': 'req-fd1099b3-7dc6-47ee-b968-2c9f15f39be3'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:46.710359 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-fd1099b3-7dc6-47ee-b968-2c9f15f39be3 admin admin] The token cache is being invalidate because project 67dcbd1b18464dbbb33bb4674f661018 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:30:46.710965 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-fd1099b3-7dc6-47ee-b968-2c9f15f39be3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:46.712079 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-fd1099b3-7dc6-47ee-b968-2c9f15f39be3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:46.714536 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1019/2043] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:30:46 2022] DELETE /identity/v3/projects/67dcbd1b18464dbbb33bb4674f661018 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:46.720062 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b15354c-7c4b-44f8-a666-f14ad06728e1 service neutron] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:46.733969 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b15354c-7c4b-44f8-a666-f14ad06728e1 service neutron] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:46.935286 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6302e4-1ed9-4ddb-84c0-07155faaec5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:46.936126 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6302e4-1ed9-4ddb-84c0-07155faaec5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:46.936409 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6302e4-1ed9-4ddb-84c0-07155faaec5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:46.936754 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6302e4-1ed9-4ddb-84c0-07155faaec5a admin admin] PATH_INFO: `/v3/users/2966bdb8b781457ba99c65618ce2c99a` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:46.938459 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6302e4-1ed9-4ddb-84c0-07155faaec5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2966bdb8b781457ba99c65618ce2c99a)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:46.942573 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6302e4-1ed9-4ddb-84c0-07155faaec5a admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:47.040555 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-cd6302e4-1ed9-4ddb-84c0-07155faaec5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2966bdb8b781457ba99c65618ce2c99a'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:47.063495 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-cd6302e4-1ed9-4ddb-84c0-07155faaec5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2966bdb8b781457ba99c65618ce2c99a'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:47.080073 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-cd6302e4-1ed9-4ddb-84c0-07155faaec5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2966bdb8b781457ba99c65618ce2c99a'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:47.083237 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-cd6302e4-1ed9-4ddb-84c0-07155faaec5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2966bdb8b781457ba99c65618ce2c99a'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:47.103179 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-cd6302e4-1ed9-4ddb-84c0-07155faaec5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2966bdb8b781457ba99c65618ce2c99a'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:47.119454 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1025/2044] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:30:46 2022] DELETE /identity/v3/users/2966bdb8b781457ba99c65618ce2c99a => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:47.969526 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1099b3-7dc6-47ee-b968-2c9f15f39be3 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:47.974404 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-fd1099b3-7dc6-47ee-b968-2c9f15f39be3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:48.020817 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:48.048439 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1099b3-7dc6-47ee-b968-2c9f15f39be3 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:48.286874 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a5777-bb9c-4170-b44c-5b1bdee65ef2 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:48.289730 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a5777-bb9c-4170-b44c-5b1bdee65ef2 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:48.289730 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a5777-bb9c-4170-b44c-5b1bdee65ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:48.327509 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36295486-d041-45c5-810a-09f8b243b4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:48.342959 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36295486-d041-45c5-810a-09f8b243b4e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:48.344121 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36295486-d041-45c5-810a-09f8b243b4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:48.344947 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36295486-d041-45c5-810a-09f8b243b4e8 admin admin] PATH_INFO: `/v3/projects/b6f800ca537b49f2ae4a3f90cede5ca5` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:48.347327 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36295486-d041-45c5-810a-09f8b243b4e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6f800ca537b49f2ae4a3f90cede5ca5)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:48.366934 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-980a5777-bb9c-4170-b44c-5b1bdee65ef2 None None] MFA Rules not processed for user `f237249974584d938baf71727ea3a162`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:48.368651 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-980a5777-bb9c-4170-b44c-5b1bdee65ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:48.368824 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36295486-d041-45c5-810a-09f8b243b4e8 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:48.402681 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:48.598436 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1026/2045] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:30:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:48.656314 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980a5777-bb9c-4170-b44c-5b1bdee65ef2 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:48.658033 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-980a5777-bb9c-4170-b44c-5b1bdee65ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:48.698818 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-36295486-d041-45c5-810a-09f8b243b4e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6f800ca537b49f2ae4a3f90cede5ca5', 'request_id': 'req-36295486-d041-45c5-810a-09f8b243b4e8'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:48.714107 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-36295486-d041-45c5-810a-09f8b243b4e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6f800ca537b49f2ae4a3f90cede5ca5', 'request_id': 'req-36295486-d041-45c5-810a-09f8b243b4e8'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:48.731704 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-36295486-d041-45c5-810a-09f8b243b4e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6f800ca537b49f2ae4a3f90cede5ca5', 'request_id': 'req-36295486-d041-45c5-810a-09f8b243b4e8'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:48.758682 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-36295486-d041-45c5-810a-09f8b243b4e8 admin admin] The token cache is being invalidate because project b6f800ca537b49f2ae4a3f90cede5ca5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:30:48.758682 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-36295486-d041-45c5-810a-09f8b243b4e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:48.762662 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-36295486-d041-45c5-810a-09f8b243b4e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:48.770536 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1020/2046] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:30:47 2022] DELETE /identity/v3/projects/b6f800ca537b49f2ae4a3f90cede5ca5 => generated 0 bytes in 803 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:48.777488 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36295486-d041-45c5-810a-09f8b243b4e8 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:48.780865 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-36295486-d041-45c5-810a-09f8b243b4e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:48.810907 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980a5777-bb9c-4170-b44c-5b1bdee65ef2 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:48.891286 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519eb8cf-3db1-4313-a35e-ea51f20cad74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:48.891946 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519eb8cf-3db1-4313-a35e-ea51f20cad74 service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:48.892384 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519eb8cf-3db1-4313-a35e-ea51f20cad74 service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:48.892656 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519eb8cf-3db1-4313-a35e-ea51f20cad74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:48.894870 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-519eb8cf-3db1-4313-a35e-ea51f20cad74 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:48.909999 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36295486-d041-45c5-810a-09f8b243b4e8 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:48.920426 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7406b11b-99f2-4fa8-8a43-cee70485962e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:48.921954 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406b11b-99f2-4fa8-8a43-cee70485962e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:48.922669 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406b11b-99f2-4fa8-8a43-cee70485962e admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:48.923187 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406b11b-99f2-4fa8-8a43-cee70485962e admin admin] PATH_INFO: `/v3/users/33a04e31dce8415d920918b7ada2354d` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:48.926170 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7406b11b-99f2-4fa8-8a43-cee70485962e admin admin] RBAC: Authorizing `identity:delete_user(user_id=33a04e31dce8415d920918b7ada2354d)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:48.930389 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7406b11b-99f2-4fa8-8a43-cee70485962e admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:49.010297 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519eb8cf-3db1-4313-a35e-ea51f20cad74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:49.015830 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519eb8cf-3db1-4313-a35e-ea51f20cad74 service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:49.047534 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1027/2047] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:30:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:30:49.066789 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:49.098887 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-7406b11b-99f2-4fa8-8a43-cee70485962e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33a04e31dce8415d920918b7ada2354d'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:49.115281 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-7406b11b-99f2-4fa8-8a43-cee70485962e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33a04e31dce8415d920918b7ada2354d'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:49.118375 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-7406b11b-99f2-4fa8-8a43-cee70485962e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33a04e31dce8415d920918b7ada2354d'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:49.151086 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-7406b11b-99f2-4fa8-8a43-cee70485962e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33a04e31dce8415d920918b7ada2354d'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:49.242406 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-7406b11b-99f2-4fa8-8a43-cee70485962e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33a04e31dce8415d920918b7ada2354d'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:49.258311 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519eb8cf-3db1-4313-a35e-ea51f20cad74 service cinder] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:49.261251 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-519eb8cf-3db1-4313-a35e-ea51f20cad74 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:49.284560 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1021/2048] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:30:48 2022] DELETE /identity/v3/users/33a04e31dce8415d920918b7ada2354d => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:49.293213 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519eb8cf-3db1-4313-a35e-ea51f20cad74 service cinder] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:49.396243 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:49.471343 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d61294-1d6c-4174-b585-b2b22dd28668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:49.472776 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d61294-1d6c-4174-b585-b2b22dd28668 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:49.473240 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d61294-1d6c-4174-b585-b2b22dd28668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:49.473572 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d61294-1d6c-4174-b585-b2b22dd28668 admin admin] PATH_INFO: `/v3/users/364abb1a054f45c3b95ac2f5714763a0` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:49.476147 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d61294-1d6c-4174-b585-b2b22dd28668 admin admin] RBAC: Authorizing `identity:delete_user(user_id=364abb1a054f45c3b95ac2f5714763a0)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:49.479904 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d61294-1d6c-4174-b585-b2b22dd28668 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:49.580008 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-c2d61294-1d6c-4174-b585-b2b22dd28668 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '364abb1a054f45c3b95ac2f5714763a0'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:49.600596 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-c2d61294-1d6c-4174-b585-b2b22dd28668 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '364abb1a054f45c3b95ac2f5714763a0'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:49.622849 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-c2d61294-1d6c-4174-b585-b2b22dd28668 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '364abb1a054f45c3b95ac2f5714763a0'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:49.625203 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-c2d61294-1d6c-4174-b585-b2b22dd28668 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '364abb1a054f45c3b95ac2f5714763a0'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:49.686069 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-c2d61294-1d6c-4174-b585-b2b22dd28668 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '364abb1a054f45c3b95ac2f5714763a0'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:49.700254 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1028/2049] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:30:49 2022] DELETE /identity/v3/users/364abb1a054f45c3b95ac2f5714763a0 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:30:49.906298 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7406b11b-99f2-4fa8-8a43-cee70485962e admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:49.908576 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-7406b11b-99f2-4fa8-8a43-cee70485962e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:49.930231 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7406b11b-99f2-4fa8-8a43-cee70485962e admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:50.043135 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a5cb5-cdf8-450c-8d19-7c637f47653e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:50.044290 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a5cb5-cdf8-450c-8d19-7c637f47653e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:50.045443 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a5cb5-cdf8-450c-8d19-7c637f47653e admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:50.045941 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a5cb5-cdf8-450c-8d19-7c637f47653e admin admin] PATH_INFO: `/v3/projects/880d3544029f4d71bf668b68e23e5898` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:50.047651 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219a5cb5-cdf8-450c-8d19-7c637f47653e admin admin] RBAC: Authorizing `identity:delete_project(project_id=880d3544029f4d71bf668b68e23e5898)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:50.050348 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219a5cb5-cdf8-450c-8d19-7c637f47653e admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:50.138301 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d61294-1d6c-4174-b585-b2b22dd28668 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:50.141890 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-c2d61294-1d6c-4174-b585-b2b22dd28668 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:50.164218 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d61294-1d6c-4174-b585-b2b22dd28668 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:50.171364 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-219a5cb5-cdf8-450c-8d19-7c637f47653e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '880d3544029f4d71bf668b68e23e5898', 'request_id': 'req-219a5cb5-cdf8-450c-8d19-7c637f47653e'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:50.181493 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-219a5cb5-cdf8-450c-8d19-7c637f47653e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '880d3544029f4d71bf668b68e23e5898', 'request_id': 'req-219a5cb5-cdf8-450c-8d19-7c637f47653e'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:50.194106 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-219a5cb5-cdf8-450c-8d19-7c637f47653e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '880d3544029f4d71bf668b68e23e5898', 'request_id': 'req-219a5cb5-cdf8-450c-8d19-7c637f47653e'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:50.218517 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-219a5cb5-cdf8-450c-8d19-7c637f47653e admin admin] The token cache is being invalidate because project 880d3544029f4d71bf668b68e23e5898 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:30:50.219228 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-219a5cb5-cdf8-450c-8d19-7c637f47653e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:50.220577 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-219a5cb5-cdf8-450c-8d19-7c637f47653e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:50.224547 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1022/2050] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:30:49 2022] DELETE /identity/v3/projects/880d3544029f4d71bf668b68e23e5898 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:50.233902 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b7510-2bbf-40ba-bbbf-7865fdfafa5c None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:50.234312 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b7510-2bbf-40ba-bbbf-7865fdfafa5c None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:50.234623 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b7510-2bbf-40ba-bbbf-7865fdfafa5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:50.255290 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7a2c0a-8a4e-4e26-b805-ef5e1d5cb223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:50.258583 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a2c0a-8a4e-4e26-b805-ef5e1d5cb223 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:50.259241 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a2c0a-8a4e-4e26-b805-ef5e1d5cb223 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:50.260382 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a2c0a-8a4e-4e26-b805-ef5e1d5cb223 admin admin] PATH_INFO: `/v3/projects/0a8ee9d47bc94efca1f8c216349b0809` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:50.262779 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7a2c0a-8a4e-4e26-b805-ef5e1d5cb223 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a8ee9d47bc94efca1f8c216349b0809)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:50.267955 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-838b7510-2bbf-40ba-bbbf-7865fdfafa5c None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:50.268786 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7a2c0a-8a4e-4e26-b805-ef5e1d5cb223 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:50.270127 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-838b7510-2bbf-40ba-bbbf-7865fdfafa5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:50.288903 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1023/2051] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:30:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:30:50.303574 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b22d53-06e4-4a8b-a849-4a0c5107f28e None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:50.304093 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b22d53-06e4-4a8b-a849-4a0c5107f28e None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:50.304440 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b22d53-06e4-4a8b-a849-4a0c5107f28e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:50.337856 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-18b22d53-06e4-4a8b-a849-4a0c5107f28e None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:50.339229 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-18b22d53-06e4-4a8b-a849-4a0c5107f28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:50.352886 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-db7a2c0a-8a4e-4e26-b805-ef5e1d5cb223 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a8ee9d47bc94efca1f8c216349b0809', 'request_id': 'req-db7a2c0a-8a4e-4e26-b805-ef5e1d5cb223'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:50.356009 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:50.365783 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-db7a2c0a-8a4e-4e26-b805-ef5e1d5cb223 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a8ee9d47bc94efca1f8c216349b0809', 'request_id': 'req-db7a2c0a-8a4e-4e26-b805-ef5e1d5cb223'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:50.380373 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-db7a2c0a-8a4e-4e26-b805-ef5e1d5cb223 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a8ee9d47bc94efca1f8c216349b0809', 'request_id': 'req-db7a2c0a-8a4e-4e26-b805-ef5e1d5cb223'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:50.396659 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:50.402118 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-db7a2c0a-8a4e-4e26-b805-ef5e1d5cb223 admin admin] The token cache is being invalidate because project 0a8ee9d47bc94efca1f8c216349b0809 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:30:50.402408 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-db7a2c0a-8a4e-4e26-b805-ef5e1d5cb223 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:50.403211 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-db7a2c0a-8a4e-4e26-b805-ef5e1d5cb223 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:50.405129 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1029/2052] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:30:50 2022] DELETE /identity/v3/projects/0a8ee9d47bc94efca1f8c216349b0809 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:50.415031 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ede56-609d-417a-874a-a70cd1bd5fdd None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:50.415265 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ede56-609d-417a-874a-a70cd1bd5fdd None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:50.415533 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ede56-609d-417a-874a-a70cd1bd5fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:50.452563 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1024/2053] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:30:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:50.455412 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-991ede56-609d-417a-874a-a70cd1bd5fdd None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:50.455579 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b22d53-06e4-4a8b-a849-4a0c5107f28e None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:50.458337 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-991ede56-609d-417a-874a-a70cd1bd5fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:50.471457 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b22d53-06e4-4a8b-a849-4a0c5107f28e None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:50.473632 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1030/2054] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:30:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:30:50.482030 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852934ba-63d6-4963-a67d-3181e3a76907 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:50.482389 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852934ba-63d6-4963-a67d-3181e3a76907 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:50.482586 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852934ba-63d6-4963-a67d-3181e3a76907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:50.486916 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e8cef-3fbe-4ada-a310-9f06a114a323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:50.487882 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e8cef-3fbe-4ada-a310-9f06a114a323 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:50.488483 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e8cef-3fbe-4ada-a310-9f06a114a323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:50.489121 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e8cef-3fbe-4ada-a310-9f06a114a323 admin admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:50.490142 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02e8cef-3fbe-4ada-a310-9f06a114a323 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:30:50.490641 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02e8cef-3fbe-4ada-a310-9f06a114a323 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:50.495159 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02e8cef-3fbe-4ada-a310-9f06a114a323 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:50.509567 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-852934ba-63d6-4963-a67d-3181e3a76907 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:50.510836 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-852934ba-63d6-4963-a67d-3181e3a76907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:50.512537 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1025/2055] 10.222.0.91 () {58 vars in 1153 bytes} [Tue Aug 30 04:30:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:30:50.517775 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e8cef-3fbe-4ada-a310-9f06a114a323 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:50.527284 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1031/2056] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:30:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:50.528321 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852934ba-63d6-4963-a67d-3181e3a76907 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:50.540094 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e8cef-3fbe-4ada-a310-9f06a114a323 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:50.540715 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852934ba-63d6-4963-a67d-3181e3a76907 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:50.546740 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619345f8-d2db-4aaf-b79e-c28713f7836f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:50.547489 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619345f8-d2db-4aaf-b79e-c28713f7836f admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:50.547793 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619345f8-d2db-4aaf-b79e-c28713f7836f admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:50.548096 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619345f8-d2db-4aaf-b79e-c28713f7836f admin admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:50.548777 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619345f8-d2db-4aaf-b79e-c28713f7836f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:30:50.549082 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619345f8-d2db-4aaf-b79e-c28713f7836f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:50.550959 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619345f8-d2db-4aaf-b79e-c28713f7836f admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:50.552486 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee1bb1-6c09-4d7d-b372-2427777ded36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:50.555393 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee1bb1-6c09-4d7d-b372-2427777ded36 admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:50.556333 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee1bb1-6c09-4d7d-b372-2427777ded36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:50.557111 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee1bb1-6c09-4d7d-b372-2427777ded36 admin admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:50.558386 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ee1bb1-6c09-4d7d-b372-2427777ded36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:50.562579 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ee1bb1-6c09-4d7d-b372-2427777ded36 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:50.571253 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1032/2057] 10.222.0.91 () {58 vars in 1153 bytes} [Tue Aug 30 04:30:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:30:50.578946 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619345f8-d2db-4aaf-b79e-c28713f7836f admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:50.599808 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619345f8-d2db-4aaf-b79e-c28713f7836f admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:50.615112 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c0eb43-daf0-48cf-af8a-617ca590fd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:50.616265 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0eb43-daf0-48cf-af8a-617ca590fd1d admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:50.617039 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0eb43-daf0-48cf-af8a-617ca590fd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:50.617523 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0eb43-daf0-48cf-af8a-617ca590fd1d admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:50.618533 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c0eb43-daf0-48cf-af8a-617ca590fd1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:50.621871 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c0eb43-daf0-48cf-af8a-617ca590fd1d admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:50.636324 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1026/2058] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:30:50 2022] POST /identity/v3/projects => generated 387 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:30:50.638058 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee1bb1-6c09-4d7d-b372-2427777ded36 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:50.676330 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1033/2059] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:30:50 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:30:50.681548 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c0eb43-daf0-48cf-af8a-617ca590fd1d admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:50.744988 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee1bb1-6c09-4d7d-b372-2427777ded36 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:50.772099 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c0eb43-daf0-48cf-af8a-617ca590fd1d admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:50.781491 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dfe6ef-692c-4703-b47b-82f9fb6c492b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:50.782176 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dfe6ef-692c-4703-b47b-82f9fb6c492b admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:50.782454 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dfe6ef-692c-4703-b47b-82f9fb6c492b admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:50.782724 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dfe6ef-692c-4703-b47b-82f9fb6c492b admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:50.783395 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dfe6ef-692c-4703-b47b-82f9fb6c492b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:50.787043 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dfe6ef-692c-4703-b47b-82f9fb6c492b admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:50.829876 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1034/2060] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:30:50 2022] POST /identity/v3/users => generated 293 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:30:50.834823 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dfe6ef-692c-4703-b47b-82f9fb6c492b admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:50.844859 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de0d7e-a4b6-48de-b25a-4382edb020f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:50.845722 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de0d7e-a4b6-48de-b25a-4382edb020f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:50.846238 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de0d7e-a4b6-48de-b25a-4382edb020f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:50.846563 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de0d7e-a4b6-48de-b25a-4382edb020f3 admin admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:50.847158 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99de0d7e-a4b6-48de-b25a-4382edb020f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:50.849315 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99de0d7e-a4b6-48de-b25a-4382edb020f3 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:50.854143 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dfe6ef-692c-4703-b47b-82f9fb6c492b admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:50.868291 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61d7d44-8a37-4c26-a597-cb4cbccf0817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:50.869473 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d7d44-8a37-4c26-a597-cb4cbccf0817 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:50.869789 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d7d44-8a37-4c26-a597-cb4cbccf0817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:50.870068 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d7d44-8a37-4c26-a597-cb4cbccf0817 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:50.870757 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61d7d44-8a37-4c26-a597-cb4cbccf0817 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:50.875618 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61d7d44-8a37-4c26-a597-cb4cbccf0817 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:50.882399 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1027/2061] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:30:50 2022] POST /identity/v3/users => generated 294 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:30:50.882399 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf9406-d360-4a6a-977c-51df77a3bb48 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:50.882399 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf9406-d360-4a6a-977c-51df77a3bb48 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:50.882399 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf9406-d360-4a6a-977c-51df77a3bb48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:50.901355 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1035/2062] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:30:50 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:30:50.903149 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61d7d44-8a37-4c26-a597-cb4cbccf0817 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:50.905507 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-b2cf9406-d360-4a6a-977c-51df77a3bb48 None None] MFA Rules not processed for user `f237249974584d938baf71727ea3a162`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:50.906922 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-b2cf9406-d360-4a6a-977c-51df77a3bb48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:50.920603 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61d7d44-8a37-4c26-a597-cb4cbccf0817 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:50.929981 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847ef2e-4a85-4f72-8d12-3a256decdce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:50.930908 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847ef2e-4a85-4f72-8d12-3a256decdce5 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:50.931337 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847ef2e-4a85-4f72-8d12-3a256decdce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:50.931716 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847ef2e-4a85-4f72-8d12-3a256decdce5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:50.932763 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9847ef2e-4a85-4f72-8d12-3a256decdce5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:50.935199 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9847ef2e-4a85-4f72-8d12-3a256decdce5 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:50.953100 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1036/2063] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:30:50 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:30:50.958265 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847ef2e-4a85-4f72-8d12-3a256decdce5 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:50.964978 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:50.972518 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847ef2e-4a85-4f72-8d12-3a256decdce5 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:50.983417 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccbf23c-d529-4cd4-b365-6da0415f5acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:50.984422 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccbf23c-d529-4cd4-b365-6da0415f5acb admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:50.984831 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccbf23c-d529-4cd4-b365-6da0415f5acb admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:50.985229 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccbf23c-d529-4cd4-b365-6da0415f5acb admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:50.986078 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccbf23c-d529-4cd4-b365-6da0415f5acb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:50.988959 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccbf23c-d529-4cd4-b365-6da0415f5acb admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:51.012436 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1037/2064] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:30:50 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:30:51.012436 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccbf23c-d529-4cd4-b365-6da0415f5acb admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:51.012874 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1028/2065] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:30:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:51.015328 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cf9406-d360-4a6a-977c-51df77a3bb48 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:51.027145 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccbf23c-d529-4cd4-b365-6da0415f5acb admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:51.030820 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cf9406-d360-4a6a-977c-51df77a3bb48 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:51.035846 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692fe091-9aaa-4061-870c-f86662b086d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:51.037517 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692fe091-9aaa-4061-870c-f86662b086d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:51.037905 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8618c3fc-625b-4606-bde6-5f67114690ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:51.038111 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692fe091-9aaa-4061-870c-f86662b086d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:51.038614 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618c3fc-625b-4606-bde6-5f67114690ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:51.038778 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692fe091-9aaa-4061-870c-f86662b086d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:51.038912 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618c3fc-625b-4606-bde6-5f67114690ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:51.039146 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618c3fc-625b-4606-bde6-5f67114690ac admin admin] PATH_INFO: `/v3/projects/ec24ad0a529d4df7a32b62a1558fa7a8/users/5adb079fad6c41aca6a619a71a3b7c3a/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:51.040422 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692fe091-9aaa-4061-870c-f86662b086d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:51.043335 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692fe091-9aaa-4061-870c-f86662b086d3 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:51.062851 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8618c3fc-625b-4606-bde6-5f67114690ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec24ad0a529d4df7a32b62a1558fa7a8, user_id=5adb079fad6c41aca6a619a71a3b7c3a, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:51.066228 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8618c3fc-625b-4606-bde6-5f67114690ac admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:51.074750 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1038/2066] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:30:51 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:30:51.080820 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692fe091-9aaa-4061-870c-f86662b086d3 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:51.085645 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1029/2067] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:30:51 2022] PUT /identity/v3/projects/ec24ad0a529d4df7a32b62a1558fa7a8/users/5adb079fad6c41aca6a619a71a3b7c3a/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:51.094943 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acbe5e1-d2d2-44dd-8f14-cd94a581a6ad None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:51.096231 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acbe5e1-d2d2-44dd-8f14-cd94a581a6ad None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:51.097055 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acbe5e1-d2d2-44dd-8f14-cd94a581a6ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:51.103194 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692fe091-9aaa-4061-870c-f86662b086d3 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:51.145203 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-1acbe5e1-d2d2-44dd-8f14-cd94a581a6ad None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:51.149164 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-1acbe5e1-d2d2-44dd-8f14-cd94a581a6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:51.174462 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:51.224462 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468b190f-f283-496c-8e94-e40c307c595b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:51.226075 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b190f-f283-496c-8e94-e40c307c595b admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:51.226460 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b190f-f283-496c-8e94-e40c307c595b admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:51.226735 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b190f-f283-496c-8e94-e40c307c595b admin admin] PATH_INFO: `/v3/projects/f010dad4c48d4bc58e20f87bd5a611a3/users/aaf17f335cab4c76b7d84d14fa0c41e5/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:51.314842 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1030/2068] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:30:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:51.315420 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468b190f-f283-496c-8e94-e40c307c595b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f010dad4c48d4bc58e20f87bd5a611a3, user_id=aaf17f335cab4c76b7d84d14fa0c41e5, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:51.317215 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468b190f-f283-496c-8e94-e40c307c595b admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:51.344543 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acbe5e1-d2d2-44dd-8f14-cd94a581a6ad None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:51.348811 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1039/2069] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:30:51 2022] PUT /identity/v3/projects/f010dad4c48d4bc58e20f87bd5a611a3/users/aaf17f335cab4c76b7d84d14fa0c41e5/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:51.350208 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-1acbe5e1-d2d2-44dd-8f14-cd94a581a6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:51.350667 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d26571-92a4-4791-92b1-a386bebe6b26 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:51.351013 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d26571-92a4-4791-92b1-a386bebe6b26 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:51.351297 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d26571-92a4-4791-92b1-a386bebe6b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:51.388563 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-92d26571-92a4-4791-92b1-a386bebe6b26 None None] MFA Rules not processed for user `aaf17f335cab4c76b7d84d14fa0c41e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:51.389848 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-92d26571-92a4-4791-92b1-a386bebe6b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:51.473257 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acbe5e1-d2d2-44dd-8f14-cd94a581a6ad None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:51.505933 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1040/2070] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:30:51 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:51.511558 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d26571-92a4-4791-92b1-a386bebe6b26 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:51.544074 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e0fd6-517f-4ab3-857a-d1301c5e41ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:51.544866 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e0fd6-517f-4ab3-857a-d1301c5e41ca service neutron] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:51.545264 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e0fd6-517f-4ab3-857a-d1301c5e41ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:51.545630 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e0fd6-517f-4ab3-857a-d1301c5e41ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:51.601650 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:51.611870 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d26571-92a4-4791-92b1-a386bebe6b26 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:51.621260 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219151a5-6e26-4cd3-8fc9-0834b8ecb6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:51.621994 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219151a5-6e26-4cd3-8fc9-0834b8ecb6e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:51.622390 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219151a5-6e26-4cd3-8fc9-0834b8ecb6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:51.622709 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219151a5-6e26-4cd3-8fc9-0834b8ecb6e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:51.623661 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219151a5-6e26-4cd3-8fc9-0834b8ecb6e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:51.627409 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219151a5-6e26-4cd3-8fc9-0834b8ecb6e9 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:51.687427 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1041/2071] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:30:51 2022] POST /identity/v3/projects => generated 385 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:30:51.688250 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660e0fd6-517f-4ab3-857a-d1301c5e41ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:51.692129 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660e0fd6-517f-4ab3-857a-d1301c5e41ca service neutron] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:51.692967 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219151a5-6e26-4cd3-8fc9-0834b8ecb6e9 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:51.718410 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1031/2072] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:30:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:30:51.750984 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:51.792976 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219151a5-6e26-4cd3-8fc9-0834b8ecb6e9 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:51.798907 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae39c23-0c09-498d-b649-9f6bdd7ef8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:51.799866 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae39c23-0c09-498d-b649-9f6bdd7ef8ee admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:51.800275 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae39c23-0c09-498d-b649-9f6bdd7ef8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:51.800718 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae39c23-0c09-498d-b649-9f6bdd7ef8ee admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:51.801612 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae39c23-0c09-498d-b649-9f6bdd7ef8ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:51.803776 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae39c23-0c09-498d-b649-9f6bdd7ef8ee admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:51.841633 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1042/2073] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:30:51 2022] POST /identity/v3/users => generated 299 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:30:51.846631 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e0fd6-517f-4ab3-857a-d1301c5e41ca service neutron] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:51.857746 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e0fd6-517f-4ab3-857a-d1301c5e41ca service neutron] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:51.869432 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa112279-889a-46fa-bc2b-1192d65aec48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:51.870574 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa112279-889a-46fa-bc2b-1192d65aec48 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:51.871756 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa112279-889a-46fa-bc2b-1192d65aec48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:51.872294 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa112279-889a-46fa-bc2b-1192d65aec48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:51.888488 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa112279-889a-46fa-bc2b-1192d65aec48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:51.888488 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa112279-889a-46fa-bc2b-1192d65aec48 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:51.907734 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1032/2074] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:30:51 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:30:51.914907 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae39c23-0c09-498d-b649-9f6bdd7ef8ee admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:51.937781 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae39c23-0c09-498d-b649-9f6bdd7ef8ee admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:51.947226 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd35c5-d5d8-4ffd-b793-17afa9fd9d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:51.948672 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd35c5-d5d8-4ffd-b793-17afa9fd9d6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:51.949147 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd35c5-d5d8-4ffd-b793-17afa9fd9d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:51.950001 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd35c5-d5d8-4ffd-b793-17afa9fd9d6f admin admin] PATH_INFO: `/v3/projects/480b5589d4f14d8ebe81f72ca551ef96/users/04945475bd5c4ebfa7e18206bce1437e/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:51.978962 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbd35c5-d5d8-4ffd-b793-17afa9fd9d6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=480b5589d4f14d8ebe81f72ca551ef96, user_id=04945475bd5c4ebfa7e18206bce1437e, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:51.981860 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbd35c5-d5d8-4ffd-b793-17afa9fd9d6f admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:52.004106 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1043/2075] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:30:51 2022] PUT /identity/v3/projects/480b5589d4f14d8ebe81f72ca551ef96/users/04945475bd5c4ebfa7e18206bce1437e/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:52.008747 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa112279-889a-46fa-bc2b-1192d65aec48 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:52.024478 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa112279-889a-46fa-bc2b-1192d65aec48 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:52.161193 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd1c108-664b-45f9-bb21-87c316ad37ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:52.162694 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1c108-664b-45f9-bb21-87c316ad37ca admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:52.163091 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1c108-664b-45f9-bb21-87c316ad37ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:52.163627 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1c108-664b-45f9-bb21-87c316ad37ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:52.164829 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd1c108-664b-45f9-bb21-87c316ad37ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:52.167930 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd1c108-664b-45f9-bb21-87c316ad37ca admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:52.184013 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1033/2076] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:30:52 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:30:52.188554 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd35c5-d5d8-4ffd-b793-17afa9fd9d6f admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:52.202906 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd35c5-d5d8-4ffd-b793-17afa9fd9d6f admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:52.210414 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c8abcb-af9b-464b-998c-0aa57dc19544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:52.211109 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c8abcb-af9b-464b-998c-0aa57dc19544 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:52.211388 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c8abcb-af9b-464b-998c-0aa57dc19544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:52.211663 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c8abcb-af9b-464b-998c-0aa57dc19544 admin admin] PATH_INFO: `/v3/projects/480b5589d4f14d8ebe81f72ca551ef96/users/04945475bd5c4ebfa7e18206bce1437e/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:52.214450 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c8abcb-af9b-464b-998c-0aa57dc19544 admin admin] RBAC: Authorizing `identity:create_grant(project_id=480b5589d4f14d8ebe81f72ca551ef96, user_id=04945475bd5c4ebfa7e18206bce1437e, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:52.219681 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c8abcb-af9b-464b-998c-0aa57dc19544 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:52.239985 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1044/2077] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:30:52 2022] PUT /identity/v3/projects/480b5589d4f14d8ebe81f72ca551ef96/users/04945475bd5c4ebfa7e18206bce1437e/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:30:52.255223 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9f3c8-fc9b-4f7d-a341-f55fa3d90771 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:52.255710 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9f3c8-fc9b-4f7d-a341-f55fa3d90771 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:52.256321 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9f3c8-fc9b-4f7d-a341-f55fa3d90771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:52.320156 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-3ae9f3c8-fc9b-4f7d-a341-f55fa3d90771 None None] MFA Rules not processed for user `04945475bd5c4ebfa7e18206bce1437e`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:52.320156 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-3ae9f3c8-fc9b-4f7d-a341-f55fa3d90771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:52.578050 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c8abcb-af9b-464b-998c-0aa57dc19544 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:52.580781 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1034/2078] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:30:52 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:30:52.580983 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-57c8abcb-af9b-464b-998c-0aa57dc19544 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:52.732864 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c8abcb-af9b-464b-998c-0aa57dc19544 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:52.737144 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749241e6-6743-4658-a8aa-08d7e0c60920 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:52.738329 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749241e6-6743-4658-a8aa-08d7e0c60920 service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:52.738581 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749241e6-6743-4658-a8aa-08d7e0c60920 service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:52.738714 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749241e6-6743-4658-a8aa-08d7e0c60920 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:52.755743 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749241e6-6743-4658-a8aa-08d7e0c60920 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:52.761442 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749241e6-6743-4658-a8aa-08d7e0c60920 service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:52.795228 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1045/2079] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:30:52 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:30:53.998572 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae9f3c8-fc9b-4f7d-a341-f55fa3d90771 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:54.093208 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:54.141769 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae9f3c8-fc9b-4f7d-a341-f55fa3d90771 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:54.158849 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c073883-f775-4b8e-9221-6daefae82da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:54.159770 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c073883-f775-4b8e-9221-6daefae82da1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:54.160742 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c073883-f775-4b8e-9221-6daefae82da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:54.164266 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c073883-f775-4b8e-9221-6daefae82da1 admin admin] PATH_INFO: `/v3/users/aaf17f335cab4c76b7d84d14fa0c41e5` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:54.171293 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c073883-f775-4b8e-9221-6daefae82da1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aaf17f335cab4c76b7d84d14fa0c41e5)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:54.174164 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c073883-f775-4b8e-9221-6daefae82da1 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:54.312515 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-4c073883-f775-4b8e-9221-6daefae82da1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aaf17f335cab4c76b7d84d14fa0c41e5'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:54.316578 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-4c073883-f775-4b8e-9221-6daefae82da1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aaf17f335cab4c76b7d84d14fa0c41e5'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:54.328722 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-4c073883-f775-4b8e-9221-6daefae82da1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aaf17f335cab4c76b7d84d14fa0c41e5'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:54.361594 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-4c073883-f775-4b8e-9221-6daefae82da1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aaf17f335cab4c76b7d84d14fa0c41e5'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:54.470812 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-4c073883-f775-4b8e-9221-6daefae82da1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aaf17f335cab4c76b7d84d14fa0c41e5'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:54.520195 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1035/2080] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:30:53 2022] DELETE /identity/v3/users/aaf17f335cab4c76b7d84d14fa0c41e5 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:30:54.526127 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf68b8-0377-425b-8e3e-ba89fa18651f None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:54.526942 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf68b8-0377-425b-8e3e-ba89fa18651f None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:54.526942 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf68b8-0377-425b-8e3e-ba89fa18651f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:54.613835 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-6ccf68b8-0377-425b-8e3e-ba89fa18651f None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:54.620315 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-6ccf68b8-0377-425b-8e3e-ba89fa18651f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:54.997243 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1046/2081] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:30:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 474 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:55.096124 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c073883-f775-4b8e-9221-6daefae82da1 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:55.099890 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-4c073883-f775-4b8e-9221-6daefae82da1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:55.286307 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c073883-f775-4b8e-9221-6daefae82da1 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:55.304579 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9d98bf-a7d1-47c1-b45b-2b511cd6b623 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:55.305248 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d98bf-a7d1-47c1-b45b-2b511cd6b623 service neutron] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:55.305684 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d98bf-a7d1-47c1-b45b-2b511cd6b623 service neutron] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:55.305966 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d98bf-a7d1-47c1-b45b-2b511cd6b623 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:55.327669 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9d98bf-a7d1-47c1-b45b-2b511cd6b623 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:55.333931 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9d98bf-a7d1-47c1-b45b-2b511cd6b623 service neutron] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:55.378490 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1036/2082] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:30:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:30:56.846866 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccf68b8-0377-425b-8e3e-ba89fa18651f None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:56.851227 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-6ccf68b8-0377-425b-8e3e-ba89fa18651f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:56.950684 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccf68b8-0377-425b-8e3e-ba89fa18651f None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:56.966844 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a064faf9-68d7-4ad5-8eb1-5944d07a8ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:56.971718 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c2d35-2e00-4868-8e12-6f85c3b36a5f None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:56.973261 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c2d35-2e00-4868-8e12-6f85c3b36a5f None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:56.973678 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a064faf9-68d7-4ad5-8eb1-5944d07a8ca1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:56.973856 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a064faf9-68d7-4ad5-8eb1-5944d07a8ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:56.974613 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a064faf9-68d7-4ad5-8eb1-5944d07a8ca1 admin admin] PATH_INFO: `/v3/projects/f010dad4c48d4bc58e20f87bd5a611a3` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:56.975343 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c2d35-2e00-4868-8e12-6f85c3b36a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:56.976746 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a064faf9-68d7-4ad5-8eb1-5944d07a8ca1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f010dad4c48d4bc58e20f87bd5a611a3)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:56.990652 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a064faf9-68d7-4ad5-8eb1-5944d07a8ca1 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:57.055075 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:57.106797 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-a064faf9-68d7-4ad5-8eb1-5944d07a8ca1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f010dad4c48d4bc58e20f87bd5a611a3', 'request_id': 'req-a064faf9-68d7-4ad5-8eb1-5944d07a8ca1'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:57.111656 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-983c2d35-2e00-4868-8e12-6f85c3b36a5f None None] MFA Rules not processed for user `1bc12faf48984335a3515dcde85b5cb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:57.118029 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-983c2d35-2e00-4868-8e12-6f85c3b36a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:57.138258 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-a064faf9-68d7-4ad5-8eb1-5944d07a8ca1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f010dad4c48d4bc58e20f87bd5a611a3', 'request_id': 'req-a064faf9-68d7-4ad5-8eb1-5944d07a8ca1'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:57.173016 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-a064faf9-68d7-4ad5-8eb1-5944d07a8ca1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f010dad4c48d4bc58e20f87bd5a611a3', 'request_id': 'req-a064faf9-68d7-4ad5-8eb1-5944d07a8ca1'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:57.241990 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-a064faf9-68d7-4ad5-8eb1-5944d07a8ca1 admin admin] The token cache is being invalidate because project f010dad4c48d4bc58e20f87bd5a611a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:30:57.242499 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-a064faf9-68d7-4ad5-8eb1-5944d07a8ca1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:57.255534 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-a064faf9-68d7-4ad5-8eb1-5944d07a8ca1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:57.267249 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1047/2083] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:30:56 2022] DELETE /identity/v3/projects/f010dad4c48d4bc58e20f87bd5a611a3 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:57.277150 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a064faf9-68d7-4ad5-8eb1-5944d07a8ca1 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:57.279440 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-a064faf9-68d7-4ad5-8eb1-5944d07a8ca1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:57.339859 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1037/2084] 10.222.0.91 () {58 vars in 1009 bytes} [Tue Aug 30 04:30:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:57.421644 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a064faf9-68d7-4ad5-8eb1-5944d07a8ca1 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:57.429936 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c2d35-2e00-4868-8e12-6f85c3b36a5f None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:57.431482 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-983c2d35-2e00-4868-8e12-6f85c3b36a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:57.443000 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:57.451141 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27f8dc1-d493-4dd4-a902-0db807d2d9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:57.451832 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f8dc1-d493-4dd4-a902-0db807d2d9ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:57.452162 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f8dc1-d493-4dd4-a902-0db807d2d9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:57.458801 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f8dc1-d493-4dd4-a902-0db807d2d9ab admin admin] PATH_INFO: `/v3/users/04945475bd5c4ebfa7e18206bce1437e` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:57.461685 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27f8dc1-d493-4dd4-a902-0db807d2d9ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=04945475bd5c4ebfa7e18206bce1437e)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:57.465039 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27f8dc1-d493-4dd4-a902-0db807d2d9ab admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:57.620138 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-a27f8dc1-d493-4dd4-a902-0db807d2d9ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04945475bd5c4ebfa7e18206bce1437e'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:57.641479 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-a27f8dc1-d493-4dd4-a902-0db807d2d9ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04945475bd5c4ebfa7e18206bce1437e'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:57.682483 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-a27f8dc1-d493-4dd4-a902-0db807d2d9ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04945475bd5c4ebfa7e18206bce1437e'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:57.689250 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-a27f8dc1-d493-4dd4-a902-0db807d2d9ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04945475bd5c4ebfa7e18206bce1437e'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:57.754465 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-a27f8dc1-d493-4dd4-a902-0db807d2d9ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04945475bd5c4ebfa7e18206bce1437e'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:57.774849 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1048/2085] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:30:57 2022] DELETE /identity/v3/users/04945475bd5c4ebfa7e18206bce1437e => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:57.818938 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c2d35-2e00-4868-8e12-6f85c3b36a5f None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:58.063316 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a1aa3f-5fbf-4c91-af3b-c6e7fbe21730 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b50f9552124b07822ae63c1d553864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:58.064338 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1aa3f-5fbf-4c91-af3b-c6e7fbe21730 service swift] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:58.064616 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1aa3f-5fbf-4c91-af3b-c6e7fbe21730 service swift] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:58.064883 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1aa3f-5fbf-4c91-af3b-c6e7fbe21730 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:58.067472 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-56a1aa3f-5fbf-4c91-af3b-c6e7fbe21730 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:58.336619 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a1aa3f-5fbf-4c91-af3b-c6e7fbe21730 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:58.338641 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a1aa3f-5fbf-4c91-af3b-c6e7fbe21730 service swift] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:58.386379 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1038/2086] 10.222.0.91 () {60 vars in 1384 bytes} [Tue Aug 30 04:30:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 957 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 04:30:59.241741 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27f8dc1-d493-4dd4-a902-0db807d2d9ab admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:59.244884 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-a27f8dc1-d493-4dd4-a902-0db807d2d9ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:59.429835 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:59.526111 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27f8dc1-d493-4dd4-a902-0db807d2d9ab admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:59.558507 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de442d8c-08ad-4bae-a4e5-520b22448df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:59.561619 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de442d8c-08ad-4bae-a4e5-520b22448df5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:59.561935 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de442d8c-08ad-4bae-a4e5-520b22448df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:59.562301 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de442d8c-08ad-4bae-a4e5-520b22448df5 admin admin] PATH_INFO: `/v3/users/eab8453bb3014dd3ba8b269f4d8949ee` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:59.567559 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de442d8c-08ad-4bae-a4e5-520b22448df5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eab8453bb3014dd3ba8b269f4d8949ee)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:59.593908 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de442d8c-08ad-4bae-a4e5-520b22448df5 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:59.612991 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a1aa3f-5fbf-4c91-af3b-c6e7fbe21730 service swift] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:59.620960 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-56a1aa3f-5fbf-4c91-af3b-c6e7fbe21730 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:59.694566 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a1aa3f-5fbf-4c91-af3b-c6e7fbe21730 service swift] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:59.710429 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d70a0-d940-45bd-9fbf-cadc75baa655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:59.725815 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d70a0-d940-45bd-9fbf-cadc75baa655 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:59.726905 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d70a0-d940-45bd-9fbf-cadc75baa655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:59.734440 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d70a0-d940-45bd-9fbf-cadc75baa655 admin admin] PATH_INFO: `/v3/projects/480b5589d4f14d8ebe81f72ca551ef96` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:59.736543 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6d70a0-d940-45bd-9fbf-cadc75baa655 admin admin] RBAC: Authorizing `identity:delete_project(project_id=480b5589d4f14d8ebe81f72ca551ef96)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:59.740819 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6d70a0-d940-45bd-9fbf-cadc75baa655 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:59.787529 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-de442d8c-08ad-4bae-a4e5-520b22448df5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eab8453bb3014dd3ba8b269f4d8949ee'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:59.826454 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-de442d8c-08ad-4bae-a4e5-520b22448df5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eab8453bb3014dd3ba8b269f4d8949ee'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:59.841318 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:59.854291 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-6f6d70a0-d940-45bd-9fbf-cadc75baa655 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '480b5589d4f14d8ebe81f72ca551ef96', 'request_id': 'req-6f6d70a0-d940-45bd-9fbf-cadc75baa655'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:59.854665 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-de442d8c-08ad-4bae-a4e5-520b22448df5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eab8453bb3014dd3ba8b269f4d8949ee'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:59.855984 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-de442d8c-08ad-4bae-a4e5-520b22448df5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eab8453bb3014dd3ba8b269f4d8949ee'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:59.864087 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-6f6d70a0-d940-45bd-9fbf-cadc75baa655 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '480b5589d4f14d8ebe81f72ca551ef96', 'request_id': 'req-6f6d70a0-d940-45bd-9fbf-cadc75baa655'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:59.887398 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-6f6d70a0-d940-45bd-9fbf-cadc75baa655 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '480b5589d4f14d8ebe81f72ca551ef96', 'request_id': 'req-6f6d70a0-d940-45bd-9fbf-cadc75baa655'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:59.927890 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-de442d8c-08ad-4bae-a4e5-520b22448df5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eab8453bb3014dd3ba8b269f4d8949ee'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:59.939222 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-6f6d70a0-d940-45bd-9fbf-cadc75baa655 admin admin] The token cache is being invalidate because project 480b5589d4f14d8ebe81f72ca551ef96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:30:59.940653 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-6f6d70a0-d940-45bd-9fbf-cadc75baa655 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:59.942009 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-6f6d70a0-d940-45bd-9fbf-cadc75baa655 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:59.944118 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1039/2087] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:30:59 2022] DELETE /identity/v3/projects/480b5589d4f14d8ebe81f72ca551ef96 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:59.948022 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1049/2088] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:30:59 2022] DELETE /identity/v3/users/eab8453bb3014dd3ba8b269f4d8949ee => generated 0 bytes in 708 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:59.949483 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac20155-7308-411e-8bf8-610713709e9c None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:59.951479 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be1793-bc32-4a2e-be28-0d82a31ae1d6 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:59.952203 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac20155-7308-411e-8bf8-610713709e9c None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:59.952739 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac20155-7308-411e-8bf8-610713709e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:59.953254 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be1793-bc32-4a2e-be28-0d82a31ae1d6 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:59.955283 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be1793-bc32-4a2e-be28-0d82a31ae1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:00.027109 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-fac20155-7308-411e-8bf8-610713709e9c None None] MFA Rules not processed for user `1bc12faf48984335a3515dcde85b5cb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:31:00.030415 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-fac20155-7308-411e-8bf8-610713709e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:00.038970 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-e0be1793-bc32-4a2e-be28-0d82a31ae1d6 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:31:00.043331 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-e0be1793-bc32-4a2e-be28-0d82a31ae1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:00.152638 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1040/2089] 10.222.0.91 () {58 vars in 967 bytes} [Tue Aug 30 04:30:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:31:00.154048 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee56a3-3c44-4f51-a2ae-1777446a3bd9 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:00.154340 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee56a3-3c44-4f51-a2ae-1777446a3bd9 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:00.154617 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee56a3-3c44-4f51-a2ae-1777446a3bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:00.197587 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-6bee56a3-3c44-4f51-a2ae-1777446a3bd9 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:31:00.198865 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-6bee56a3-3c44-4f51-a2ae-1777446a3bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:00.205943 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1050/2090] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:30:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:31:00.208048 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0be1793-bc32-4a2e-be28-0d82a31ae1d6 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:00.210359 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-e0be1793-bc32-4a2e-be28-0d82a31ae1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:00.230694 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1041/2091] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:31:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:31:00.230694 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09958b-9fd6-4eaa-879a-087e8f88864f None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:00.230694 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09958b-9fd6-4eaa-879a-087e8f88864f None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:00.230694 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09958b-9fd6-4eaa-879a-087e8f88864f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:00.282949 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-9d09958b-9fd6-4eaa-879a-087e8f88864f None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:31:00.284325 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-9d09958b-9fd6-4eaa-879a-087e8f88864f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:00.303314 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:00.316561 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1042/2092] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:31:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:31:00.318764 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09958b-9fd6-4eaa-879a-087e8f88864f None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:00.320714 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-9d09958b-9fd6-4eaa-879a-087e8f88864f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:00.356849 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0be1793-bc32-4a2e-be28-0d82a31ae1d6 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:00.371589 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7717efce-dfb3-44bd-8d90-7d14a4102c9e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b50f9552124b07822ae63c1d553864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:00.372566 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7717efce-dfb3-44bd-8d90-7d14a4102c9e service swift] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:00.373158 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7717efce-dfb3-44bd-8d90-7d14a4102c9e service swift] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:00.373936 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7717efce-dfb3-44bd-8d90-7d14a4102c9e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:00.395467 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7717efce-dfb3-44bd-8d90-7d14a4102c9e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:00.397069 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7717efce-dfb3-44bd-8d90-7d14a4102c9e service swift] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:00.413627 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1051/2093] 10.222.0.91 () {60 vars in 1384 bytes} [Tue Aug 30 04:31:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:31:00.416351 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7717efce-dfb3-44bd-8d90-7d14a4102c9e service swift] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:00.456444 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7717efce-dfb3-44bd-8d90-7d14a4102c9e service swift] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:00.485671 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b51962c-980e-4399-b465-c57156ec4c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:00.488389 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51962c-980e-4399-b465-c57156ec4c88 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:00.496270 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51962c-980e-4399-b465-c57156ec4c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:00.496270 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51962c-980e-4399-b465-c57156ec4c88 admin admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:00.496270 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b51962c-980e-4399-b465-c57156ec4c88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:31:00.496270 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b51962c-980e-4399-b465-c57156ec4c88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:00.497575 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09958b-9fd6-4eaa-879a-087e8f88864f None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:00.505661 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b51962c-980e-4399-b465-c57156ec4c88 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:00.506182 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af011abf-9716-48c3-a741-c3d02a4d3cd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:00.507163 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af011abf-9716-48c3-a741-c3d02a4d3cd1 service neutron] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:00.512585 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af011abf-9716-48c3-a741-c3d02a4d3cd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:00.513025 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af011abf-9716-48c3-a741-c3d02a4d3cd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:00.544866 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af011abf-9716-48c3-a741-c3d02a4d3cd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:00.546642 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af011abf-9716-48c3-a741-c3d02a4d3cd1 service neutron] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:00.562479 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1043/2094] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:31:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:31:00.576536 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1052/2095] 10.222.0.91 () {58 vars in 1153 bytes} [Tue Aug 30 04:31:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:31:00.580936 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af011abf-9716-48c3-a741-c3d02a4d3cd1 service neutron] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:00.598135 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af011abf-9716-48c3-a741-c3d02a4d3cd1 service neutron] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:00.674068 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c166577-f62d-4a2f-bcdb-95981ba25279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:00.677655 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c166577-f62d-4a2f-bcdb-95981ba25279 admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:00.679716 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c166577-f62d-4a2f-bcdb-95981ba25279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:00.680045 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c166577-f62d-4a2f-bcdb-95981ba25279 admin admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:00.692264 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c166577-f62d-4a2f-bcdb-95981ba25279 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:00.707051 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c166577-f62d-4a2f-bcdb-95981ba25279 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:00.815413 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b51962c-980e-4399-b465-c57156ec4c88 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:00.815780 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1044/2096] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:31:00 2022] POST /identity/v3/projects => generated 373 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:31:00.854237 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b51962c-980e-4399-b465-c57156ec4c88 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:01.049176 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67271897-e8ab-46d7-ac25-c614be281188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:01.053757 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67271897-e8ab-46d7-ac25-c614be281188 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:01.054288 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67271897-e8ab-46d7-ac25-c614be281188 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:01.054671 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67271897-e8ab-46d7-ac25-c614be281188 admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:01.056380 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67271897-e8ab-46d7-ac25-c614be281188 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:01.067444 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67271897-e8ab-46d7-ac25-c614be281188 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:01.147564 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1053/2097] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:31:00 2022] POST /identity/v3/users => generated 287 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:31:01.149807 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c166577-f62d-4a2f-bcdb-95981ba25279 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:01.167592 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c166577-f62d-4a2f-bcdb-95981ba25279 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:01.200317 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e8f9c-1ca7-4e78-a48b-67c68594201b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:01.200969 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e8f9c-1ca7-4e78-a48b-67c68594201b admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:01.201249 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e8f9c-1ca7-4e78-a48b-67c68594201b admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:01.201521 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e8f9c-1ca7-4e78-a48b-67c68594201b admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:01.202189 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e8f9c-1ca7-4e78-a48b-67c68594201b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:01.212682 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e8f9c-1ca7-4e78-a48b-67c68594201b admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:01.214574 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3a8ae-3e8f-4b9d-9a99-8331cb353b4c None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:01.216766 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3a8ae-3e8f-4b9d-9a99-8331cb353b4c None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:01.217568 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3a8ae-3e8f-4b9d-9a99-8331cb353b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:01.261945 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1045/2098] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:31:01.263021 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e8f9c-1ca7-4e78-a48b-67c68594201b admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:01.291409 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e8f9c-1ca7-4e78-a48b-67c68594201b admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:01.308759 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1344eae-7fcd-473f-a14d-e75b69edc0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:01.311881 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1344eae-7fcd-473f-a14d-e75b69edc0e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:01.311881 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1344eae-7fcd-473f-a14d-e75b69edc0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:01.311881 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1344eae-7fcd-473f-a14d-e75b69edc0e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:01.311881 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1344eae-7fcd-473f-a14d-e75b69edc0e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:01.312307 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1344eae-7fcd-473f-a14d-e75b69edc0e8 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:01.320014 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-22a3a8ae-3e8f-4b9d-9a99-8331cb353b4c None None] MFA Rules not processed for user `1bc12faf48984335a3515dcde85b5cb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:31:01.328158 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-22a3a8ae-3e8f-4b9d-9a99-8331cb353b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:01.344168 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1046/2099] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:31:01.345167 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1344eae-7fcd-473f-a14d-e75b69edc0e8 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:01.384775 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1344eae-7fcd-473f-a14d-e75b69edc0e8 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:01.409317 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204b2f1e-5d37-4047-821b-c6d89edda851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:01.410940 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b2f1e-5d37-4047-821b-c6d89edda851 admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:01.411234 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b2f1e-5d37-4047-821b-c6d89edda851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:01.412663 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b2f1e-5d37-4047-821b-c6d89edda851 admin admin] PATH_INFO: `/v3/projects/ccca99871c65472bb4df307b70d8d75b/users/5ddccf0f897245128076eeefb36293dd/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:01.449319 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204b2f1e-5d37-4047-821b-c6d89edda851 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccca99871c65472bb4df307b70d8d75b, user_id=5ddccf0f897245128076eeefb36293dd, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:01.452365 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204b2f1e-5d37-4047-821b-c6d89edda851 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:01.456943 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:01.475806 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1047/2100] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:31:01 2022] PUT /identity/v3/projects/ccca99871c65472bb4df307b70d8d75b/users/5ddccf0f897245128076eeefb36293dd/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:31:01.489945 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54709ea2-0bd4-481b-995b-d3f697221d71 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:01.492255 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54709ea2-0bd4-481b-995b-d3f697221d71 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:01.492581 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54709ea2-0bd4-481b-995b-d3f697221d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:01.574185 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1054/2101] 10.222.0.91 () {58 vars in 1009 bytes} [Tue Aug 30 04:31:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:31:01.604494 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a3a8ae-3e8f-4b9d-9a99-8331cb353b4c None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:01.627209 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-54709ea2-0bd4-481b-995b-d3f697221d71 None None] MFA Rules not processed for user `5ddccf0f897245128076eeefb36293dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:31:01.635035 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-54709ea2-0bd4-481b-995b-d3f697221d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:01.810297 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1048/2102] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:31:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:31:01.812583 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54709ea2-0bd4-481b-995b-d3f697221d71 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:01.815592 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-54709ea2-0bd4-481b-995b-d3f697221d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:01.861711 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a3a8ae-3e8f-4b9d-9a99-8331cb353b4c None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:01.894377 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:02.107286 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc123d-1c34-4f05-aec1-45000113f2b2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b50f9552124b07822ae63c1d553864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:02.107904 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc123d-1c34-4f05-aec1-45000113f2b2 service swift] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:02.108674 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc123d-1c34-4f05-aec1-45000113f2b2 service swift] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:02.108847 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc123d-1c34-4f05-aec1-45000113f2b2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:02.113990 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54709ea2-0bd4-481b-995b-d3f697221d71 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:02.140159 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e4fc0d-7303-4f28-b596-a867b0998ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:02.143271 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e4fc0d-7303-4f28-b596-a867b0998ac1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:02.143687 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e4fc0d-7303-4f28-b596-a867b0998ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:02.144220 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e4fc0d-7303-4f28-b596-a867b0998ac1 admin admin] PATH_INFO: `/v3/projects/40a006662b86417ca2c5b846268e271c` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:02.151093 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e4fc0d-7303-4f28-b596-a867b0998ac1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40a006662b86417ca2c5b846268e271c)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:02.158258 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e4fc0d-7303-4f28-b596-a867b0998ac1 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:02.355151 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dc123d-1c34-4f05-aec1-45000113f2b2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:02.374017 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dc123d-1c34-4f05-aec1-45000113f2b2 service swift] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:02.386671 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-28e4fc0d-7303-4f28-b596-a867b0998ac1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40a006662b86417ca2c5b846268e271c', 'request_id': 'req-28e4fc0d-7303-4f28-b596-a867b0998ac1'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:31:02.392536 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1055/2103] 10.222.0.91 () {60 vars in 1384 bytes} [Tue Aug 30 04:31:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 788 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:31:02.393638 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc123d-1c34-4f05-aec1-45000113f2b2 service swift] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:02.395809 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-36dc123d-1c34-4f05-aec1-45000113f2b2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:02.408201 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-28e4fc0d-7303-4f28-b596-a867b0998ac1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40a006662b86417ca2c5b846268e271c', 'request_id': 'req-28e4fc0d-7303-4f28-b596-a867b0998ac1'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:31:02.426413 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-28e4fc0d-7303-4f28-b596-a867b0998ac1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40a006662b86417ca2c5b846268e271c', 'request_id': 'req-28e4fc0d-7303-4f28-b596-a867b0998ac1'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:31:02.459339 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-28e4fc0d-7303-4f28-b596-a867b0998ac1 admin admin] The token cache is being invalidate because project 40a006662b86417ca2c5b846268e271c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:31:02.460715 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-28e4fc0d-7303-4f28-b596-a867b0998ac1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:31:02.467403 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-28e4fc0d-7303-4f28-b596-a867b0998ac1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:31:02.479818 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1049/2104] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:31:01 2022] DELETE /identity/v3/projects/40a006662b86417ca2c5b846268e271c => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:31:02.481917 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21275530-031c-4e41-8d77-759c74e4eb24 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:02.482202 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21275530-031c-4e41-8d77-759c74e4eb24 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:02.487826 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21275530-031c-4e41-8d77-759c74e4eb24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:02.521702 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc123d-1c34-4f05-aec1-45000113f2b2 service swift] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:02.548411 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-21275530-031c-4e41-8d77-759c74e4eb24 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:31:02.552347 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-21275530-031c-4e41-8d77-759c74e4eb24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:02.571446 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:02.751491 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1651c6-449c-44eb-9587-c04fc86effca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:02.754567 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1651c6-449c-44eb-9587-c04fc86effca service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:02.757275 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1651c6-449c-44eb-9587-c04fc86effca service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:02.761784 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1651c6-449c-44eb-9587-c04fc86effca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:02.788179 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-1a1651c6-449c-44eb-9587-c04fc86effca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:02.883590 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1050/2105] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:31:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:31:02.892044 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca474d-b3e4-49d6-8499-ec1010ad7a66 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:02.896577 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca474d-b3e4-49d6-8499-ec1010ad7a66 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:02.897285 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca474d-b3e4-49d6-8499-ec1010ad7a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:02.906127 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:02.966451 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-aaca474d-b3e4-49d6-8499-ec1010ad7a66 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:31:02.971362 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-aaca474d-b3e4-49d6-8499-ec1010ad7a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:03.008185 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1051/2106] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:31:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:31:03.009779 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca474d-b3e4-49d6-8499-ec1010ad7a66 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:03.040182 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca474d-b3e4-49d6-8499-ec1010ad7a66 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:03.067959 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e79fc-2b67-4058-873a-4d89e89b12fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:03.067959 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e79fc-2b67-4058-873a-4d89e89b12fa admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:03.067959 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e79fc-2b67-4058-873a-4d89e89b12fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:03.067959 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e79fc-2b67-4058-873a-4d89e89b12fa admin admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:03.069019 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658e79fc-2b67-4058-873a-4d89e89b12fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:31:03.069299 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658e79fc-2b67-4058-873a-4d89e89b12fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:03.077961 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658e79fc-2b67-4058-873a-4d89e89b12fa admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:03.108312 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1651c6-449c-44eb-9587-c04fc86effca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:03.110285 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1651c6-449c-44eb-9587-c04fc86effca service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:03.132525 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1052/2107] 10.222.0.91 () {58 vars in 1153 bytes} [Tue Aug 30 04:31:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:31:03.135803 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e79fc-2b67-4058-873a-4d89e89b12fa admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:03.155449 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1056/2108] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:31:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 760 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:31:03.181785 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e79fc-2b67-4058-873a-4d89e89b12fa admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:03.213062 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da3edde-d8e5-4953-9812-fec4c19e2295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:03.214042 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3edde-d8e5-4953-9812-fec4c19e2295 admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:03.215175 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3edde-d8e5-4953-9812-fec4c19e2295 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:03.215705 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3edde-d8e5-4953-9812-fec4c19e2295 admin admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:03.216012 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1651c6-449c-44eb-9587-c04fc86effca service cinder] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:03.217757 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-1a1651c6-449c-44eb-9587-c04fc86effca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:03.221128 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da3edde-d8e5-4953-9812-fec4c19e2295 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:03.226696 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da3edde-d8e5-4953-9812-fec4c19e2295 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:03.260130 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1651c6-449c-44eb-9587-c04fc86effca service cinder] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:03.282402 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5a5b18-ddcd-4696-87a1-555f26baf4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:03.285582 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a5b18-ddcd-4696-87a1-555f26baf4dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:03.285882 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a5b18-ddcd-4696-87a1-555f26baf4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:03.286310 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a5b18-ddcd-4696-87a1-555f26baf4dd admin admin] PATH_INFO: `/v3/users/5ddccf0f897245128076eeefb36293dd` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:03.295051 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5a5b18-ddcd-4696-87a1-555f26baf4dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ddccf0f897245128076eeefb36293dd)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:03.309434 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5a5b18-ddcd-4696-87a1-555f26baf4dd admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:03.417679 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1053/2109] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:31:03 2022] POST /identity/v3/projects => generated 391 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:31:03.419162 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da3edde-d8e5-4953-9812-fec4c19e2295 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:03.588573 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-ae5a5b18-ddcd-4696-87a1-555f26baf4dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ddccf0f897245128076eeefb36293dd'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:31:03.612702 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-ae5a5b18-ddcd-4696-87a1-555f26baf4dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ddccf0f897245128076eeefb36293dd'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:31:03.631585 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-ae5a5b18-ddcd-4696-87a1-555f26baf4dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ddccf0f897245128076eeefb36293dd'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:31:03.632987 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-ae5a5b18-ddcd-4696-87a1-555f26baf4dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ddccf0f897245128076eeefb36293dd'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:31:03.669410 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da3edde-d8e5-4953-9812-fec4c19e2295 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:03.701472 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7e16b-ac04-438c-8cb8-6039b5ef066f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:03.702401 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7e16b-ac04-438c-8cb8-6039b5ef066f admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:03.702857 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7e16b-ac04-438c-8cb8-6039b5ef066f admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:03.703271 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7e16b-ac04-438c-8cb8-6039b5ef066f admin admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:03.704144 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e7e16b-ac04-438c-8cb8-6039b5ef066f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:03.706946 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e7e16b-ac04-438c-8cb8-6039b5ef066f admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:03.762163 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-ae5a5b18-ddcd-4696-87a1-555f26baf4dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ddccf0f897245128076eeefb36293dd'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:31:03.780581 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1054/2110] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:31:03 2022] POST /identity/v3/users => generated 296 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:31:03.797558 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7e16b-ac04-438c-8cb8-6039b5ef066f admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:03.802970 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-31e7e16b-ac04-438c-8cb8-6039b5ef066f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:03.811088 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1057/2111] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:31:03 2022] DELETE /identity/v3/users/5ddccf0f897245128076eeefb36293dd => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:31:03.813115 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58dccd-cebf-41ad-81c3-60aed6adfcdc None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:03.819295 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58dccd-cebf-41ad-81c3-60aed6adfcdc None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:03.819942 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58dccd-cebf-41ad-81c3-60aed6adfcdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:03.841007 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7e16b-ac04-438c-8cb8-6039b5ef066f admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:03.898128 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-5f58dccd-cebf-41ad-81c3-60aed6adfcdc None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:31:03.904279 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-5f58dccd-cebf-41ad-81c3-60aed6adfcdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:03.998484 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7df941-f2e9-4122-a1a5-b955854821d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:04.003350 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7df941-f2e9-4122-a1a5-b955854821d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:04.004239 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7df941-f2e9-4122-a1a5-b955854821d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:04.006772 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7df941-f2e9-4122-a1a5-b955854821d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:04.007516 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7df941-f2e9-4122-a1a5-b955854821d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:04.009268 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7df941-f2e9-4122-a1a5-b955854821d0 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:04.050402 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:04.061441 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1055/2112] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:31:04.063755 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ec4e1-7303-40e6-8c1b-b5e1a5237ba6 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:04.068959 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ec4e1-7303-40e6-8c1b-b5e1a5237ba6 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:04.069616 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ec4e1-7303-40e6-8c1b-b5e1a5237ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:04.127591 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-e37ec4e1-7303-40e6-8c1b-b5e1a5237ba6 None None] MFA Rules not processed for user `1bc12faf48984335a3515dcde85b5cb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:31:04.130250 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1058/2113] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:31:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:31:04.133016 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-e37ec4e1-7303-40e6-8c1b-b5e1a5237ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:04.134650 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f58dccd-cebf-41ad-81c3-60aed6adfcdc None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:04.177998 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f58dccd-cebf-41ad-81c3-60aed6adfcdc None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:04.195086 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb58f919-cbb5-445b-ae3c-7381262a2961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:04.195965 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58f919-cbb5-445b-ae3c-7381262a2961 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:04.197428 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58f919-cbb5-445b-ae3c-7381262a2961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:04.197428 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58f919-cbb5-445b-ae3c-7381262a2961 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:04.197428 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb58f919-cbb5-445b-ae3c-7381262a2961 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:04.201374 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb58f919-cbb5-445b-ae3c-7381262a2961 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:04.233759 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1059/2114] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:31:04 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:31:04.237428 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb58f919-cbb5-445b-ae3c-7381262a2961 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:04.242660 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-bb58f919-cbb5-445b-ae3c-7381262a2961 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:04.315840 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:04.428685 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1056/2115] 10.222.0.91 () {58 vars in 967 bytes} [Tue Aug 30 04:31:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:31:04.467186 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37ec4e1-7303-40e6-8c1b-b5e1a5237ba6 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:04.507638 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37ec4e1-7303-40e6-8c1b-b5e1a5237ba6 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:04.523441 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb58f919-cbb5-445b-ae3c-7381262a2961 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:04.539143 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a95b91-f7f8-4237-9ff6-3c6a2952564a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:04.542547 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b44414-a090-4ced-854b-e35e029a41bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:04.543458 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a95b91-f7f8-4237-9ff6-3c6a2952564a admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:04.544206 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a95b91-f7f8-4237-9ff6-3c6a2952564a admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:04.545627 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b44414-a090-4ced-854b-e35e029a41bb service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:04.546439 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a95b91-f7f8-4237-9ff6-3c6a2952564a admin admin] PATH_INFO: `/v3/projects/0f739b7a3ddd441ca0dd521be98a229e/users/1462b90453c0410f97ef84b9759169d5/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:04.549358 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b44414-a090-4ced-854b-e35e029a41bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:04.549969 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b44414-a090-4ced-854b-e35e029a41bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:04.578034 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b44414-a090-4ced-854b-e35e029a41bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:04.583777 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b44414-a090-4ced-854b-e35e029a41bb service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:04.595992 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a95b91-f7f8-4237-9ff6-3c6a2952564a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f739b7a3ddd441ca0dd521be98a229e, user_id=1462b90453c0410f97ef84b9759169d5, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:04.603318 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a95b91-f7f8-4237-9ff6-3c6a2952564a admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:04.648563 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1060/2116] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:31:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:31:04.665616 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b44414-a090-4ced-854b-e35e029a41bb service neutron] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:04.673699 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-33b44414-a090-4ced-854b-e35e029a41bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:04.697347 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1057/2117] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:31:04 2022] PUT /identity/v3/projects/0f739b7a3ddd441ca0dd521be98a229e/users/1462b90453c0410f97ef84b9759169d5/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:31:04.710969 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e469c-bf04-4a7e-b7a4-9a6416f1a169 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:04.711429 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e469c-bf04-4a7e-b7a4-9a6416f1a169 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:04.711891 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e469c-bf04-4a7e-b7a4-9a6416f1a169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:04.873349 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-116e469c-bf04-4a7e-b7a4-9a6416f1a169 None None] MFA Rules not processed for user `1462b90453c0410f97ef84b9759169d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:31:04.882460 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-116e469c-bf04-4a7e-b7a4-9a6416f1a169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:05.092853 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b44414-a090-4ced-854b-e35e029a41bb service neutron] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:05.262548 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1058/2118] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:31:04 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 553 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:31:05.265160 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d4e76-1ac1-4112-b529-4adf32738bd9 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:05.266036 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d4e76-1ac1-4112-b529-4adf32738bd9 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:05.266551 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d4e76-1ac1-4112-b529-4adf32738bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:05.359315 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-4e1d4e76-1ac1-4112-b529-4adf32738bd9 None None] MFA Rules not processed for user `5adb079fad6c41aca6a619a71a3b7c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:31:05.362206 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-4e1d4e76-1ac1-4112-b529-4adf32738bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:05.363320 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d5d843-828a-4283-9f33-7dd8cfda8dab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b50f9552124b07822ae63c1d553864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:05.365102 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d5d843-828a-4283-9f33-7dd8cfda8dab service swift] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:05.365568 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d5d843-828a-4283-9f33-7dd8cfda8dab service swift] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:05.366028 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d5d843-828a-4283-9f33-7dd8cfda8dab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:05.551643 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:05.569822 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1059/2119] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:31:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:31:05.569822 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d4e76-1ac1-4112-b529-4adf32738bd9 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:05.572938 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-4e1d4e76-1ac1-4112-b529-4adf32738bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:05.589267 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d5d843-828a-4283-9f33-7dd8cfda8dab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:05.593721 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d5d843-828a-4283-9f33-7dd8cfda8dab service swift] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:05.604938 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1061/2120] 10.222.0.91 () {60 vars in 1384 bytes} [Tue Aug 30 04:31:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 955 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:31:05.605889 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d5d843-828a-4283-9f33-7dd8cfda8dab service swift] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:05.607559 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-31d5d843-828a-4283-9f33-7dd8cfda8dab service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:05.625888 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:05.731739 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d4e76-1ac1-4112-b529-4adf32738bd9 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:05.741195 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8ad96-db1b-4a8a-9787-32ece5cea5af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:05.749517 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8ad96-db1b-4a8a-9787-32ece5cea5af service cinder] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:05.752701 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8ad96-db1b-4a8a-9787-32ece5cea5af service cinder] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:05.752701 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8ad96-db1b-4a8a-9787-32ece5cea5af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:05.793739 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c8ad96-db1b-4a8a-9787-32ece5cea5af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:05.797946 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c8ad96-db1b-4a8a-9787-32ece5cea5af service cinder] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:05.827886 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1060/2121] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:31:05 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:31:06.092273 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d5d843-828a-4283-9f33-7dd8cfda8dab service swift] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:06.124357 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ae344-0e5f-4500-a574-87c7a9538994 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd806295278ae4997b5c6968aa553290c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:06.126208 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ae344-0e5f-4500-a574-87c7a9538994 service nova] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:06.126896 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ae344-0e5f-4500-a574-87c7a9538994 service nova] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:06.127451 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ae344-0e5f-4500-a574-87c7a9538994 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:06.156284 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8ae344-0e5f-4500-a574-87c7a9538994 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:06.162721 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8ae344-0e5f-4500-a574-87c7a9538994 service nova] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:06.206185 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1062/2122] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:31:05 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:31:06.826467 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8ad96-db1b-4a8a-9787-32ece5cea5af service cinder] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:06.829322 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-96c8ad96-db1b-4a8a-9787-32ece5cea5af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:07.358652 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8ad96-db1b-4a8a-9787-32ece5cea5af service cinder] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:07.382371 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d63548-b780-494f-a226-774571a1c0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:07.387408 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d63548-b780-494f-a226-774571a1c0b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:07.387882 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d63548-b780-494f-a226-774571a1c0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:07.388374 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d63548-b780-494f-a226-774571a1c0b7 admin admin] PATH_INFO: `/v3/projects/ccca99871c65472bb4df307b70d8d75b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:07.398842 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d63548-b780-494f-a226-774571a1c0b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccca99871c65472bb4df307b70d8d75b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:07.408882 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d63548-b780-494f-a226-774571a1c0b7 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:07.657790 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-b7d63548-b780-494f-a226-774571a1c0b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccca99871c65472bb4df307b70d8d75b', 'request_id': 'req-b7d63548-b780-494f-a226-774571a1c0b7'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:31:07.684317 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-b7d63548-b780-494f-a226-774571a1c0b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccca99871c65472bb4df307b70d8d75b', 'request_id': 'req-b7d63548-b780-494f-a226-774571a1c0b7'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:31:07.750321 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-b7d63548-b780-494f-a226-774571a1c0b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccca99871c65472bb4df307b70d8d75b', 'request_id': 'req-b7d63548-b780-494f-a226-774571a1c0b7'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:31:07.827776 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-b7d63548-b780-494f-a226-774571a1c0b7 admin admin] The token cache is being invalidate because project ccca99871c65472bb4df307b70d8d75b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:31:07.828738 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-b7d63548-b780-494f-a226-774571a1c0b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:31:07.829491 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-b7d63548-b780-494f-a226-774571a1c0b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:31:07.846838 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1061/2123] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:31:06 2022] DELETE /identity/v3/projects/ccca99871c65472bb4df307b70d8d75b => generated 0 bytes in 1013 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:31:07.847255 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f661439a-b18c-474d-87e5-d5ae2fb6b0ab None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:07.848050 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f661439a-b18c-474d-87e5-d5ae2fb6b0ab None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:07.848050 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f661439a-b18c-474d-87e5-d5ae2fb6b0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:07.998368 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-f661439a-b18c-474d-87e5-d5ae2fb6b0ab None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:31:08.007517 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-f661439a-b18c-474d-87e5-d5ae2fb6b0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:08.302362 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1063/2124] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:31:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 457 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:31:08.326967 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7d6b2-1fd7-4c5e-94a6-2555a54561db None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:08.327770 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7d6b2-1fd7-4c5e-94a6-2555a54561db None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:08.328698 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7d6b2-1fd7-4c5e-94a6-2555a54561db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:08.438224 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-33f7d6b2-1fd7-4c5e-94a6-2555a54561db None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:31:08.456381 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-33f7d6b2-1fd7-4c5e-94a6-2555a54561db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:08.490884 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1062/2125] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:31:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:31:08.491164 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f661439a-b18c-474d-87e5-d5ae2fb6b0ab None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:08.532986 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f661439a-b18c-474d-87e5-d5ae2fb6b0ab None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:08.586849 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1184031-21a2-45ba-9bca-595d5e25b933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:08.587858 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1184031-21a2-45ba-9bca-595d5e25b933 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:08.588388 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1184031-21a2-45ba-9bca-595d5e25b933 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:08.588872 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1184031-21a2-45ba-9bca-595d5e25b933 admin admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:08.590044 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1184031-21a2-45ba-9bca-595d5e25b933 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:31:08.590554 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1184031-21a2-45ba-9bca-595d5e25b933 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:08.616159 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1184031-21a2-45ba-9bca-595d5e25b933 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:08.728528 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1064/2126] 10.222.0.91 () {58 vars in 1153 bytes} [Tue Aug 30 04:31:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:31:08.737110 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f7d6b2-1fd7-4c5e-94a6-2555a54561db None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:08.774727 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f7d6b2-1fd7-4c5e-94a6-2555a54561db None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:08.820273 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3890eb0f-7370-49ea-95b6-b2d63c32a422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:08.823488 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890eb0f-7370-49ea-95b6-b2d63c32a422 admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:08.825932 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890eb0f-7370-49ea-95b6-b2d63c32a422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:08.831079 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890eb0f-7370-49ea-95b6-b2d63c32a422 admin admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:08.835803 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3890eb0f-7370-49ea-95b6-b2d63c32a422 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:08.846014 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3890eb0f-7370-49ea-95b6-b2d63c32a422 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:09.038822 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1063/2127] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:31:08 2022] POST /identity/v3/projects => generated 385 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:31:09.044079 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1184031-21a2-45ba-9bca-595d5e25b933 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:09.061545 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1184031-21a2-45ba-9bca-595d5e25b933 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:09.343592 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5384b28f-e382-4c5e-91e2-7aa0c7246da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:09.347301 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5384b28f-e382-4c5e-91e2-7aa0c7246da0 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:09.347678 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5384b28f-e382-4c5e-91e2-7aa0c7246da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:09.348089 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5384b28f-e382-4c5e-91e2-7aa0c7246da0 admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:09.350185 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5384b28f-e382-4c5e-91e2-7aa0c7246da0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:09.354923 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5384b28f-e382-4c5e-91e2-7aa0c7246da0 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:09.416707 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3890eb0f-7370-49ea-95b6-b2d63c32a422 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:09.430170 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1065/2128] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:31:09 2022] POST /identity/v3/users => generated 293 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:31:09.430462 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:09.440188 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3890eb0f-7370-49ea-95b6-b2d63c32a422 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:09.468594 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce952da-b523-4b86-a86f-0a478da800c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:09.470330 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce952da-b523-4b86-a86f-0a478da800c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:09.471049 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce952da-b523-4b86-a86f-0a478da800c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:09.471697 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce952da-b523-4b86-a86f-0a478da800c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:09.477000 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce952da-b523-4b86-a86f-0a478da800c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:09.494948 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce952da-b523-4b86-a86f-0a478da800c1 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:09.537493 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1064/2129] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:31:09.543928 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5384b28f-e382-4c5e-91e2-7aa0c7246da0 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:09.581917 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5384b28f-e382-4c5e-91e2-7aa0c7246da0 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:09.622054 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b535cf-b7b2-473e-8041-cd02c6fc37f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:09.623127 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b535cf-b7b2-473e-8041-cd02c6fc37f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:09.623611 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b535cf-b7b2-473e-8041-cd02c6fc37f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:09.627003 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b535cf-b7b2-473e-8041-cd02c6fc37f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:09.628311 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b535cf-b7b2-473e-8041-cd02c6fc37f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:09.632147 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b535cf-b7b2-473e-8041-cd02c6fc37f0 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:09.672341 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:09.722733 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1066/2130] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:31:09.731525 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce952da-b523-4b86-a86f-0a478da800c1 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:09.759617 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce952da-b523-4b86-a86f-0a478da800c1 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:09.805456 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57e216-3286-449c-af5c-bdf4e7f3fe47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:09.806470 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57e216-3286-449c-af5c-bdf4e7f3fe47 admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:09.807922 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57e216-3286-449c-af5c-bdf4e7f3fe47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:09.808706 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57e216-3286-449c-af5c-bdf4e7f3fe47 admin admin] PATH_INFO: `/v3/projects/c57bd2abb1034a6b8bc8e27ed6381e86/users/fe961aa9542c4798b1705175032ed39d/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:09.872195 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a57e216-3286-449c-af5c-bdf4e7f3fe47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c57bd2abb1034a6b8bc8e27ed6381e86, user_id=fe961aa9542c4798b1705175032ed39d, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:09.896746 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a57e216-3286-449c-af5c-bdf4e7f3fe47 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:09.948618 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1065/2131] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:31:09 2022] PUT /identity/v3/projects/c57bd2abb1034a6b8bc8e27ed6381e86/users/fe961aa9542c4798b1705175032ed39d/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:31:09.964042 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04fbcfa-b609-4502-9fe8-050f7f5a75c9 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:09.964363 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04fbcfa-b609-4502-9fe8-050f7f5a75c9 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:09.964523 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04fbcfa-b609-4502-9fe8-050f7f5a75c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:10.042051 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-f04fbcfa-b609-4502-9fe8-050f7f5a75c9 None None] MFA Rules not processed for user `fe961aa9542c4798b1705175032ed39d`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:31:10.042303 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-f04fbcfa-b609-4502-9fe8-050f7f5a75c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:10.299974 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1067/2132] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:31:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:31:10.312121 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57e216-3286-449c-af5c-bdf4e7f3fe47 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:10.314258 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-1a57e216-3286-449c-af5c-bdf4e7f3fe47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:10.480910 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57e216-3286-449c-af5c-bdf4e7f3fe47 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:10.493760 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d319415b-543f-4708-8d9d-4dd6785d0df4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:10.494411 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319415b-543f-4708-8d9d-4dd6785d0df4 service cinder] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:10.494687 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319415b-543f-4708-8d9d-4dd6785d0df4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:10.494962 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319415b-543f-4708-8d9d-4dd6785d0df4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:10.525176 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d319415b-543f-4708-8d9d-4dd6785d0df4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:10.526694 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d319415b-543f-4708-8d9d-4dd6785d0df4 service cinder] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:10.549064 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1066/2133] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:31:10 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:31:11.640253 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04fbcfa-b609-4502-9fe8-050f7f5a75c9 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:11.646706 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-f04fbcfa-b609-4502-9fe8-050f7f5a75c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:11.864065 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04fbcfa-b609-4502-9fe8-050f7f5a75c9 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:11.874057 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b179b1d8-b416-4cf4-8549-dfa23c7edc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:11.874928 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b179b1d8-b416-4cf4-8549-dfa23c7edc00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:11.875356 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b179b1d8-b416-4cf4-8549-dfa23c7edc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:11.875704 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b179b1d8-b416-4cf4-8549-dfa23c7edc00 admin admin] PATH_INFO: `/v3/users/0ad11e9c9afd47f2833edac5f0b83c61` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:11.877659 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b179b1d8-b416-4cf4-8549-dfa23c7edc00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ad11e9c9afd47f2833edac5f0b83c61)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:11.880346 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b179b1d8-b416-4cf4-8549-dfa23c7edc00 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:11.981635 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-b179b1d8-b416-4cf4-8549-dfa23c7edc00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ad11e9c9afd47f2833edac5f0b83c61'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:31:12.003000 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-b179b1d8-b416-4cf4-8549-dfa23c7edc00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ad11e9c9afd47f2833edac5f0b83c61'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:31:12.026331 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-b179b1d8-b416-4cf4-8549-dfa23c7edc00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ad11e9c9afd47f2833edac5f0b83c61'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:31:12.027324 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-b179b1d8-b416-4cf4-8549-dfa23c7edc00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ad11e9c9afd47f2833edac5f0b83c61'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:31:12.051709 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-b179b1d8-b416-4cf4-8549-dfa23c7edc00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ad11e9c9afd47f2833edac5f0b83c61'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:31:12.063807 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1068/2134] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:31:11 2022] DELETE /identity/v3/users/0ad11e9c9afd47f2833edac5f0b83c61 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:31:12.070179 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05016bc6-8809-4c21-b5ed-82b1ad87372b None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:12.071104 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05016bc6-8809-4c21-b5ed-82b1ad87372b None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:12.071317 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05016bc6-8809-4c21-b5ed-82b1ad87372b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:12.121514 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-05016bc6-8809-4c21-b5ed-82b1ad87372b None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:31:12.123833 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-05016bc6-8809-4c21-b5ed-82b1ad87372b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:12.257042 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1067/2135] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:31:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:31:12.271972 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b179b1d8-b416-4cf4-8549-dfa23c7edc00 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:12.273784 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-b179b1d8-b416-4cf4-8549-dfa23c7edc00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:12.298486 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:12.407641 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b179b1d8-b416-4cf4-8549-dfa23c7edc00 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:12.415771 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606bd9a3-c5ea-4a7e-8509-98435bee4a75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:12.417568 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606bd9a3-c5ea-4a7e-8509-98435bee4a75 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:12.417568 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606bd9a3-c5ea-4a7e-8509-98435bee4a75 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:12.417801 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606bd9a3-c5ea-4a7e-8509-98435bee4a75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:12.437610 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606bd9a3-c5ea-4a7e-8509-98435bee4a75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:12.440113 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606bd9a3-c5ea-4a7e-8509-98435bee4a75 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:12.485665 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1069/2136] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:31:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:31:12.507229 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d074c08-8890-4a97-916c-bd1d5744c9b0 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:12.508243 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d074c08-8890-4a97-916c-bd1d5744c9b0 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:12.508982 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d074c08-8890-4a97-916c-bd1d5744c9b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:12.634619 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-3d074c08-8890-4a97-916c-bd1d5744c9b0 None None] MFA Rules not processed for user `5adb079fad6c41aca6a619a71a3b7c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:31:12.645339 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-3d074c08-8890-4a97-916c-bd1d5744c9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:12.861649 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1068/2137] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:31:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:31:13.543814 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606bd9a3-c5ea-4a7e-8509-98435bee4a75 service neutron] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:13.546595 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-606bd9a3-c5ea-4a7e-8509-98435bee4a75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:13.570848 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606bd9a3-c5ea-4a7e-8509-98435bee4a75 service neutron] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:13.585962 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786027b6-da87-45a4-8493-c94fe65faad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:13.586603 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786027b6-da87-45a4-8493-c94fe65faad9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:13.587046 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786027b6-da87-45a4-8493-c94fe65faad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:13.587465 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786027b6-da87-45a4-8493-c94fe65faad9 admin admin] PATH_INFO: `/v3/projects/92b93bd6951d461ba2f6586f3566699d` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:13.594370 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786027b6-da87-45a4-8493-c94fe65faad9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92b93bd6951d461ba2f6586f3566699d)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:13.596514 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786027b6-da87-45a4-8493-c94fe65faad9 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:13.845024 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-786027b6-da87-45a4-8493-c94fe65faad9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92b93bd6951d461ba2f6586f3566699d', 'request_id': 'req-786027b6-da87-45a4-8493-c94fe65faad9'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:31:13.857517 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-786027b6-da87-45a4-8493-c94fe65faad9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92b93bd6951d461ba2f6586f3566699d', 'request_id': 'req-786027b6-da87-45a4-8493-c94fe65faad9'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:31:13.872275 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-786027b6-da87-45a4-8493-c94fe65faad9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92b93bd6951d461ba2f6586f3566699d', 'request_id': 'req-786027b6-da87-45a4-8493-c94fe65faad9'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:31:13.903300 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-786027b6-da87-45a4-8493-c94fe65faad9 admin admin] The token cache is being invalidate because project 92b93bd6951d461ba2f6586f3566699d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:31:13.904005 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-786027b6-da87-45a4-8493-c94fe65faad9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:31:13.905929 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-786027b6-da87-45a4-8493-c94fe65faad9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:31:13.917504 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1070/2138] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:31:13 2022] DELETE /identity/v3/projects/92b93bd6951d461ba2f6586f3566699d => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:31:13.928612 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423adef1-1324-4193-87c7-4bff697d67e6 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:13.930098 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423adef1-1324-4193-87c7-4bff697d67e6 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:13.930872 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423adef1-1324-4193-87c7-4bff697d67e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:13.971592 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-423adef1-1324-4193-87c7-4bff697d67e6 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:31:13.974226 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-423adef1-1324-4193-87c7-4bff697d67e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:14.001644 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:14.109634 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1069/2139] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:31:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:31:14.115235 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbb407-2602-4520-8693-c854a6ee18e0 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:14.116100 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbb407-2602-4520-8693-c854a6ee18e0 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:14.117224 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbb407-2602-4520-8693-c854a6ee18e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:14.157683 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-59fbb407-2602-4520-8693-c854a6ee18e0 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:31:14.160559 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-59fbb407-2602-4520-8693-c854a6ee18e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:14.175961 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1071/2140] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:31:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:31:14.182454 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423adef1-1324-4193-87c7-4bff697d67e6 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:14.203295 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423adef1-1324-4193-87c7-4bff697d67e6 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:14.214423 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8652d2-ecbc-44cb-838d-539db3acd1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:14.215598 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8652d2-ecbc-44cb-838d-539db3acd1ab admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:14.216985 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8652d2-ecbc-44cb-838d-539db3acd1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:14.216985 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8652d2-ecbc-44cb-838d-539db3acd1ab admin admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:14.218069 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8652d2-ecbc-44cb-838d-539db3acd1ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:31:14.218693 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8652d2-ecbc-44cb-838d-539db3acd1ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:14.222518 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8652d2-ecbc-44cb-838d-539db3acd1ab admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:14.257660 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1070/2141] 10.222.0.91 () {58 vars in 1153 bytes} [Tue Aug 30 04:31:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:31:14.264946 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fbb407-2602-4520-8693-c854a6ee18e0 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:14.286355 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fbb407-2602-4520-8693-c854a6ee18e0 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:14.298288 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd0596-7c17-4765-8958-f6fa0459f59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:14.299460 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd0596-7c17-4765-8958-f6fa0459f59f admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:14.299895 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd0596-7c17-4765-8958-f6fa0459f59f admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:14.300454 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd0596-7c17-4765-8958-f6fa0459f59f admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:14.301794 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bd0596-7c17-4765-8958-f6fa0459f59f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:14.305402 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bd0596-7c17-4765-8958-f6fa0459f59f admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:14.364086 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1072/2142] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:31:14 2022] POST /identity/v3/projects => generated 371 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:31:14.371868 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8652d2-ecbc-44cb-838d-539db3acd1ab admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:14.400698 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8652d2-ecbc-44cb-838d-539db3acd1ab admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:14.663964 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d90040-44cd-4524-9116-57f019c8d051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:14.664538 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d90040-44cd-4524-9116-57f019c8d051 admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:14.666243 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d90040-44cd-4524-9116-57f019c8d051 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:14.666542 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d90040-44cd-4524-9116-57f019c8d051 admin admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:14.677506 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d90040-44cd-4524-9116-57f019c8d051 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:14.677506 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d90040-44cd-4524-9116-57f019c8d051 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:14.733734 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1071/2143] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:31:14 2022] POST /identity/v3/users => generated 286 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:31:14.740901 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd0596-7c17-4765-8958-f6fa0459f59f admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:14.795875 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd0596-7c17-4765-8958-f6fa0459f59f admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:14.825796 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e442400-c6f5-4a07-89cf-d154dfa974f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:14.827808 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e442400-c6f5-4a07-89cf-d154dfa974f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:14.828294 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e442400-c6f5-4a07-89cf-d154dfa974f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:14.831479 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e442400-c6f5-4a07-89cf-d154dfa974f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:14.833093 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e442400-c6f5-4a07-89cf-d154dfa974f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:14.842236 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e442400-c6f5-4a07-89cf-d154dfa974f5 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:14.894365 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1073/2144] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:31:14 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:31:14.901270 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d90040-44cd-4524-9116-57f019c8d051 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:14.931878 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d90040-44cd-4524-9116-57f019c8d051 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:14.970514 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0cdbf3-0473-4e46-b649-4290000c8e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:14.973754 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0cdbf3-0473-4e46-b649-4290000c8e80 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:14.974294 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0cdbf3-0473-4e46-b649-4290000c8e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:14.975397 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0cdbf3-0473-4e46-b649-4290000c8e80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:14.980561 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0cdbf3-0473-4e46-b649-4290000c8e80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:14.982389 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0cdbf3-0473-4e46-b649-4290000c8e80 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:15.017426 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1072/2145] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:31:14 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:31:15.024474 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e442400-c6f5-4a07-89cf-d154dfa974f5 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:15.054783 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e442400-c6f5-4a07-89cf-d154dfa974f5 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:15.083152 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c676031c-36e6-46a7-8b87-535f094fc87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:15.089286 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676031c-36e6-46a7-8b87-535f094fc87c admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:15.093250 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676031c-36e6-46a7-8b87-535f094fc87c admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:15.093574 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676031c-36e6-46a7-8b87-535f094fc87c admin admin] PATH_INFO: `/v3/projects/a89458e4a02d40e4abfd8457f31cc0a4/users/563dbe8a50e34840b6d5b2f9ff65e29a/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:15.178521 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c676031c-36e6-46a7-8b87-535f094fc87c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a89458e4a02d40e4abfd8457f31cc0a4, user_id=563dbe8a50e34840b6d5b2f9ff65e29a, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:15.194585 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c676031c-36e6-46a7-8b87-535f094fc87c admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:15.247776 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1074/2146] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:31:15 2022] PUT /identity/v3/projects/a89458e4a02d40e4abfd8457f31cc0a4/users/563dbe8a50e34840b6d5b2f9ff65e29a/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:31:15.260234 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b67114-04a1-467e-971c-5e377ff260d5 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:15.261215 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b67114-04a1-467e-971c-5e377ff260d5 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:15.261964 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b67114-04a1-467e-971c-5e377ff260d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:15.344650 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-f8b67114-04a1-467e-971c-5e377ff260d5 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:31:15.345988 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-f8b67114-04a1-467e-971c-5e377ff260d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:15.516374 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1073/2147] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:31:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:31:15.535410 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c676031c-36e6-46a7-8b87-535f094fc87c admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:15.539088 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-c676031c-36e6-46a7-8b87-535f094fc87c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:15.593372 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:15.664787 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c676031c-36e6-46a7-8b87-535f094fc87c admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:15.676683 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86014feb-ecaa-4cd2-9057-e4b7ac30622f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:15.678397 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86014feb-ecaa-4cd2-9057-e4b7ac30622f service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:15.678397 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86014feb-ecaa-4cd2-9057-e4b7ac30622f service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:15.678924 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86014feb-ecaa-4cd2-9057-e4b7ac30622f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:15.695070 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86014feb-ecaa-4cd2-9057-e4b7ac30622f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:15.696987 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86014feb-ecaa-4cd2-9057-e4b7ac30622f service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:15.725721 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1075/2148] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:31:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:31:19.034559 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b67114-04a1-467e-971c-5e377ff260d5 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:19.049092 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-f8b67114-04a1-467e-971c-5e377ff260d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:19.088451 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b67114-04a1-467e-971c-5e377ff260d5 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:19.106122 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b2988-6bc8-490a-80d0-98e4c42a3671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:19.106811 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b2988-6bc8-490a-80d0-98e4c42a3671 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:19.107264 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b2988-6bc8-490a-80d0-98e4c42a3671 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:19.107548 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b2988-6bc8-490a-80d0-98e4c42a3671 admin admin] PATH_INFO: `/v3/users/fe961aa9542c4798b1705175032ed39d` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:19.110747 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123b2988-6bc8-490a-80d0-98e4c42a3671 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe961aa9542c4798b1705175032ed39d)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:19.113112 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123b2988-6bc8-490a-80d0-98e4c42a3671 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:19.236925 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:19.319798 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-123b2988-6bc8-490a-80d0-98e4c42a3671 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe961aa9542c4798b1705175032ed39d'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:31:19.321650 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-123b2988-6bc8-490a-80d0-98e4c42a3671 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe961aa9542c4798b1705175032ed39d'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:31:19.322885 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-123b2988-6bc8-490a-80d0-98e4c42a3671 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe961aa9542c4798b1705175032ed39d'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:31:19.351660 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-123b2988-6bc8-490a-80d0-98e4c42a3671 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe961aa9542c4798b1705175032ed39d'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:31:19.387882 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-123b2988-6bc8-490a-80d0-98e4c42a3671 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe961aa9542c4798b1705175032ed39d'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:31:19.424840 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1074/2149] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:31:19 2022] DELETE /identity/v3/users/fe961aa9542c4798b1705175032ed39d => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:31:19.435850 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b95cb4-6a3d-4fa7-ab3c-65fd729be701 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:19.436830 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b95cb4-6a3d-4fa7-ab3c-65fd729be701 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:19.436830 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b95cb4-6a3d-4fa7-ab3c-65fd729be701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:19.493501 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-04b95cb4-6a3d-4fa7-ab3c-65fd729be701 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:31:19.497091 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-04b95cb4-6a3d-4fa7-ab3c-65fd729be701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:19.726061 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1076/2150] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:31:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:31:19.738584 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b2988-6bc8-490a-80d0-98e4c42a3671 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:19.741289 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-123b2988-6bc8-490a-80d0-98e4c42a3671 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:19.960349 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b2988-6bc8-490a-80d0-98e4c42a3671 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:20.001494 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ff9a37-8660-49a9-9db7-588c6c8a5347 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:20.001494 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff9a37-8660-49a9-9db7-588c6c8a5347 service neutron] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:20.001494 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff9a37-8660-49a9-9db7-588c6c8a5347 service neutron] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:20.001494 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff9a37-8660-49a9-9db7-588c6c8a5347 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:20.014656 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ff9a37-8660-49a9-9db7-588c6c8a5347 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:20.018000 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ff9a37-8660-49a9-9db7-588c6c8a5347 service neutron] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:20.039803 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1075/2151] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:31:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:31:21.167885 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b95cb4-6a3d-4fa7-ab3c-65fd729be701 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:21.176783 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-04b95cb4-6a3d-4fa7-ab3c-65fd729be701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:21.210079 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b95cb4-6a3d-4fa7-ab3c-65fd729be701 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:21.223943 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c0c92-576c-4842-8a69-a41c0f23d269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:21.224691 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c0c92-576c-4842-8a69-a41c0f23d269 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:21.229270 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c0c92-576c-4842-8a69-a41c0f23d269 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:21.231542 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c0c92-576c-4842-8a69-a41c0f23d269 admin admin] PATH_INFO: `/v3/users/1462b90453c0410f97ef84b9759169d5` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:21.236712 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36c0c92-576c-4842-8a69-a41c0f23d269 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1462b90453c0410f97ef84b9759169d5)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:21.239831 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36c0c92-576c-4842-8a69-a41c0f23d269 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:21.366061 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-a36c0c92-576c-4842-8a69-a41c0f23d269 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1462b90453c0410f97ef84b9759169d5'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:31:21.377518 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-a36c0c92-576c-4842-8a69-a41c0f23d269 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1462b90453c0410f97ef84b9759169d5'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:31:21.401231 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-a36c0c92-576c-4842-8a69-a41c0f23d269 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1462b90453c0410f97ef84b9759169d5'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:31:21.402479 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-a36c0c92-576c-4842-8a69-a41c0f23d269 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1462b90453c0410f97ef84b9759169d5'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:31:21.427076 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-a36c0c92-576c-4842-8a69-a41c0f23d269 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1462b90453c0410f97ef84b9759169d5'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:31:21.443952 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1077/2152] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:31:21 2022] DELETE /identity/v3/users/1462b90453c0410f97ef84b9759169d5 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:31:21.449909 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec0b7d9-bc68-40f8-b776-fb3c2c9c3bae None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:21.450675 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec0b7d9-bc68-40f8-b776-fb3c2c9c3bae None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:21.450842 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec0b7d9-bc68-40f8-b776-fb3c2c9c3bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:21.588217 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-8ec0b7d9-bc68-40f8-b776-fb3c2c9c3bae None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:31:21.594712 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-8ec0b7d9-bc68-40f8-b776-fb3c2c9c3bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:21.611073 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c0c92-576c-4842-8a69-a41c0f23d269 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:21.614442 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-a36c0c92-576c-4842-8a69-a41c0f23d269 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:21.771483 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1076/2153] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:31:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:31:21.792104 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec0b7d9-bc68-40f8-b776-fb3c2c9c3bae None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:21.795137 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-8ec0b7d9-bc68-40f8-b776-fb3c2c9c3bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:21.818079 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:21.873737 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c0c92-576c-4842-8a69-a41c0f23d269 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:21.891401 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7767a648-0932-46f4-9dee-6ee8bcb81ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:21.893047 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767a648-0932-46f4-9dee-6ee8bcb81ebd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:21.896807 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767a648-0932-46f4-9dee-6ee8bcb81ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:21.897188 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767a648-0932-46f4-9dee-6ee8bcb81ebd admin admin] PATH_INFO: `/v3/projects/c57bd2abb1034a6b8bc8e27ed6381e86` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:21.900735 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7767a648-0932-46f4-9dee-6ee8bcb81ebd admin admin] RBAC: Authorizing `identity:delete_project(project_id=c57bd2abb1034a6b8bc8e27ed6381e86)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:21.908196 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7767a648-0932-46f4-9dee-6ee8bcb81ebd admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:21.938502 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:21.992092 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec0b7d9-bc68-40f8-b776-fb3c2c9c3bae None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:22.007509 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec22568-6b42-4fee-bde8-6f2b25a918b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:22.012291 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec22568-6b42-4fee-bde8-6f2b25a918b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:22.012711 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec22568-6b42-4fee-bde8-6f2b25a918b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:22.015831 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec22568-6b42-4fee-bde8-6f2b25a918b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:22.041386 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-7767a648-0932-46f4-9dee-6ee8bcb81ebd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c57bd2abb1034a6b8bc8e27ed6381e86', 'request_id': 'req-7767a648-0932-46f4-9dee-6ee8bcb81ebd'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:31:22.049474 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-7767a648-0932-46f4-9dee-6ee8bcb81ebd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c57bd2abb1034a6b8bc8e27ed6381e86', 'request_id': 'req-7767a648-0932-46f4-9dee-6ee8bcb81ebd'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:31:22.058378 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-7767a648-0932-46f4-9dee-6ee8bcb81ebd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c57bd2abb1034a6b8bc8e27ed6381e86', 'request_id': 'req-7767a648-0932-46f4-9dee-6ee8bcb81ebd'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:31:22.062026 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec22568-6b42-4fee-bde8-6f2b25a918b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:22.069614 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec22568-6b42-4fee-bde8-6f2b25a918b1 service neutron] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:22.086642 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-7767a648-0932-46f4-9dee-6ee8bcb81ebd admin admin] The token cache is being invalidate because project c57bd2abb1034a6b8bc8e27ed6381e86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:31:22.088472 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-7767a648-0932-46f4-9dee-6ee8bcb81ebd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:31:22.090077 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-7767a648-0932-46f4-9dee-6ee8bcb81ebd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:31:22.101928 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1078/2154] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:31:21 2022] DELETE /identity/v3/projects/c57bd2abb1034a6b8bc8e27ed6381e86 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:31:22.102253 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1077/2155] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:31:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:31:22.104718 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743657e3-464c-4e2c-b1ab-09460d256d46 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:22.105165 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743657e3-464c-4e2c-b1ab-09460d256d46 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:22.105579 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743657e3-464c-4e2c-b1ab-09460d256d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:22.133626 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-743657e3-464c-4e2c-b1ab-09460d256d46 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:31:22.135225 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-743657e3-464c-4e2c-b1ab-09460d256d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:22.220117 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1079/2156] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:31:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:31:22.228333 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159708a3-395e-4c87-8356-07b30de7f718 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:22.228879 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159708a3-395e-4c87-8356-07b30de7f718 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:22.229249 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159708a3-395e-4c87-8356-07b30de7f718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:22.257229 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-159708a3-395e-4c87-8356-07b30de7f718 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:31:22.257229 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-159708a3-395e-4c87-8356-07b30de7f718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:22.277156 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1078/2157] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:31:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:31:22.282310 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743657e3-464c-4e2c-b1ab-09460d256d46 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:22.294807 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743657e3-464c-4e2c-b1ab-09460d256d46 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:22.301121 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85a27ce-684b-459d-8feb-bacbe55f460c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:22.301999 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a27ce-684b-459d-8feb-bacbe55f460c admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:22.302526 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a27ce-684b-459d-8feb-bacbe55f460c admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:22.302717 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a27ce-684b-459d-8feb-bacbe55f460c admin admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:22.303410 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85a27ce-684b-459d-8feb-bacbe55f460c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:31:22.303778 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85a27ce-684b-459d-8feb-bacbe55f460c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:22.307058 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85a27ce-684b-459d-8feb-bacbe55f460c admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:22.325895 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159708a3-395e-4c87-8356-07b30de7f718 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:22.333828 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1080/2158] 10.222.0.91 () {58 vars in 1153 bytes} [Tue Aug 30 04:31:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:31:22.338764 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159708a3-395e-4c87-8356-07b30de7f718 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:22.345354 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6641563-0e4c-4ff2-bb3e-5b4ef7710de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:22.346261 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6641563-0e4c-4ff2-bb3e-5b4ef7710de6 admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:22.346439 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6641563-0e4c-4ff2-bb3e-5b4ef7710de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:22.346902 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6641563-0e4c-4ff2-bb3e-5b4ef7710de6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:22.347687 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6641563-0e4c-4ff2-bb3e-5b4ef7710de6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:22.349822 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6641563-0e4c-4ff2-bb3e-5b4ef7710de6 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:22.402562 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1079/2159] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:31:22 2022] POST /identity/v3/projects => generated 365 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:31:22.407089 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85a27ce-684b-459d-8feb-bacbe55f460c admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:22.421632 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85a27ce-684b-459d-8feb-bacbe55f460c admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:22.502249 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8705bfc-c493-4c1f-a11c-eb666b96299f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:22.503267 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8705bfc-c493-4c1f-a11c-eb666b96299f admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:22.503791 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8705bfc-c493-4c1f-a11c-eb666b96299f admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:22.504321 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8705bfc-c493-4c1f-a11c-eb666b96299f admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:22.505520 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8705bfc-c493-4c1f-a11c-eb666b96299f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:22.508240 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8705bfc-c493-4c1f-a11c-eb666b96299f admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:22.522958 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:22.565741 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6641563-0e4c-4ff2-bb3e-5b4ef7710de6 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:22.576599 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1081/2160] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:31:22 2022] POST /identity/v3/users => generated 283 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:31:22.579361 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6641563-0e4c-4ff2-bb3e-5b4ef7710de6 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:22.586924 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a5fb55-1da1-496c-b59e-773511188de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:22.587675 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5fb55-1da1-496c-b59e-773511188de1 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:22.588113 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5fb55-1da1-496c-b59e-773511188de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:22.588503 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5fb55-1da1-496c-b59e-773511188de1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:22.589452 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a5fb55-1da1-496c-b59e-773511188de1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:22.592022 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a5fb55-1da1-496c-b59e-773511188de1 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:22.606227 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1080/2161] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:31:22.611494 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8705bfc-c493-4c1f-a11c-eb666b96299f admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:22.651203 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8705bfc-c493-4c1f-a11c-eb666b96299f admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:22.676127 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f237e2f-a327-4542-9fec-2592075409e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:22.677540 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f237e2f-a327-4542-9fec-2592075409e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:22.677995 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f237e2f-a327-4542-9fec-2592075409e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:22.678539 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f237e2f-a327-4542-9fec-2592075409e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:22.679341 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f237e2f-a327-4542-9fec-2592075409e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:22.687362 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f237e2f-a327-4542-9fec-2592075409e1 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:22.715272 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1082/2162] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:31:22.719534 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a5fb55-1da1-496c-b59e-773511188de1 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:22.737535 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a5fb55-1da1-496c-b59e-773511188de1 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:22.749881 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be652ff9-e47b-4468-8c89-9ec7f0cee068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:22.750621 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be652ff9-e47b-4468-8c89-9ec7f0cee068 admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:22.750911 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be652ff9-e47b-4468-8c89-9ec7f0cee068 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:22.751170 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be652ff9-e47b-4468-8c89-9ec7f0cee068 admin admin] PATH_INFO: `/v3/projects/71fa3342cfe540fbac26a99cadd11cf4/users/2625000b652a40cd87496b008f8faada/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:22.791708 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be652ff9-e47b-4468-8c89-9ec7f0cee068 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71fa3342cfe540fbac26a99cadd11cf4, user_id=2625000b652a40cd87496b008f8faada, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:22.794706 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be652ff9-e47b-4468-8c89-9ec7f0cee068 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:22.842038 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1081/2163] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:31:22 2022] PUT /identity/v3/projects/71fa3342cfe540fbac26a99cadd11cf4/users/2625000b652a40cd87496b008f8faada/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:31:22.864225 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e83e3-3f4d-4278-b188-12ff4f88fd66 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:22.864225 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e83e3-3f4d-4278-b188-12ff4f88fd66 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:22.864703 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e83e3-3f4d-4278-b188-12ff4f88fd66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:22.935163 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-ed9e83e3-3f4d-4278-b188-12ff4f88fd66 None None] MFA Rules not processed for user `2625000b652a40cd87496b008f8faada`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:31:22.936307 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-ed9e83e3-3f4d-4278-b188-12ff4f88fd66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:23.077352 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1083/2164] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:31:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:31:23.104010 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be652ff9-e47b-4468-8c89-9ec7f0cee068 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:23.108368 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-be652ff9-e47b-4468-8c89-9ec7f0cee068 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:23.264541 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be652ff9-e47b-4468-8c89-9ec7f0cee068 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:23.271982 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bda28ad-3d80-4145-8a0c-53ebcad4687a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:23.272584 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda28ad-3d80-4145-8a0c-53ebcad4687a service cinder] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:23.273508 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda28ad-3d80-4145-8a0c-53ebcad4687a service cinder] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:23.273508 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda28ad-3d80-4145-8a0c-53ebcad4687a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:23.297118 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bda28ad-3d80-4145-8a0c-53ebcad4687a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:23.298414 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bda28ad-3d80-4145-8a0c-53ebcad4687a service cinder] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:23.323192 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1082/2165] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:31:23 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:31:23.613276 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e83e3-3f4d-4278-b188-12ff4f88fd66 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:23.631323 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-ed9e83e3-3f4d-4278-b188-12ff4f88fd66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:23.847837 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e83e3-3f4d-4278-b188-12ff4f88fd66 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:23.855157 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f052c944-9c81-445b-bffa-55d997558a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:23.856603 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052c944-9c81-445b-bffa-55d997558a01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:23.857051 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052c944-9c81-445b-bffa-55d997558a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:23.857610 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052c944-9c81-445b-bffa-55d997558a01 admin admin] PATH_INFO: `/v3/projects/0f739b7a3ddd441ca0dd521be98a229e` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:23.859384 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f052c944-9c81-445b-bffa-55d997558a01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f739b7a3ddd441ca0dd521be98a229e)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:23.863975 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f052c944-9c81-445b-bffa-55d997558a01 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:23.983463 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-f052c944-9c81-445b-bffa-55d997558a01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f739b7a3ddd441ca0dd521be98a229e', 'request_id': 'req-f052c944-9c81-445b-bffa-55d997558a01'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:31:24.005374 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-f052c944-9c81-445b-bffa-55d997558a01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f739b7a3ddd441ca0dd521be98a229e', 'request_id': 'req-f052c944-9c81-445b-bffa-55d997558a01'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:31:24.021098 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-f052c944-9c81-445b-bffa-55d997558a01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f739b7a3ddd441ca0dd521be98a229e', 'request_id': 'req-f052c944-9c81-445b-bffa-55d997558a01'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:31:24.040917 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:24.049522 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-f052c944-9c81-445b-bffa-55d997558a01 admin admin] The token cache is being invalidate because project 0f739b7a3ddd441ca0dd521be98a229e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:31:24.054004 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-f052c944-9c81-445b-bffa-55d997558a01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:31:24.055717 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-f052c944-9c81-445b-bffa-55d997558a01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:31:24.059312 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1084/2166] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:31:23 2022] DELETE /identity/v3/projects/0f739b7a3ddd441ca0dd521be98a229e => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:31:24.064722 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a116d0-8661-4862-ba4b-7369684afcb1 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:24.065227 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a116d0-8661-4862-ba4b-7369684afcb1 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:24.065307 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a116d0-8661-4862-ba4b-7369684afcb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:24.113700 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-12a116d0-8661-4862-ba4b-7369684afcb1 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:31:24.115676 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-12a116d0-8661-4862-ba4b-7369684afcb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:24.233604 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1083/2167] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:31:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:31:24.241781 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033defb-2377-475c-b553-b0cf22368384 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:24.242075 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033defb-2377-475c-b553-b0cf22368384 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:24.242464 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033defb-2377-475c-b553-b0cf22368384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:24.270428 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-4033defb-2377-475c-b553-b0cf22368384 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:31:24.272025 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-4033defb-2377-475c-b553-b0cf22368384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:24.286339 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1085/2168] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:31:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:31:24.288090 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a116d0-8661-4862-ba4b-7369684afcb1 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:24.303319 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a116d0-8661-4862-ba4b-7369684afcb1 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:24.328542 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8f0fde-6ef2-4116-855a-0cf1a1ae58f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:24.329722 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f0fde-6ef2-4116-855a-0cf1a1ae58f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:24.329722 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f0fde-6ef2-4116-855a-0cf1a1ae58f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:24.329722 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f0fde-6ef2-4116-855a-0cf1a1ae58f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:24.331153 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8f0fde-6ef2-4116-855a-0cf1a1ae58f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:31:24.331956 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8f0fde-6ef2-4116-855a-0cf1a1ae58f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:24.336152 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8f0fde-6ef2-4116-855a-0cf1a1ae58f1 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:24.359670 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1084/2169] 10.222.0.91 () {58 vars in 1153 bytes} [Tue Aug 30 04:31:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:31:24.361787 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4033defb-2377-475c-b553-b0cf22368384 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:24.380382 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4033defb-2377-475c-b553-b0cf22368384 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:24.389087 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41811756-ac5c-4aeb-a033-e2f96b063f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:24.390478 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41811756-ac5c-4aeb-a033-e2f96b063f20 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:24.390940 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41811756-ac5c-4aeb-a033-e2f96b063f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:24.391446 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41811756-ac5c-4aeb-a033-e2f96b063f20 admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:24.393282 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41811756-ac5c-4aeb-a033-e2f96b063f20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:24.397143 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41811756-ac5c-4aeb-a033-e2f96b063f20 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:24.455649 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1086/2170] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:31:24 2022] POST /identity/v3/projects => generated 383 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:31:24.461373 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8f0fde-6ef2-4116-855a-0cf1a1ae58f1 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:24.481562 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8f0fde-6ef2-4116-855a-0cf1a1ae58f1 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:24.499385 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:24.667498 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5641adc7-91b7-4f3f-b4e5-6051b78e1e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:24.668651 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5641adc7-91b7-4f3f-b4e5-6051b78e1e26 admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:24.669149 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5641adc7-91b7-4f3f-b4e5-6051b78e1e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:24.669639 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5641adc7-91b7-4f3f-b4e5-6051b78e1e26 admin admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:24.670908 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5641adc7-91b7-4f3f-b4e5-6051b78e1e26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:24.675320 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5641adc7-91b7-4f3f-b4e5-6051b78e1e26 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:24.744943 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1085/2171] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:31:24 2022] POST /identity/v3/users => generated 292 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:31:24.746834 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41811756-ac5c-4aeb-a033-e2f96b063f20 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:24.791282 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41811756-ac5c-4aeb-a033-e2f96b063f20 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:24.812065 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8607b434-4e2c-472c-a8d5-3c44aff912a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:24.813967 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8607b434-4e2c-472c-a8d5-3c44aff912a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:24.814789 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8607b434-4e2c-472c-a8d5-3c44aff912a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:24.815400 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8607b434-4e2c-472c-a8d5-3c44aff912a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:24.824351 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8607b434-4e2c-472c-a8d5-3c44aff912a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:24.827640 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8607b434-4e2c-472c-a8d5-3c44aff912a4 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:24.852413 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1087/2172] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:31:24 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:31:24.861203 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5641adc7-91b7-4f3f-b4e5-6051b78e1e26 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:24.901143 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5641adc7-91b7-4f3f-b4e5-6051b78e1e26 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:24.918782 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52481c6-ca9c-44a8-8854-a12474124c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:24.920255 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52481c6-ca9c-44a8-8854-a12474124c29 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:24.921126 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52481c6-ca9c-44a8-8854-a12474124c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:24.921786 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52481c6-ca9c-44a8-8854-a12474124c29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:24.939056 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52481c6-ca9c-44a8-8854-a12474124c29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:24.947418 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52481c6-ca9c-44a8-8854-a12474124c29 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:24.986185 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1086/2173] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:31:24 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:31:24.987018 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8607b434-4e2c-472c-a8d5-3c44aff912a4 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:25.030052 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8607b434-4e2c-472c-a8d5-3c44aff912a4 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:25.049559 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef83ef3-8c66-43c3-9fab-72e5a1ac367c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:25.050954 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef83ef3-8c66-43c3-9fab-72e5a1ac367c admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:25.058948 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef83ef3-8c66-43c3-9fab-72e5a1ac367c admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:25.067023 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef83ef3-8c66-43c3-9fab-72e5a1ac367c admin admin] PATH_INFO: `/v3/projects/da2baee55e704f8cbcf73b9bab63bd9a/users/ba9817cf82004a5e824a93d1b3ede5cb/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:25.095165 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef83ef3-8c66-43c3-9fab-72e5a1ac367c admin admin] RBAC: Authorizing `identity:create_grant(project_id=da2baee55e704f8cbcf73b9bab63bd9a, user_id=ba9817cf82004a5e824a93d1b3ede5cb, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:25.101722 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef83ef3-8c66-43c3-9fab-72e5a1ac367c admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:25.155679 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1088/2174] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:31:24 2022] PUT /identity/v3/projects/da2baee55e704f8cbcf73b9bab63bd9a/users/ba9817cf82004a5e824a93d1b3ede5cb/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:31:25.166137 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c603b-b377-4fa7-84d8-f09561c32fad None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:25.169244 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c603b-b377-4fa7-84d8-f09561c32fad None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:25.169959 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c603b-b377-4fa7-84d8-f09561c32fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:25.267866 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-e11c603b-b377-4fa7-84d8-f09561c32fad None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:31:25.270802 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-e11c603b-b377-4fa7-84d8-f09561c32fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:25.526774 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1087/2175] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:31:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:31:25.544874 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef83ef3-8c66-43c3-9fab-72e5a1ac367c admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:25.547797 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-8ef83ef3-8c66-43c3-9fab-72e5a1ac367c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:25.702433 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef83ef3-8c66-43c3-9fab-72e5a1ac367c admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:25.716000 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd612ab-1ed0-4768-88e6-4954a658af85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:25.716550 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd612ab-1ed0-4768-88e6-4954a658af85 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:25.717117 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd612ab-1ed0-4768-88e6-4954a658af85 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:25.717613 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd612ab-1ed0-4768-88e6-4954a658af85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:25.750292 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd612ab-1ed0-4768-88e6-4954a658af85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:25.753451 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd612ab-1ed0-4768-88e6-4954a658af85 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:25.767304 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1089/2176] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:31:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:31:26.243394 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92731da9-18ac-4d2f-86b7-87469e1a94c3 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:26.245092 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92731da9-18ac-4d2f-86b7-87469e1a94c3 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:26.245835 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92731da9-18ac-4d2f-86b7-87469e1a94c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:26.376527 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-92731da9-18ac-4d2f-86b7-87469e1a94c3 None None] MFA Rules not processed for user `563dbe8a50e34840b6d5b2f9ff65e29a`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:31:26.381486 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-92731da9-18ac-4d2f-86b7-87469e1a94c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:26.704869 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1088/2177] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:31:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 463 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:31:26.711572 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd612ab-1ed0-4768-88e6-4954a658af85 service neutron] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:26.713954 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-7cd612ab-1ed0-4768-88e6-4954a658af85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:26.775004 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd612ab-1ed0-4768-88e6-4954a658af85 service neutron] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:26.790527 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85054bb0-def3-44fb-bd29-bb7e527d284b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:26.791378 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85054bb0-def3-44fb-bd29-bb7e527d284b admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:26.793800 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85054bb0-def3-44fb-bd29-bb7e527d284b admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:26.794434 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85054bb0-def3-44fb-bd29-bb7e527d284b admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:26.798821 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85054bb0-def3-44fb-bd29-bb7e527d284b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:26.813361 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85054bb0-def3-44fb-bd29-bb7e527d284b admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:26.914848 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1090/2178] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:31:26 2022] POST /identity/v3/projects => generated 373 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:31:26.920076 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92731da9-18ac-4d2f-86b7-87469e1a94c3 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:26.942504 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92731da9-18ac-4d2f-86b7-87469e1a94c3 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:26.971755 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:27.139193 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a7c283-4e1c-4017-b9f5-835ff2ab2c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:27.141532 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a7c283-4e1c-4017-b9f5-835ff2ab2c55 admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:27.141975 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a7c283-4e1c-4017-b9f5-835ff2ab2c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:27.142581 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a7c283-4e1c-4017-b9f5-835ff2ab2c55 admin admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:27.144556 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a7c283-4e1c-4017-b9f5-835ff2ab2c55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:27.150989 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a7c283-4e1c-4017-b9f5-835ff2ab2c55 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:27.248411 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1089/2179] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:31:26 2022] POST /identity/v3/users => generated 293 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:31:27.253323 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85054bb0-def3-44fb-bd29-bb7e527d284b admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:27.304494 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85054bb0-def3-44fb-bd29-bb7e527d284b admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:27.323107 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b66e0e3-8b2c-4723-bb3e-cba5291c9986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:27.326087 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66e0e3-8b2c-4723-bb3e-cba5291c9986 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:27.327452 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66e0e3-8b2c-4723-bb3e-cba5291c9986 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:27.327452 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66e0e3-8b2c-4723-bb3e-cba5291c9986 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:27.328509 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b66e0e3-8b2c-4723-bb3e-cba5291c9986 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:27.330732 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b66e0e3-8b2c-4723-bb3e-cba5291c9986 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:27.385605 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1091/2180] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:31:27.391413 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a7c283-4e1c-4017-b9f5-835ff2ab2c55 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:27.444432 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a7c283-4e1c-4017-b9f5-835ff2ab2c55 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:27.481269 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32faa09a-8dd3-4ab5-a94f-b69e8b94a9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:27.484744 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32faa09a-8dd3-4ab5-a94f-b69e8b94a9ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:27.485022 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32faa09a-8dd3-4ab5-a94f-b69e8b94a9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:27.486323 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32faa09a-8dd3-4ab5-a94f-b69e8b94a9ea admin admin] PATH_INFO: `/v3/projects/e657afcad0214c4d8403a0b81dde2e95/users/c174d0fabdfe4ae39f8f0ef6be258d5b/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:27.544214 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32faa09a-8dd3-4ab5-a94f-b69e8b94a9ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=e657afcad0214c4d8403a0b81dde2e95, user_id=c174d0fabdfe4ae39f8f0ef6be258d5b, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:27.561560 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32faa09a-8dd3-4ab5-a94f-b69e8b94a9ea admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:27.598890 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1090/2181] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:31:27 2022] PUT /identity/v3/projects/e657afcad0214c4d8403a0b81dde2e95/users/c174d0fabdfe4ae39f8f0ef6be258d5b/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:31:27.604419 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b66e0e3-8b2c-4723-bb3e-cba5291c9986 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:27.625363 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b66e0e3-8b2c-4723-bb3e-cba5291c9986 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:27.793374 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a798bf21-3793-4548-980d-16db958f48b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:27.794081 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798bf21-3793-4548-980d-16db958f48b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:27.794337 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798bf21-3793-4548-980d-16db958f48b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:27.794604 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798bf21-3793-4548-980d-16db958f48b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:27.795299 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a798bf21-3793-4548-980d-16db958f48b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:27.797711 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a798bf21-3793-4548-980d-16db958f48b7 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:27.811790 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1092/2182] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:31:27.818614 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32faa09a-8dd3-4ab5-a94f-b69e8b94a9ea admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:27.848429 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32faa09a-8dd3-4ab5-a94f-b69e8b94a9ea admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:27.858430 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce40fc0-32a8-4e81-a603-91a15bb0fb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:27.859470 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce40fc0-32a8-4e81-a603-91a15bb0fb18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:27.859961 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce40fc0-32a8-4e81-a603-91a15bb0fb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:27.861368 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce40fc0-32a8-4e81-a603-91a15bb0fb18 admin admin] PATH_INFO: `/v3/projects/e657afcad0214c4d8403a0b81dde2e95/users/c174d0fabdfe4ae39f8f0ef6be258d5b/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:27.866677 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce40fc0-32a8-4e81-a603-91a15bb0fb18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e657afcad0214c4d8403a0b81dde2e95, user_id=c174d0fabdfe4ae39f8f0ef6be258d5b, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:27.876339 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce40fc0-32a8-4e81-a603-91a15bb0fb18 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:27.923726 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1091/2183] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:31:27 2022] PUT /identity/v3/projects/e657afcad0214c4d8403a0b81dde2e95/users/c174d0fabdfe4ae39f8f0ef6be258d5b/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:31:37.805196 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=96,keystone:INSERT=3 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:37.906150 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=36,keystone:INSERT=5 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:41.656900 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02bbd24-df18-44e3-b502-bb12957c6f7c None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:41.657498 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02bbd24-df18-44e3-b502-bb12957c6f7c None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:41.657769 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02bbd24-df18-44e3-b502-bb12957c6f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:41.725019 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-f02bbd24-df18-44e3-b502-bb12957c6f7c None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:31:41.726610 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-f02bbd24-df18-44e3-b502-bb12957c6f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:41.949640 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1093/2184] 10.222.0.83 () {58 vars in 1016 bytes} [Tue Aug 30 04:31:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:31:42.400111 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0de00b-ad56-421d-a7d3-1db37251cf92 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:42.404356 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0de00b-ad56-421d-a7d3-1db37251cf92 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:42.406953 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0de00b-ad56-421d-a7d3-1db37251cf92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:42.531791 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-ec0de00b-ad56-421d-a7d3-1db37251cf92 None None] MFA Rules not processed for user `c174d0fabdfe4ae39f8f0ef6be258d5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:31:42.534317 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-ec0de00b-ad56-421d-a7d3-1db37251cf92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:42.610903 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02bbd24-df18-44e3-b502-bb12957c6f7c None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:42.612833 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-f02bbd24-df18-44e3-b502-bb12957c6f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:42.749464 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02bbd24-df18-44e3-b502-bb12957c6f7c None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:42.761032 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2299f3-92eb-42ff-9ae0-2785cb739e59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd806295278ae4997b5c6968aa553290c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:42.762362 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2299f3-92eb-42ff-9ae0-2785cb739e59 service nova] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:42.762716 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2299f3-92eb-42ff-9ae0-2785cb739e59 service nova] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:42.763045 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2299f3-92eb-42ff-9ae0-2785cb739e59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:42.773351 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2299f3-92eb-42ff-9ae0-2785cb739e59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:42.775202 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2299f3-92eb-42ff-9ae0-2785cb739e59 service nova] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:42.787885 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1094/2185] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:31:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:31:42.789717 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48844fcd-d372-4bf3-a762-4aed905e989a None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:42.790209 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48844fcd-d372-4bf3-a762-4aed905e989a None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:42.790678 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48844fcd-d372-4bf3-a762-4aed905e989a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:42.813822 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1092/2186] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:31:42 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:31:42.824894 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0de00b-ad56-421d-a7d3-1db37251cf92 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:42.826513 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-ec0de00b-ad56-421d-a7d3-1db37251cf92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:42.854517 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-48844fcd-d372-4bf3-a762-4aed905e989a None None] MFA Rules not processed for user `ba9817cf82004a5e824a93d1b3ede5cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:31:42.856368 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0de00b-ad56-421d-a7d3-1db37251cf92 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:42.857990 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-48844fcd-d372-4bf3-a762-4aed905e989a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:42.892096 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179b51e-b8c8-4a6f-ae8a-0552a2b61f49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd806295278ae4997b5c6968aa553290c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:42.893517 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179b51e-b8c8-4a6f-ae8a-0552a2b61f49 service nova] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:42.894160 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179b51e-b8c8-4a6f-ae8a-0552a2b61f49 service nova] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:42.894876 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179b51e-b8c8-4a6f-ae8a-0552a2b61f49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:42.986637 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1095/2187] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:31:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:31:42.993208 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48844fcd-d372-4bf3-a762-4aed905e989a None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:43.018750 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48844fcd-d372-4bf3-a762-4aed905e989a None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:43.030149 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc13969b-35d4-4a82-871a-86d3976640a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:43.030841 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13969b-35d4-4a82-871a-86d3976640a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:43.031159 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13969b-35d4-4a82-871a-86d3976640a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:43.031494 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13969b-35d4-4a82-871a-86d3976640a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:43.033189 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc13969b-35d4-4a82-871a-86d3976640a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:43.037513 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc13969b-35d4-4a82-871a-86d3976640a4 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:43.056671 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179b51e-b8c8-4a6f-ae8a-0552a2b61f49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:43.058308 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179b51e-b8c8-4a6f-ae8a-0552a2b61f49 service nova] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:43.070477 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1093/2188] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:31:42 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:31:43.078511 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:43.108568 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1096/2189] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:31:42 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:31:43.112650 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179b51e-b8c8-4a6f-ae8a-0552a2b61f49 service nova] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:43.150115 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179b51e-b8c8-4a6f-ae8a-0552a2b61f49 service nova] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:43.321582 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465dda9e-80a0-4940-9bdc-daeeb5156ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:43.322876 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465dda9e-80a0-4940-9bdc-daeeb5156ef5 admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:43.323050 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465dda9e-80a0-4940-9bdc-daeeb5156ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:43.323467 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465dda9e-80a0-4940-9bdc-daeeb5156ef5 admin admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:43.324692 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465dda9e-80a0-4940-9bdc-daeeb5156ef5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:43.327861 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465dda9e-80a0-4940-9bdc-daeeb5156ef5 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:43.402725 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc13969b-35d4-4a82-871a-86d3976640a4 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:43.403285 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1094/2190] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:31:43 2022] POST /identity/v3/users => generated 299 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:31:43.428174 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc13969b-35d4-4a82-871a-86d3976640a4 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:43.452184 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab325c76-7693-4b78-bcf1-3156d28da49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:43.453039 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab325c76-7693-4b78-bcf1-3156d28da49b admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:43.459550 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab325c76-7693-4b78-bcf1-3156d28da49b admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:43.462151 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab325c76-7693-4b78-bcf1-3156d28da49b admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:43.463104 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab325c76-7693-4b78-bcf1-3156d28da49b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:43.470156 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab325c76-7693-4b78-bcf1-3156d28da49b admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:43.507201 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1097/2191] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:31:43.509594 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465dda9e-80a0-4940-9bdc-daeeb5156ef5 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:43.527568 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465dda9e-80a0-4940-9bdc-daeeb5156ef5 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:43.548375 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb1f66f-df9a-49d8-932b-3630c03dc62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:43.549543 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb1f66f-df9a-49d8-932b-3630c03dc62d admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:43.549543 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb1f66f-df9a-49d8-932b-3630c03dc62d admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:43.549922 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb1f66f-df9a-49d8-932b-3630c03dc62d admin admin] PATH_INFO: `/v3/projects/6529d016e7774d7689b965de00c5d1a9/users/6a76139959714c6eb61ecca502ab7138/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:43.587712 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:43.596722 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb1f66f-df9a-49d8-932b-3630c03dc62d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6529d016e7774d7689b965de00c5d1a9, user_id=6a76139959714c6eb61ecca502ab7138, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:43.626233 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb1f66f-df9a-49d8-932b-3630c03dc62d admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:43.670629 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1095/2192] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:31:43 2022] PUT /identity/v3/projects/6529d016e7774d7689b965de00c5d1a9/users/6a76139959714c6eb61ecca502ab7138/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:31:43.672631 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab325c76-7693-4b78-bcf1-3156d28da49b admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:43.684012 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab325c76-7693-4b78-bcf1-3156d28da49b admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:43.860800 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70693cd4-b56b-467d-9500-f0d36a1ba26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:43.862973 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70693cd4-b56b-467d-9500-f0d36a1ba26a admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:43.863558 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70693cd4-b56b-467d-9500-f0d36a1ba26a admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:43.864775 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70693cd4-b56b-467d-9500-f0d36a1ba26a admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:43.865730 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70693cd4-b56b-467d-9500-f0d36a1ba26a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:43.867753 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70693cd4-b56b-467d-9500-f0d36a1ba26a admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:43.898010 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1098/2193] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:31:43.902723 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb1f66f-df9a-49d8-932b-3630c03dc62d admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:43.936429 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb1f66f-df9a-49d8-932b-3630c03dc62d admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:43.945365 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be6406-9c01-425f-a991-0ba36eef3731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:43.946147 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be6406-9c01-425f-a991-0ba36eef3731 admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:43.946508 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be6406-9c01-425f-a991-0ba36eef3731 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:43.946850 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be6406-9c01-425f-a991-0ba36eef3731 admin admin] PATH_INFO: `/v3/projects/6529d016e7774d7689b965de00c5d1a9/users/6a76139959714c6eb61ecca502ab7138/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:43.950536 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6be6406-9c01-425f-a991-0ba36eef3731 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6529d016e7774d7689b965de00c5d1a9, user_id=6a76139959714c6eb61ecca502ab7138, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:43.956122 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6be6406-9c01-425f-a991-0ba36eef3731 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:44.007366 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1096/2194] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:31:43 2022] PUT /identity/v3/projects/6529d016e7774d7689b965de00c5d1a9/users/6a76139959714c6eb61ecca502ab7138/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:31:46.528935 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363c1e2-eac6-4964-b7ea-bcb4f1df1c0e None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:46.530080 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363c1e2-eac6-4964-b7ea-bcb4f1df1c0e None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:46.530551 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363c1e2-eac6-4964-b7ea-bcb4f1df1c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:46.594336 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-5363c1e2-eac6-4964-b7ea-bcb4f1df1c0e None None] MFA Rules not processed for user `563dbe8a50e34840b6d5b2f9ff65e29a`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:31:46.600269 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-5363c1e2-eac6-4964-b7ea-bcb4f1df1c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:46.822256 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1099/2195] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:31:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:31:48.774109 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d8766-3941-478b-9b55-c63eaebb731e None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:48.774884 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d8766-3941-478b-9b55-c63eaebb731e None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:48.774884 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d8766-3941-478b-9b55-c63eaebb731e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:48.826300 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-640d8766-3941-478b-9b55-c63eaebb731e None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:31:48.831715 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-640d8766-3941-478b-9b55-c63eaebb731e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:49.237622 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1097/2196] 10.222.0.83 () {58 vars in 1016 bytes} [Tue Aug 30 04:31:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 466 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:31:49.307348 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5363c1e2-eac6-4964-b7ea-bcb4f1df1c0e None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:49.551533 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5363c1e2-eac6-4964-b7ea-bcb4f1df1c0e None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:49.586013 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553dfcfd-d498-42dc-bfb1-cc0d1639db36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd806295278ae4997b5c6968aa553290c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:49.586754 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553dfcfd-d498-42dc-bfb1-cc0d1639db36 service nova] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:49.587439 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553dfcfd-d498-42dc-bfb1-cc0d1639db36 service nova] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:49.588189 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553dfcfd-d498-42dc-bfb1-cc0d1639db36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:49.627089 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553dfcfd-d498-42dc-bfb1-cc0d1639db36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:49.628995 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553dfcfd-d498-42dc-bfb1-cc0d1639db36 service nova] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:49.674506 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1100/2197] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:31:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:31:52.632528 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be4189-8b92-4c6f-937e-cf6582997b63 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:52.634435 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be4189-8b92-4c6f-937e-cf6582997b63 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:52.635701 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be4189-8b92-4c6f-937e-cf6582997b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:52.678120 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-84be4189-8b92-4c6f-937e-cf6582997b63 None None] MFA Rules not processed for user `589bd91dbf434099b15ed7a8680f93bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:31:52.702884 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-84be4189-8b92-4c6f-937e-cf6582997b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:52.877600 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1098/2198] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:31:52 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:31:54.581964 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301c76c-c3bc-4de5-a74b-af494242033a None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:54.584078 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301c76c-c3bc-4de5-a74b-af494242033a None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:54.586662 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301c76c-c3bc-4de5-a74b-af494242033a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:54.642854 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-3301c76c-c3bc-4de5-a74b-af494242033a None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:31:54.651388 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-3301c76c-c3bc-4de5-a74b-af494242033a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:54.695513 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1101/2199] 10.222.0.83 () {58 vars in 1016 bytes} [Tue Aug 30 04:31:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:31:54.727003 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be4189-8b92-4c6f-937e-cf6582997b63 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:54.763128 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be4189-8b92-4c6f-937e-cf6582997b63 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:54.780688 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e5697-fb09-4276-ace1-c44e81acd75b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd806295278ae4997b5c6968aa553290c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:54.781986 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e5697-fb09-4276-ace1-c44e81acd75b service nova] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:54.782364 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e5697-fb09-4276-ace1-c44e81acd75b service nova] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:54.782701 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e5697-fb09-4276-ace1-c44e81acd75b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:54.809183 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814e5697-fb09-4276-ace1-c44e81acd75b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:54.811408 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814e5697-fb09-4276-ace1-c44e81acd75b service nova] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:54.845568 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1099/2200] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:31:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:31:55.658048 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26bf64-4677-46d5-8a44-47f888f522cb None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:55.658048 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26bf64-4677-46d5-8a44-47f888f522cb None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:55.658838 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26bf64-4677-46d5-8a44-47f888f522cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:55.668750 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:55.756078 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-ee26bf64-4677-46d5-8a44-47f888f522cb None None] MFA Rules not processed for user `6a76139959714c6eb61ecca502ab7138`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:31:55.758208 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-ee26bf64-4677-46d5-8a44-47f888f522cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:55.940075 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1102/2201] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:31:55 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:31:59.946724 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e5697-fb09-4276-ace1-c44e81acd75b service nova] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:59.950518 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-814e5697-fb09-4276-ace1-c44e81acd75b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:32:00.051451 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e5697-fb09-4276-ace1-c44e81acd75b service nova] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:32:00.057324 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d9d69d-a002-420b-b28d-aa0f39177745 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2e1344bc54bf388e5ec025ab94c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:32:00.058381 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9d69d-a002-420b-b28d-aa0f39177745 service glance] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:00.059137 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9d69d-a002-420b-b28d-aa0f39177745 service glance] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:00.059596 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9d69d-a002-420b-b28d-aa0f39177745 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:00.093381 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:00.165274 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d9d69d-a002-420b-b28d-aa0f39177745 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:32:00.168687 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d9d69d-a002-420b-b28d-aa0f39177745 service glance] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:32:00.183178 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1100/2202] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:31:59 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:32:00.388135 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57450562-efbb-4aa9-bd6c-d8310d066a71 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:00.389214 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57450562-efbb-4aa9-bd6c-d8310d066a71 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:00.389751 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57450562-efbb-4aa9-bd6c-d8310d066a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:00.431046 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-57450562-efbb-4aa9-bd6c-d8310d066a71 None None] MFA Rules not processed for user `1bc12faf48984335a3515dcde85b5cb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:32:00.433744 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-57450562-efbb-4aa9-bd6c-d8310d066a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:32:00.552016 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1103/2203] 10.222.0.91 () {58 vars in 1009 bytes} [Tue Aug 30 04:32:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:32:00.595054 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d9d69d-a002-420b-b28d-aa0f39177745 service glance] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:32:00.597014 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-04d9d69d-a002-420b-b28d-aa0f39177745 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:32:00.783248 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d9d69d-a002-420b-b28d-aa0f39177745 service glance] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:32:00.799769 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e94056-f557-4fbe-8af9-7a945fb97ccf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b50f9552124b07822ae63c1d553864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:32:00.801164 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e94056-f557-4fbe-8af9-7a945fb97ccf service swift] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:00.801882 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e94056-f557-4fbe-8af9-7a945fb97ccf service swift] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:00.801882 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e94056-f557-4fbe-8af9-7a945fb97ccf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:00.813602 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e94056-f557-4fbe-8af9-7a945fb97ccf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:32:00.815224 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e94056-f557-4fbe-8af9-7a945fb97ccf service swift] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:32:00.827688 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1101/2204] 10.222.0.91 () {60 vars in 1384 bytes} [Tue Aug 30 04:32:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 04:32:00.949826 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9b12d-b846-458b-a8b1-fad322b1862c None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:00.950187 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9b12d-b846-458b-a8b1-fad322b1862c None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:00.950578 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9b12d-b846-458b-a8b1-fad322b1862c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:01.017325 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-08c9b12d-b846-458b-a8b1-fad322b1862c None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:32:01.019469 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-08c9b12d-b846-458b-a8b1-fad322b1862c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:32:01.033585 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1104/2205] 10.222.0.83 () {58 vars in 1016 bytes} [Tue Aug 30 04:32:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:32:01.085913 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e94056-f557-4fbe-8af9-7a945fb97ccf service swift] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:32:01.151377 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e94056-f557-4fbe-8af9-7a945fb97ccf service swift] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:32:01.208109 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d28d6a5-4f60-4ad1-8907-c6f917411e63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd806295278ae4997b5c6968aa553290c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:32:01.209474 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28d6a5-4f60-4ad1-8907-c6f917411e63 service nova] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:01.211297 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28d6a5-4f60-4ad1-8907-c6f917411e63 service nova] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:01.212497 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28d6a5-4f60-4ad1-8907-c6f917411e63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:01.246459 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d28d6a5-4f60-4ad1-8907-c6f917411e63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:32:01.250362 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d28d6a5-4f60-4ad1-8907-c6f917411e63 service nova] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:32:01.287878 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1102/2206] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:32:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:32:05.539380 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc0f222-15be-4b7e-a63e-385f592f318e None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:05.542737 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc0f222-15be-4b7e-a63e-385f592f318e None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:05.543249 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc0f222-15be-4b7e-a63e-385f592f318e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:05.591233 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-efc0f222-15be-4b7e-a63e-385f592f318e None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:32:05.594061 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-efc0f222-15be-4b7e-a63e-385f592f318e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:32:05.612373 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1105/2207] 10.222.0.83 () {58 vars in 1016 bytes} [Tue Aug 30 04:32:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:32:05.647170 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d28d6a5-4f60-4ad1-8907-c6f917411e63 service nova] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:32:05.670499 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d28d6a5-4f60-4ad1-8907-c6f917411e63 service nova] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:32:05.682351 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddaef40-e362-4fb3-8390-4766512486cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd806295278ae4997b5c6968aa553290c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:32:05.684272 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddaef40-e362-4fb3-8390-4766512486cc service nova] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:05.685319 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddaef40-e362-4fb3-8390-4766512486cc service nova] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:05.703419 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddaef40-e362-4fb3-8390-4766512486cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:05.730978 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddaef40-e362-4fb3-8390-4766512486cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:32:05.735399 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddaef40-e362-4fb3-8390-4766512486cc service nova] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:32:05.770619 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1103/2208] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:32:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:32:06.220457 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fcd5ef-b5f0-4f87-903c-8414756b8102 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:06.220910 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fcd5ef-b5f0-4f87-903c-8414756b8102 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:06.221333 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fcd5ef-b5f0-4f87-903c-8414756b8102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:06.275404 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-b7fcd5ef-b5f0-4f87-903c-8414756b8102 None None] MFA Rules not processed for user `1bc12faf48984335a3515dcde85b5cb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:32:06.281056 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-b7fcd5ef-b5f0-4f87-903c-8414756b8102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:32:06.306324 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1106/2209] 10.222.0.91 () {58 vars in 1009 bytes} [Tue Aug 30 04:32:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:32:06.338388 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddaef40-e362-4fb3-8390-4766512486cc service nova] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:32:06.370358 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddaef40-e362-4fb3-8390-4766512486cc service nova] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:32:06.381099 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba1e383-c596-4117-8fe9-472120e8a4b4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b50f9552124b07822ae63c1d553864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:32:06.382525 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1e383-c596-4117-8fe9-472120e8a4b4 service swift] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:06.383318 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1e383-c596-4117-8fe9-472120e8a4b4 service swift] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:06.384152 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1e383-c596-4117-8fe9-472120e8a4b4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:06.404356 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba1e383-c596-4117-8fe9-472120e8a4b4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:32:06.407901 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba1e383-c596-4117-8fe9-472120e8a4b4 service swift] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:32:06.428923 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1104/2210] 10.222.0.91 () {60 vars in 1384 bytes} [Tue Aug 30 04:32:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:32:10.063493 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9e2eb-4adc-4dcc-923a-a918ba084024 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:10.064468 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9e2eb-4adc-4dcc-923a-a918ba084024 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:10.064468 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9e2eb-4adc-4dcc-923a-a918ba084024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:10.109346 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-8de9e2eb-4adc-4dcc-923a-a918ba084024 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:32:10.110881 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-8de9e2eb-4adc-4dcc-923a-a918ba084024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:32:10.131600 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1107/2211] 10.222.0.83 () {58 vars in 1016 bytes} [Tue Aug 30 04:32:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:32:10.204695 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba1e383-c596-4117-8fe9-472120e8a4b4 service swift] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:32:10.229773 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba1e383-c596-4117-8fe9-472120e8a4b4 service swift] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:32:10.250394 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1621e80-6773-4c7a-8695-2f7577853f26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd806295278ae4997b5c6968aa553290c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:32:10.252506 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1621e80-6773-4c7a-8695-2f7577853f26 service nova] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:10.253042 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1621e80-6773-4c7a-8695-2f7577853f26 service nova] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:10.253741 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1621e80-6773-4c7a-8695-2f7577853f26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:10.312479 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1621e80-6773-4c7a-8695-2f7577853f26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:32:10.317583 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1621e80-6773-4c7a-8695-2f7577853f26 service nova] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:32:10.388213 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1105/2212] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:32:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:32:15.377959 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02264d57-5094-4ed3-8273-2258d4ddb469 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:15.377959 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02264d57-5094-4ed3-8273-2258d4ddb469 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:15.377959 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02264d57-5094-4ed3-8273-2258d4ddb469 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:15.377959 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1108/2213] 10.222.0.91 () {54 vars in 961 bytes} [Tue Aug 30 04:32:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:32:15.385822 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a0784-e560-48e1-8cb7-af4df6f6ba9c None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:15.385822 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a0784-e560-48e1-8cb7-af4df6f6ba9c None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:15.385822 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a0784-e560-48e1-8cb7-af4df6f6ba9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:15.469151 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-9a1a0784-e560-48e1-8cb7-af4df6f6ba9c None None] MFA Rules not processed for user `47a092fbe1334f7e9ae4ba9bdb5e9f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:32:15.471576 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-9a1a0784-e560-48e1-8cb7-af4df6f6ba9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:32:15.750678 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:15.810777 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1106/2214] 10.222.0.91 () {58 vars in 1058 bytes} [Tue Aug 30 04:32:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 430 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:32:15.819125 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02264d57-5094-4ed3-8273-2258d4ddb469 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:32:15.853163 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02264d57-5094-4ed3-8273-2258d4ddb469 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:32:15.867355 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab00ed2-d62f-452d-9e97-3ac0630eaa3a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47a092fbe1334f7e9ae4ba9bdb5e9f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:32:15.868518 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab00ed2-d62f-452d-9e97-3ac0630eaa3a service placement] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:15.868805 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab00ed2-d62f-452d-9e97-3ac0630eaa3a service placement] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:15.869080 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab00ed2-d62f-452d-9e97-3ac0630eaa3a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:15.879782 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-5ab00ed2-d62f-452d-9e97-3ac0630eaa3a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:32:15.922700 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab00ed2-d62f-452d-9e97-3ac0630eaa3a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:32:15.929449 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab00ed2-d62f-452d-9e97-3ac0630eaa3a service placement] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:32:15.972622 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1109/2215] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:32:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:32:18.436010 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4802417-9840-4e60-840e-2a112c026315 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:18.436910 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4802417-9840-4e60-840e-2a112c026315 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:18.436910 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4802417-9840-4e60-840e-2a112c026315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:18.466342 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-b4802417-9840-4e60-840e-2a112c026315 None None] MFA Rules not processed for user `ba9817cf82004a5e824a93d1b3ede5cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:32:18.468700 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-b4802417-9840-4e60-840e-2a112c026315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:32:18.490457 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1107/2216] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:32:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:32:25.949858 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=76 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:28.457381 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=5 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:29.456224 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab00ed2-d62f-452d-9e97-3ac0630eaa3a service placement] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:32:29.459335 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-5ab00ed2-d62f-452d-9e97-3ac0630eaa3a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:32:29.484032 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab00ed2-d62f-452d-9e97-3ac0630eaa3a service placement] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:32:29.493163 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5527ad47-cf60-4f7e-a0c2-47ac2b5560a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:32:29.494260 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527ad47-cf60-4f7e-a0c2-47ac2b5560a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:29.494750 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527ad47-cf60-4f7e-a0c2-47ac2b5560a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:29.495226 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527ad47-cf60-4f7e-a0c2-47ac2b5560a8 admin admin] PATH_INFO: `/v3/users/2625000b652a40cd87496b008f8faada` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:29.497526 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5527ad47-cf60-4f7e-a0c2-47ac2b5560a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2625000b652a40cd87496b008f8faada)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:32:29.501545 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5527ad47-cf60-4f7e-a0c2-47ac2b5560a8 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:32:29.673953 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-5527ad47-cf60-4f7e-a0c2-47ac2b5560a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2625000b652a40cd87496b008f8faada'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:32:29.687649 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-5527ad47-cf60-4f7e-a0c2-47ac2b5560a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2625000b652a40cd87496b008f8faada'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:32:29.709174 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-5527ad47-cf60-4f7e-a0c2-47ac2b5560a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2625000b652a40cd87496b008f8faada'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:32:29.710392 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-5527ad47-cf60-4f7e-a0c2-47ac2b5560a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2625000b652a40cd87496b008f8faada'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:32:29.745825 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-5527ad47-cf60-4f7e-a0c2-47ac2b5560a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2625000b652a40cd87496b008f8faada'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:32:29.762946 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1110/2217] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:32:29 2022] DELETE /identity/v3/users/2625000b652a40cd87496b008f8faada => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:32:29.763371 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eacd1e1-1dc9-4f37-85ed-6fd61a43cc19 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:29.764010 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eacd1e1-1dc9-4f37-85ed-6fd61a43cc19 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:29.764269 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eacd1e1-1dc9-4f37-85ed-6fd61a43cc19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:29.786710 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-6eacd1e1-1dc9-4f37-85ed-6fd61a43cc19 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:32:29.788766 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-6eacd1e1-1dc9-4f37-85ed-6fd61a43cc19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:32:29.870041 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1108/2218] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:32:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:32:29.883623 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5527ad47-cf60-4f7e-a0c2-47ac2b5560a8 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:32:29.885748 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-5527ad47-cf60-4f7e-a0c2-47ac2b5560a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:32:29.975461 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5527ad47-cf60-4f7e-a0c2-47ac2b5560a8 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:32:29.979599 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae0f27d-3e2c-4828-b80e-4d64ba0693d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:32:29.980291 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0f27d-3e2c-4828-b80e-4d64ba0693d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:29.980556 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0f27d-3e2c-4828-b80e-4d64ba0693d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:29.980896 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0f27d-3e2c-4828-b80e-4d64ba0693d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:29.992682 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae0f27d-3e2c-4828-b80e-4d64ba0693d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:32:29.994870 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae0f27d-3e2c-4828-b80e-4d64ba0693d1 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:32:30.009836 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1111/2219] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:32:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:32:30.479862 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eacd1e1-1dc9-4f37-85ed-6fd61a43cc19 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:32:30.483062 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-6eacd1e1-1dc9-4f37-85ed-6fd61a43cc19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:32:30.512251 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eacd1e1-1dc9-4f37-85ed-6fd61a43cc19 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:32:30.528369 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f94f8-4081-49f8-b132-eb3654ccd622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:32:30.534283 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f94f8-4081-49f8-b132-eb3654ccd622 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:30.537319 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f94f8-4081-49f8-b132-eb3654ccd622 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:30.537319 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f94f8-4081-49f8-b132-eb3654ccd622 admin admin] PATH_INFO: `/v3/projects/71fa3342cfe540fbac26a99cadd11cf4` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:30.538988 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171f94f8-4081-49f8-b132-eb3654ccd622 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71fa3342cfe540fbac26a99cadd11cf4)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:32:30.541294 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171f94f8-4081-49f8-b132-eb3654ccd622 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:32:30.663714 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-171f94f8-4081-49f8-b132-eb3654ccd622 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71fa3342cfe540fbac26a99cadd11cf4', 'request_id': 'req-171f94f8-4081-49f8-b132-eb3654ccd622'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:32:30.689100 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-171f94f8-4081-49f8-b132-eb3654ccd622 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71fa3342cfe540fbac26a99cadd11cf4', 'request_id': 'req-171f94f8-4081-49f8-b132-eb3654ccd622'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:32:30.707620 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-171f94f8-4081-49f8-b132-eb3654ccd622 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71fa3342cfe540fbac26a99cadd11cf4', 'request_id': 'req-171f94f8-4081-49f8-b132-eb3654ccd622'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:32:30.734115 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-171f94f8-4081-49f8-b132-eb3654ccd622 admin admin] The token cache is being invalidate because project 71fa3342cfe540fbac26a99cadd11cf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:32:30.735577 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-171f94f8-4081-49f8-b132-eb3654ccd622 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:32:30.736430 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-171f94f8-4081-49f8-b132-eb3654ccd622 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:32:30.738317 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1109/2220] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:32:30 2022] DELETE /identity/v3/projects/71fa3342cfe540fbac26a99cadd11cf4 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:32:33.606030 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22178023-7113-4e4f-8e3f-8ef5a614f4bc None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:33.606922 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22178023-7113-4e4f-8e3f-8ef5a614f4bc None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:33.607281 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22178023-7113-4e4f-8e3f-8ef5a614f4bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:33.799058 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-22178023-7113-4e4f-8e3f-8ef5a614f4bc None None] MFA Rules not processed for user `1bc12faf48984335a3515dcde85b5cb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:32:33.803415 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-22178023-7113-4e4f-8e3f-8ef5a614f4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:32:34.012066 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1112/2221] 10.222.0.91 () {58 vars in 1009 bytes} [Tue Aug 30 04:32:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 409 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:32:34.024904 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f94f8-4081-49f8-b132-eb3654ccd622 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:32:34.029708 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-171f94f8-4081-49f8-b132-eb3654ccd622 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:32:34.225435 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f94f8-4081-49f8-b132-eb3654ccd622 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:32:34.237959 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bb51e8-fd30-4cbd-a724-c8e255ddaa24 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b50f9552124b07822ae63c1d553864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:32:34.239250 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb51e8-fd30-4cbd-a724-c8e255ddaa24 service swift] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:34.239828 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb51e8-fd30-4cbd-a724-c8e255ddaa24 service swift] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:34.240240 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb51e8-fd30-4cbd-a724-c8e255ddaa24 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:34.250695 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bb51e8-fd30-4cbd-a724-c8e255ddaa24 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:32:34.252549 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bb51e8-fd30-4cbd-a724-c8e255ddaa24 service swift] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:32:34.263588 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1110/2222] 10.222.0.91 () {60 vars in 1384 bytes} [Tue Aug 30 04:32:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:32:35.446731 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc7a9c-b1d7-4e8f-b000-78d2d7c108c5 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:35.447339 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc7a9c-b1d7-4e8f-b000-78d2d7c108c5 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:35.447339 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc7a9c-b1d7-4e8f-b000-78d2d7c108c5 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:35.454023 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1113/2223] 10.222.0.91 () {54 vars in 921 bytes} [Tue Aug 30 04:32:35 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:32:35.463445 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b23cb-e869-4d2f-919b-a4f1cde3f9ac None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:35.464041 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b23cb-e869-4d2f-919b-a4f1cde3f9ac None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:35.464183 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b23cb-e869-4d2f-919b-a4f1cde3f9ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:35.529123 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-642b23cb-e869-4d2f-919b-a4f1cde3f9ac None None] MFA Rules not processed for user `d806295278ae4997b5c6968aa553290c`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:32:35.531372 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-642b23cb-e869-4d2f-919b-a4f1cde3f9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:32:35.563249 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:35.849948 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1111/2224] 10.222.0.91 () {58 vars in 1018 bytes} [Tue Aug 30 04:32:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:32:35.859830 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc7a9c-b1d7-4e8f-b000-78d2d7c108c5 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:32:35.863102 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-ddbc7a9c-b1d7-4e8f-b000-78d2d7c108c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:32:35.985239 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:36.125049 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc7a9c-b1d7-4e8f-b000-78d2d7c108c5 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:32:36.142526 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b67da-5dfe-4728-b58e-64b07f0ea5d5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2e1344bc54bf388e5ec025ab94c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:32:36.143649 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b67da-5dfe-4728-b58e-64b07f0ea5d5 service glance] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:36.144149 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b67da-5dfe-4728-b58e-64b07f0ea5d5 service glance] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:36.144626 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b67da-5dfe-4728-b58e-64b07f0ea5d5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:36.190508 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b67da-5dfe-4728-b58e-64b07f0ea5d5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:32:36.193597 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b67da-5dfe-4728-b58e-64b07f0ea5d5 service glance] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:32:36.224613 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1114/2225] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:32:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:32:36.369853 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2028f-1bd8-4eca-99a6-500ceb63733c None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:36.370379 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2028f-1bd8-4eca-99a6-500ceb63733c None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:36.370849 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2028f-1bd8-4eca-99a6-500ceb63733c None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:36.373875 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1112/2226] 10.222.0.91 () {54 vars in 921 bytes} [Tue Aug 30 04:32:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:32:36.381877 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a123793-3cab-4dc8-abb8-c8123a125af8 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:36.382550 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a123793-3cab-4dc8-abb8-c8123a125af8 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:36.383023 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a123793-3cab-4dc8-abb8-c8123a125af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:36.468030 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-5a123793-3cab-4dc8-abb8-c8123a125af8 None None] MFA Rules not processed for user `1c05f49ae42b4f9583ff10b2cfce52a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:32:36.479956 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-5a123793-3cab-4dc8-abb8-c8123a125af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:32:36.669216 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1115/2227] 10.222.0.91 () {58 vars in 1018 bytes} [Tue Aug 30 04:32:36 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:32:36.669958 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d2028f-1bd8-4eca-99a6-500ceb63733c None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:32:36.675377 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-85d2028f-1bd8-4eca-99a6-500ceb63733c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:32:36.711206 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d2028f-1bd8-4eca-99a6-500ceb63733c None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:32:36.716789 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9405a2-4b12-43b4-8e3e-16ff036246df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:32:36.717772 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9405a2-4b12-43b4-8e3e-16ff036246df service neutron] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:36.718468 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9405a2-4b12-43b4-8e3e-16ff036246df service neutron] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:36.718989 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9405a2-4b12-43b4-8e3e-16ff036246df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:36.729222 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9405a2-4b12-43b4-8e3e-16ff036246df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:32:36.731264 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9405a2-4b12-43b4-8e3e-16ff036246df service neutron] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:32:36.745324 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1113/2228] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:32:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:32:36.923179 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4955110-01f2-44c1-bc38-f5ce367510c4 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:36.923458 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4955110-01f2-44c1-bc38-f5ce367510c4 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:36.923758 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4955110-01f2-44c1-bc38-f5ce367510c4 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:36.925356 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1116/2229] 10.222.0.91 () {54 vars in 921 bytes} [Tue Aug 30 04:32:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:32:36.938041 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f8082-a3bc-4292-bc71-371e97f40be8 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:36.938452 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f8082-a3bc-4292-bc71-371e97f40be8 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:36.938666 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f8082-a3bc-4292-bc71-371e97f40be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:36.981116 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-dd2f8082-a3bc-4292-bc71-371e97f40be8 None None] MFA Rules not processed for user `d806295278ae4997b5c6968aa553290c`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:32:36.982537 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-dd2f8082-a3bc-4292-bc71-371e97f40be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:32:37.011753 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1114/2230] 10.222.0.91 () {58 vars in 1018 bytes} [Tue Aug 30 04:32:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:32:37.032214 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4955110-01f2-44c1-bc38-f5ce367510c4 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:32:37.052996 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4955110-01f2-44c1-bc38-f5ce367510c4 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:32:37.063827 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163c63ea-2e5d-4242-84cb-3ffea7589e63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:32:37.064489 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c63ea-2e5d-4242-84cb-3ffea7589e63 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:37.064760 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c63ea-2e5d-4242-84cb-3ffea7589e63 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:37.065035 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c63ea-2e5d-4242-84cb-3ffea7589e63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:37.092861 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163c63ea-2e5d-4242-84cb-3ffea7589e63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:32:37.094398 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163c63ea-2e5d-4242-84cb-3ffea7589e63 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:32:37.165574 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1117/2231] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:32:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:32:40.956758 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7049862a-8e11-4b02-9581-03cad33b9fb7 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:40.958181 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7049862a-8e11-4b02-9581-03cad33b9fb7 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:40.958181 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7049862a-8e11-4b02-9581-03cad33b9fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:41.003178 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-7049862a-8e11-4b02-9581-03cad33b9fb7 None None] MFA Rules not processed for user `f237249974584d938baf71727ea3a162`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:32:41.007042 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-7049862a-8e11-4b02-9581-03cad33b9fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:32:41.133343 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1115/2232] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:32:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:32:45.092998 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb219a-4ff2-4d51-8e89-d8ed549114cf None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:45.093974 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb219a-4ff2-4d51-8e89-d8ed549114cf None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:45.093974 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb219a-4ff2-4d51-8e89-d8ed549114cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:45.128625 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-14cb219a-4ff2-4d51-8e89-d8ed549114cf None None] MFA Rules not processed for user `5adb079fad6c41aca6a619a71a3b7c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:32:45.131049 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-14cb219a-4ff2-4d51-8e89-d8ed549114cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:32:45.264576 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1118/2233] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:32:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:32:51.111741 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=59 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:51.142626 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df8305-db2f-4f06-bd88-a422e24548df None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:51.143181 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df8305-db2f-4f06-bd88-a422e24548df None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:51.143677 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df8305-db2f-4f06-bd88-a422e24548df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:51.171340 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-a5df8305-db2f-4f06-bd88-a422e24548df None None] MFA Rules not processed for user `1bc12faf48984335a3515dcde85b5cb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:32:51.173115 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-a5df8305-db2f-4f06-bd88-a422e24548df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:32:51.182295 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1116/2234] 10.222.0.91 () {58 vars in 1009 bytes} [Tue Aug 30 04:32:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:32:51.204913 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cb219a-4ff2-4d51-8e89-d8ed549114cf None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:32:51.226311 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cb219a-4ff2-4d51-8e89-d8ed549114cf None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:32:51.235359 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f849cb09-f717-43e0-b2c5-99fe3d47275a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b50f9552124b07822ae63c1d553864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:32:51.237285 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f849cb09-f717-43e0-b2c5-99fe3d47275a service swift] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:51.237956 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f849cb09-f717-43e0-b2c5-99fe3d47275a service swift] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:51.238505 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f849cb09-f717-43e0-b2c5-99fe3d47275a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:51.250258 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f849cb09-f717-43e0-b2c5-99fe3d47275a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:32:51.252685 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f849cb09-f717-43e0-b2c5-99fe3d47275a service swift] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:32:51.265324 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1119/2235] 10.222.0.91 () {60 vars in 1384 bytes} [Tue Aug 30 04:32:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:33:01.164474 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=3 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:33:01.259030 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=77 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:33:05.563103 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df8305-db2f-4f06-bd88-a422e24548df None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:33:05.581903 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df8305-db2f-4f06-bd88-a422e24548df None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:33:05.588261 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf1ff8-0785-418e-855e-73b0fbe18b65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:33:05.589301 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf1ff8-0785-418e-855e-73b0fbe18b65 service neutron] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:33:05.589836 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf1ff8-0785-418e-855e-73b0fbe18b65 service neutron] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:33:05.590597 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf1ff8-0785-418e-855e-73b0fbe18b65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:33:05.593933 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-6ebf1ff8-0785-418e-855e-73b0fbe18b65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:33:05.717606 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebf1ff8-0785-418e-855e-73b0fbe18b65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:33:05.719452 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebf1ff8-0785-418e-855e-73b0fbe18b65 service neutron] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:33:05.735233 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1117/2236] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:33:05 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:33:14.604487 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f849cb09-f717-43e0-b2c5-99fe3d47275a service swift] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:33:14.605953 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-f849cb09-f717-43e0-b2c5-99fe3d47275a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:33:14.626261 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f849cb09-f717-43e0-b2c5-99fe3d47275a service swift] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:33:14.630737 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaa13a4-633f-47c3-add7-66b10ef25507 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:33:14.631481 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa13a4-633f-47c3-add7-66b10ef25507 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:33:14.631846 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa13a4-633f-47c3-add7-66b10ef25507 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:33:14.632258 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa13a4-633f-47c3-add7-66b10ef25507 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:33:14.634341 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-3aaa13a4-633f-47c3-add7-66b10ef25507 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:33:14.733566 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaa13a4-633f-47c3-add7-66b10ef25507 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:33:14.735089 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaa13a4-633f-47c3-add7-66b10ef25507 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:33:14.746779 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1120/2237] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:33:14 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:33:15.728272 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=30 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:33:18.077530 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08332e0d-74be-4205-bb4c-6b60d2b93436 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:33:18.078580 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08332e0d-74be-4205-bb4c-6b60d2b93436 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:33:18.078580 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08332e0d-74be-4205-bb4c-6b60d2b93436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:33:18.126554 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-08332e0d-74be-4205-bb4c-6b60d2b93436 None None] MFA Rules not processed for user `1bc12faf48984335a3515dcde85b5cb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:33:18.133762 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-08332e0d-74be-4205-bb4c-6b60d2b93436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:33:18.159711 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1118/2238] 10.222.0.91 () {58 vars in 967 bytes} [Tue Aug 30 04:33:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:33:18.191372 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaa13a4-633f-47c3-add7-66b10ef25507 service neutron] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:33:18.211076 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaa13a4-633f-47c3-add7-66b10ef25507 service neutron] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:33:18.217860 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c05b8a-bfc4-4688-aed6-dc70435881ed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b50f9552124b07822ae63c1d553864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:33:18.218777 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c05b8a-bfc4-4688-aed6-dc70435881ed service swift] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:33:18.219224 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c05b8a-bfc4-4688-aed6-dc70435881ed service swift] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:33:18.219895 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c05b8a-bfc4-4688-aed6-dc70435881ed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:33:18.249151 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c05b8a-bfc4-4688-aed6-dc70435881ed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:33:18.250817 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c05b8a-bfc4-4688-aed6-dc70435881ed service swift] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:33:18.270591 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1121/2239] 10.222.0.91 () {60 vars in 1384 bytes} [Tue Aug 30 04:33:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 04:33:28.117662 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=3 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:33:28.262340 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=36 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:33:28.347832 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d3c80-98db-43bb-8032-3529013c7f19 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:33:28.348544 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d3c80-98db-43bb-8032-3529013c7f19 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:33:28.348861 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d3c80-98db-43bb-8032-3529013c7f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:33:28.382325 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-787d3c80-98db-43bb-8032-3529013c7f19 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:33:28.384496 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-787d3c80-98db-43bb-8032-3529013c7f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:33:28.485245 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1119/2240] 10.222.0.83 () {58 vars in 1016 bytes} [Tue Aug 30 04:33:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:33:28.510398 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c05b8a-bfc4-4688-aed6-dc70435881ed service swift] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:33:28.512913 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-18c05b8a-bfc4-4688-aed6-dc70435881ed service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:33:28.540563 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c05b8a-bfc4-4688-aed6-dc70435881ed service swift] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:33:28.548668 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400faf00-1a16-4b05-9f95-730aea39243a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd806295278ae4997b5c6968aa553290c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:33:28.549588 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400faf00-1a16-4b05-9f95-730aea39243a service nova] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:33:28.550000 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400faf00-1a16-4b05-9f95-730aea39243a service nova] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:33:28.550365 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400faf00-1a16-4b05-9f95-730aea39243a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:33:28.560991 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400faf00-1a16-4b05-9f95-730aea39243a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:33:28.562852 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400faf00-1a16-4b05-9f95-730aea39243a service nova] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:33:28.575287 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1122/2241] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:33:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:33:32.717092 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baabbd2f-893c-4ec1-b8ac-1cb4bceda843 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:33:32.717759 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baabbd2f-893c-4ec1-b8ac-1cb4bceda843 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:33:32.717759 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baabbd2f-893c-4ec1-b8ac-1cb4bceda843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:33:32.742276 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-baabbd2f-893c-4ec1-b8ac-1cb4bceda843 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:33:32.744211 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-baabbd2f-893c-4ec1-b8ac-1cb4bceda843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:33:32.755889 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1120/2242] 10.222.0.83 () {58 vars in 1016 bytes} [Tue Aug 30 04:33:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:33:32.783049 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400faf00-1a16-4b05-9f95-730aea39243a service nova] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:33:32.785799 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-400faf00-1a16-4b05-9f95-730aea39243a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:33:32.817150 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400faf00-1a16-4b05-9f95-730aea39243a service nova] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:33:32.824998 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24650654-2667-4db2-9e68-341f7a4147df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd806295278ae4997b5c6968aa553290c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:33:32.826229 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24650654-2667-4db2-9e68-341f7a4147df service nova] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:33:32.826702 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24650654-2667-4db2-9e68-341f7a4147df service nova] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:33:32.827151 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24650654-2667-4db2-9e68-341f7a4147df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:33:32.842358 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24650654-2667-4db2-9e68-341f7a4147df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:33:32.844050 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24650654-2667-4db2-9e68-341f7a4147df service nova] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:33:32.858481 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1123/2243] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:33:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:33:36.829229 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a668c29-3040-48b1-bea2-00aa97f04901 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:33:36.829891 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a668c29-3040-48b1-bea2-00aa97f04901 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:33:36.830060 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a668c29-3040-48b1-bea2-00aa97f04901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:33:36.853644 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-7a668c29-3040-48b1-bea2-00aa97f04901 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:33:36.854934 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-7a668c29-3040-48b1-bea2-00aa97f04901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:33:36.863505 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1121/2244] 10.222.0.83 () {58 vars in 1016 bytes} [Tue Aug 30 04:33:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:33:36.900578 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24650654-2667-4db2-9e68-341f7a4147df service nova] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:33:36.916017 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24650654-2667-4db2-9e68-341f7a4147df service nova] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:33:36.923009 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e23954-3d8f-48ac-9e58-e2e808adb148 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd806295278ae4997b5c6968aa553290c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:33:36.923711 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e23954-3d8f-48ac-9e58-e2e808adb148 service nova] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:33:36.924301 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e23954-3d8f-48ac-9e58-e2e808adb148 service nova] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:33:36.924659 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e23954-3d8f-48ac-9e58-e2e808adb148 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:33:36.935861 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e23954-3d8f-48ac-9e58-e2e808adb148 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:33:36.937809 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e23954-3d8f-48ac-9e58-e2e808adb148 service nova] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:33:36.950028 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1124/2245] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:33:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:33:41.109104 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a003d3-5493-454a-81ec-54051ffc77e1 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:33:41.109775 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a003d3-5493-454a-81ec-54051ffc77e1 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:33:41.110072 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a003d3-5493-454a-81ec-54051ffc77e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:33:41.142174 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-c7a003d3-5493-454a-81ec-54051ffc77e1 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:33:41.144408 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-c7a003d3-5493-454a-81ec-54051ffc77e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:33:41.158253 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1122/2246] 10.222.0.83 () {58 vars in 1016 bytes} [Tue Aug 30 04:33:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:33:41.192508 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e23954-3d8f-48ac-9e58-e2e808adb148 service nova] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:33:41.205758 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e23954-3d8f-48ac-9e58-e2e808adb148 service nova] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:33:41.214407 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2f02bf-4b55-4e78-a5d6-513f1f5cd4f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd806295278ae4997b5c6968aa553290c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:33:41.215470 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f02bf-4b55-4e78-a5d6-513f1f5cd4f1 service nova] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:33:41.215938 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f02bf-4b55-4e78-a5d6-513f1f5cd4f1 service nova] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:33:41.216389 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f02bf-4b55-4e78-a5d6-513f1f5cd4f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:33:41.233180 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2f02bf-4b55-4e78-a5d6-513f1f5cd4f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:33:41.237010 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2f02bf-4b55-4e78-a5d6-513f1f5cd4f1 service nova] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:33:41.256376 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1125/2247] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:33:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:33:45.364678 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97601b81-0748-4486-952d-dff60cae391e None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:33:45.365270 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97601b81-0748-4486-952d-dff60cae391e None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:33:45.365270 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97601b81-0748-4486-952d-dff60cae391e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:33:45.387318 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-97601b81-0748-4486-952d-dff60cae391e None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:33:45.388591 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-97601b81-0748-4486-952d-dff60cae391e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:33:45.397616 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1123/2248] 10.222.0.83 () {58 vars in 1016 bytes} [Tue Aug 30 04:33:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:33:45.425774 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2f02bf-4b55-4e78-a5d6-513f1f5cd4f1 service nova] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:33:45.446369 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2f02bf-4b55-4e78-a5d6-513f1f5cd4f1 service nova] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:33:45.456041 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe09a1c-2534-4ecd-beac-f8308ad7e19f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd806295278ae4997b5c6968aa553290c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:33:45.457069 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe09a1c-2534-4ecd-beac-f8308ad7e19f service nova] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:33:45.457564 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe09a1c-2534-4ecd-beac-f8308ad7e19f service nova] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:33:45.458028 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe09a1c-2534-4ecd-beac-f8308ad7e19f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:33:45.468757 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe09a1c-2534-4ecd-beac-f8308ad7e19f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:33:45.470475 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe09a1c-2534-4ecd-beac-f8308ad7e19f service nova] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:33:45.482457 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1126/2249] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:33:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:33:51.431663 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210376a-7990-447b-9c02-cdbfe610d2b1 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:33:51.432521 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210376a-7990-447b-9c02-cdbfe610d2b1 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:33:51.432521 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210376a-7990-447b-9c02-cdbfe610d2b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:33:51.457028 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-8210376a-7990-447b-9c02-cdbfe610d2b1 None None] MFA Rules not processed for user `589bd91dbf434099b15ed7a8680f93bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:33:51.458343 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-8210376a-7990-447b-9c02-cdbfe610d2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:33:51.559688 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1124/2250] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:33:51 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:33:55.477079 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=30 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:01.541480 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=64 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:13.709717 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe09a1c-2534-4ecd-beac-f8308ad7e19f service nova] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:13.723733 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe09a1c-2534-4ecd-beac-f8308ad7e19f service nova] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:13.727736 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27fb626-e266-4127-89af-904b73a3b00a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:13.728442 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27fb626-e266-4127-89af-904b73a3b00a service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:13.728911 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27fb626-e266-4127-89af-904b73a3b00a service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:13.729186 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27fb626-e266-4127-89af-904b73a3b00a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:13.731101 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-e27fb626-e266-4127-89af-904b73a3b00a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:13.746872 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27fb626-e266-4127-89af-904b73a3b00a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:13.748633 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27fb626-e266-4127-89af-904b73a3b00a service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:13.763147 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1127/2251] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:34:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:34:14.205494 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8210376a-7990-447b-9c02-cdbfe610d2b1 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:14.222056 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8210376a-7990-447b-9c02-cdbfe610d2b1 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:14.228745 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c638fd59-6053-418c-b418-c8c18a7c4f1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:14.229824 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638fd59-6053-418c-b418-c8c18a7c4f1f service neutron] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:14.230307 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638fd59-6053-418c-b418-c8c18a7c4f1f service neutron] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:14.230770 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638fd59-6053-418c-b418-c8c18a7c4f1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:14.234409 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-c638fd59-6053-418c-b418-c8c18a7c4f1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:14.262042 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c638fd59-6053-418c-b418-c8c18a7c4f1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:14.265837 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c638fd59-6053-418c-b418-c8c18a7c4f1f service neutron] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:14.289990 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1125/2252] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:34:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:34:20.250932 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac7620-844b-4bc1-a286-426846103837 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:20.251658 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac7620-844b-4bc1-a286-426846103837 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:20.251658 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac7620-844b-4bc1-a286-426846103837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:20.274660 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-76ac7620-844b-4bc1-a286-426846103837 None None] MFA Rules not processed for user `9a872454622d41ce9462890af418182d`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:34:20.276133 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-76ac7620-844b-4bc1-a286-426846103837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:20.346760 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1128/2253] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:34:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:34:24.279418 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=6 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:24.951714 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c638fd59-6053-418c-b418-c8c18a7c4f1f service neutron] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:24.953597 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-c638fd59-6053-418c-b418-c8c18a7c4f1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:25.050242 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ac7620-844b-4bc1-a286-426846103837 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:25.053431 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-76ac7620-844b-4bc1-a286-426846103837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:25.080617 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ac7620-844b-4bc1-a286-426846103837 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:25.089279 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d425eb1a-50fd-4149-bb7e-c67e783beffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:25.090114 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c638fd59-6053-418c-b418-c8c18a7c4f1f service neutron] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:25.090288 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425eb1a-50fd-4149-bb7e-c67e783beffb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:25.090697 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425eb1a-50fd-4149-bb7e-c67e783beffb admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:25.091434 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425eb1a-50fd-4149-bb7e-c67e783beffb admin admin] PATH_INFO: `/v3/users/f237249974584d938baf71727ea3a162` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:25.093687 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d425eb1a-50fd-4149-bb7e-c67e783beffb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f237249974584d938baf71727ea3a162)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:25.097463 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d425eb1a-50fd-4149-bb7e-c67e783beffb admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:25.099627 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af9775-6ba0-419c-85ed-49de1199e66a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47a092fbe1334f7e9ae4ba9bdb5e9f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:25.100775 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af9775-6ba0-419c-85ed-49de1199e66a service placement] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:25.101178 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af9775-6ba0-419c-85ed-49de1199e66a service placement] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:25.101544 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af9775-6ba0-419c-85ed-49de1199e66a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:25.104143 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-c8af9775-6ba0-419c-85ed-49de1199e66a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:25.120067 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8af9775-6ba0-419c-85ed-49de1199e66a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:25.121804 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8af9775-6ba0-419c-85ed-49de1199e66a service placement] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:25.134454 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1126/2254] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:34:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:34:25.199089 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-d425eb1a-50fd-4149-bb7e-c67e783beffb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f237249974584d938baf71727ea3a162'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:25.216784 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-d425eb1a-50fd-4149-bb7e-c67e783beffb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f237249974584d938baf71727ea3a162'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:25.230542 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-d425eb1a-50fd-4149-bb7e-c67e783beffb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f237249974584d938baf71727ea3a162'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:25.232056 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-d425eb1a-50fd-4149-bb7e-c67e783beffb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f237249974584d938baf71727ea3a162'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:25.266853 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-d425eb1a-50fd-4149-bb7e-c67e783beffb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f237249974584d938baf71727ea3a162'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:25.275666 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1129/2255] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:34:25 2022] DELETE /identity/v3/users/f237249974584d938baf71727ea3a162 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:34:25.774881 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af9775-6ba0-419c-85ed-49de1199e66a service placement] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:25.790974 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af9775-6ba0-419c-85ed-49de1199e66a service placement] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:25.894598 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6176fd11-810f-4359-89a6-dfa8c7b1da5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:25.895958 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176fd11-810f-4359-89a6-dfa8c7b1da5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:25.896608 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176fd11-810f-4359-89a6-dfa8c7b1da5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:25.897464 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176fd11-810f-4359-89a6-dfa8c7b1da5d admin admin] PATH_INFO: `/v3/projects/9322fbe1939b46c3aee2418884f81e9a` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:25.900926 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6176fd11-810f-4359-89a6-dfa8c7b1da5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9322fbe1939b46c3aee2418884f81e9a)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:25.905759 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6176fd11-810f-4359-89a6-dfa8c7b1da5d admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:25.996466 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-6176fd11-810f-4359-89a6-dfa8c7b1da5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9322fbe1939b46c3aee2418884f81e9a', 'request_id': 'req-6176fd11-810f-4359-89a6-dfa8c7b1da5d'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:26.004652 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-6176fd11-810f-4359-89a6-dfa8c7b1da5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9322fbe1939b46c3aee2418884f81e9a', 'request_id': 'req-6176fd11-810f-4359-89a6-dfa8c7b1da5d'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:26.014724 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-6176fd11-810f-4359-89a6-dfa8c7b1da5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9322fbe1939b46c3aee2418884f81e9a', 'request_id': 'req-6176fd11-810f-4359-89a6-dfa8c7b1da5d'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:26.029001 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-6176fd11-810f-4359-89a6-dfa8c7b1da5d admin admin] The token cache is being invalidate because project 9322fbe1939b46c3aee2418884f81e9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:34:26.029287 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-6176fd11-810f-4359-89a6-dfa8c7b1da5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:26.030024 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-6176fd11-810f-4359-89a6-dfa8c7b1da5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:26.031763 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1127/2256] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:34:25 2022] DELETE /identity/v3/projects/9322fbe1939b46c3aee2418884f81e9a => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:34:34.453258 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242f3aa-1d3a-4cda-baa5-48b17942ef9a None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:34.453893 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242f3aa-1d3a-4cda-baa5-48b17942ef9a None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:34.453893 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242f3aa-1d3a-4cda-baa5-48b17942ef9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:34.481597 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-9242f3aa-1d3a-4cda-baa5-48b17942ef9a None None] MFA Rules not processed for user `91067603d9c549278cdc2d97b54cca88`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:34:34.483264 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-9242f3aa-1d3a-4cda-baa5-48b17942ef9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:34.568823 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1130/2257] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:34:34 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:34:34.986631 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6176fd11-810f-4359-89a6-dfa8c7b1da5d admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:34.988215 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-6176fd11-810f-4359-89a6-dfa8c7b1da5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:35.016620 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:35.065595 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6176fd11-810f-4359-89a6-dfa8c7b1da5d admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:35.069947 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5478a875-8e76-48bd-a6a7-90fc9ea130c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:35.070584 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478a875-8e76-48bd-a6a7-90fc9ea130c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:35.070844 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478a875-8e76-48bd-a6a7-90fc9ea130c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:35.071109 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478a875-8e76-48bd-a6a7-90fc9ea130c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:35.073063 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-5478a875-8e76-48bd-a6a7-90fc9ea130c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:35.084586 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5478a875-8e76-48bd-a6a7-90fc9ea130c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:35.086225 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5478a875-8e76-48bd-a6a7-90fc9ea130c0 service neutron] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:35.096492 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1128/2258] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:34:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:34:35.549953 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9242f3aa-1d3a-4cda-baa5-48b17942ef9a None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:35.552502 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-9242f3aa-1d3a-4cda-baa5-48b17942ef9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:35.559785 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:35.671237 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9242f3aa-1d3a-4cda-baa5-48b17942ef9a None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:35.677122 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12546d8-8654-465d-91bd-46ca889e0306 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47a092fbe1334f7e9ae4ba9bdb5e9f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:35.677768 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12546d8-8654-465d-91bd-46ca889e0306 service placement] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:35.678042 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12546d8-8654-465d-91bd-46ca889e0306 service placement] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:35.678313 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12546d8-8654-465d-91bd-46ca889e0306 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:35.680321 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-b12546d8-8654-465d-91bd-46ca889e0306 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:35.694569 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12546d8-8654-465d-91bd-46ca889e0306 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:35.696395 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12546d8-8654-465d-91bd-46ca889e0306 service placement] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:35.707807 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1131/2259] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:34:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:34:41.398688 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5478a875-8e76-48bd-a6a7-90fc9ea130c0 service neutron] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:41.401333 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-5478a875-8e76-48bd-a6a7-90fc9ea130c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:41.567778 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5478a875-8e76-48bd-a6a7-90fc9ea130c0 service neutron] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:41.575853 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd0dd3e-7a69-4c92-b6d1-512e499c14b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd806295278ae4997b5c6968aa553290c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:41.576614 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd0dd3e-7a69-4c92-b6d1-512e499c14b2 service nova] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:41.576900 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd0dd3e-7a69-4c92-b6d1-512e499c14b2 service nova] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:41.577397 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd0dd3e-7a69-4c92-b6d1-512e499c14b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:41.579968 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-8cd0dd3e-7a69-4c92-b6d1-512e499c14b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:41.599740 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd0dd3e-7a69-4c92-b6d1-512e499c14b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:41.604819 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd0dd3e-7a69-4c92-b6d1-512e499c14b2 service nova] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:41.619958 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1129/2260] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:34:41 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:34:42.293890 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12546d8-8654-465d-91bd-46ca889e0306 service placement] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:42.339149 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12546d8-8654-465d-91bd-46ca889e0306 service placement] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:42.347509 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5440635e-c9e1-43ef-a576-a5a0d827cd85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:42.348828 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440635e-c9e1-43ef-a576-a5a0d827cd85 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:42.349659 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440635e-c9e1-43ef-a576-a5a0d827cd85 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:42.349659 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440635e-c9e1-43ef-a576-a5a0d827cd85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:42.351824 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-5440635e-c9e1-43ef-a576-a5a0d827cd85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:42.368541 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5440635e-c9e1-43ef-a576-a5a0d827cd85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:42.373043 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5440635e-c9e1-43ef-a576-a5a0d827cd85 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:42.387856 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1132/2261] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:34:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:34:44.431129 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da023cb-0775-42fe-af45-9a885321575f None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:44.431721 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da023cb-0775-42fe-af45-9a885321575f None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:44.431806 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da023cb-0775-42fe-af45-9a885321575f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:44.459273 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-2da023cb-0775-42fe-af45-9a885321575f None None] MFA Rules not processed for user `5adb079fad6c41aca6a619a71a3b7c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:34:44.460599 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-2da023cb-0775-42fe-af45-9a885321575f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:44.531985 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1130/2262] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:34:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:34:46.467666 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5440635e-c9e1-43ef-a576-a5a0d827cd85 service neutron] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:46.469818 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-5440635e-c9e1-43ef-a576-a5a0d827cd85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:46.506907 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5440635e-c9e1-43ef-a576-a5a0d827cd85 service neutron] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:46.516826 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b22938-710a-41fe-832e-ca43267cdf74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd806295278ae4997b5c6968aa553290c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:46.518045 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b22938-710a-41fe-832e-ca43267cdf74 service nova] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:46.518864 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b22938-710a-41fe-832e-ca43267cdf74 service nova] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:46.519413 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b22938-710a-41fe-832e-ca43267cdf74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:46.523409 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-63b22938-710a-41fe-832e-ca43267cdf74 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:46.643303 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b22938-710a-41fe-832e-ca43267cdf74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:46.646946 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b22938-710a-41fe-832e-ca43267cdf74 service nova] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:46.666210 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1133/2263] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:34:46 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:34:54.524165 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=76 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:54.581952 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da023cb-0775-42fe-af45-9a885321575f None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:54.613482 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da023cb-0775-42fe-af45-9a885321575f None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:54.623626 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6aaa71-ef81-41bb-9c91-c2524e312407 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd806295278ae4997b5c6968aa553290c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:54.624837 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6aaa71-ef81-41bb-9c91-c2524e312407 service nova] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:54.625374 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6aaa71-ef81-41bb-9c91-c2524e312407 service nova] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:54.625924 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6aaa71-ef81-41bb-9c91-c2524e312407 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:54.629046 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-9a6aaa71-ef81-41bb-9c91-c2524e312407 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:54.655005 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6aaa71-ef81-41bb-9c91-c2524e312407 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:54.657827 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6aaa71-ef81-41bb-9c91-c2524e312407 service nova] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:54.679613 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1131/2264] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:34:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:34:56.657096 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=65 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:04.670756 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=6 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:14.290393 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b22938-710a-41fe-832e-ca43267cdf74 service nova] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:14.292852 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-63b22938-710a-41fe-832e-ca43267cdf74 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:14.314476 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b22938-710a-41fe-832e-ca43267cdf74 service nova] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:14.319903 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5081b3e6-d2e2-412e-9289-0db8acd4e8f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:14.320576 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081b3e6-d2e2-412e-9289-0db8acd4e8f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:14.320856 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081b3e6-d2e2-412e-9289-0db8acd4e8f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:14.321132 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081b3e6-d2e2-412e-9289-0db8acd4e8f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:14.323415 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-5081b3e6-d2e2-412e-9289-0db8acd4e8f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:14.409854 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5081b3e6-d2e2-412e-9289-0db8acd4e8f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:14.413676 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5081b3e6-d2e2-412e-9289-0db8acd4e8f9 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:14.435891 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1134/2265] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:35:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:35:16.232613 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a46f0-d85a-473a-92d8-a656f9ae1516 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:16.233347 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a46f0-d85a-473a-92d8-a656f9ae1516 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:16.233347 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a46f0-d85a-473a-92d8-a656f9ae1516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:16.265603 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-5c5a46f0-d85a-473a-92d8-a656f9ae1516 None None] MFA Rules not processed for user `1bc12faf48984335a3515dcde85b5cb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:16.268320 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-5c5a46f0-d85a-473a-92d8-a656f9ae1516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:16.394584 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1132/2266] 10.222.0.91 () {58 vars in 967 bytes} [Tue Aug 30 04:35:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:16.483751 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5081b3e6-d2e2-412e-9289-0db8acd4e8f9 service neutron] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:16.486092 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-5081b3e6-d2e2-412e-9289-0db8acd4e8f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:16.649876 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5081b3e6-d2e2-412e-9289-0db8acd4e8f9 service neutron] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:16.658909 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2387bc32-3df4-41fc-8d33-6888dc31de5f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b50f9552124b07822ae63c1d553864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:16.659901 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387bc32-3df4-41fc-8d33-6888dc31de5f service swift] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:16.661611 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387bc32-3df4-41fc-8d33-6888dc31de5f service swift] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:16.662052 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387bc32-3df4-41fc-8d33-6888dc31de5f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:16.681092 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2387bc32-3df4-41fc-8d33-6888dc31de5f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:16.684758 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2387bc32-3df4-41fc-8d33-6888dc31de5f service swift] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:16.712255 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1135/2267] 10.222.0.91 () {60 vars in 1384 bytes} [Tue Aug 30 04:35:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:35:20.043138 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78fcb5-d02d-4217-b60d-b74305a927a5 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:20.044062 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78fcb5-d02d-4217-b60d-b74305a927a5 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:20.044062 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78fcb5-d02d-4217-b60d-b74305a927a5 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:20.045135 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1133/2268] 10.222.0.91 () {54 vars in 921 bytes} [Tue Aug 30 04:35:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:35:20.054616 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5beba20-1033-4a3b-9256-ee38725c557a None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:20.055238 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5beba20-1033-4a3b-9256-ee38725c557a None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:20.055578 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5beba20-1033-4a3b-9256-ee38725c557a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:20.136861 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-f5beba20-1033-4a3b-9256-ee38725c557a None None] MFA Rules not processed for user `47a092fbe1334f7e9ae4ba9bdb5e9f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:20.138872 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-f5beba20-1033-4a3b-9256-ee38725c557a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:20.184654 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa78fcb5-d02d-4217-b60d-b74305a927a5 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:20.188435 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-fa78fcb5-d02d-4217-b60d-b74305a927a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:20.262218 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1136/2269] 10.222.0.91 () {58 vars in 1018 bytes} [Tue Aug 30 04:35:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:20.275331 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5beba20-1033-4a3b-9256-ee38725c557a None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:20.289274 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5beba20-1033-4a3b-9256-ee38725c557a None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:20.296450 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9efc261-77ba-43e0-9cf0-8509ef389ae4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47a092fbe1334f7e9ae4ba9bdb5e9f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:20.297089 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9efc261-77ba-43e0-9cf0-8509ef389ae4 service placement] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:20.298039 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9efc261-77ba-43e0-9cf0-8509ef389ae4 service placement] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:20.298344 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9efc261-77ba-43e0-9cf0-8509ef389ae4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:20.309289 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9efc261-77ba-43e0-9cf0-8509ef389ae4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:20.311139 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9efc261-77ba-43e0-9cf0-8509ef389ae4 service placement] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:20.311351 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa78fcb5-d02d-4217-b60d-b74305a927a5 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:20.316000 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:20.317450 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a65e5-6920-4bef-b95c-bfe5e71b14c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:20.318270 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a65e5-6920-4bef-b95c-bfe5e71b14c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:20.318543 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a65e5-6920-4bef-b95c-bfe5e71b14c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:20.318813 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a65e5-6920-4bef-b95c-bfe5e71b14c9 admin admin] PATH_INFO: `/v3/users/589bd91dbf434099b15ed7a8680f93bb` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:20.320367 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6a65e5-6920-4bef-b95c-bfe5e71b14c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=589bd91dbf434099b15ed7a8680f93bb)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:20.322374 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6a65e5-6920-4bef-b95c-bfe5e71b14c9 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:20.326135 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1137/2270] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:35:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:35:20.390760 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-cd6a65e5-6920-4bef-b95c-bfe5e71b14c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '589bd91dbf434099b15ed7a8680f93bb'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:20.392233 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-cd6a65e5-6920-4bef-b95c-bfe5e71b14c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '589bd91dbf434099b15ed7a8680f93bb'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:20.392877 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-cd6a65e5-6920-4bef-b95c-bfe5e71b14c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '589bd91dbf434099b15ed7a8680f93bb'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:20.404946 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-cd6a65e5-6920-4bef-b95c-bfe5e71b14c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '589bd91dbf434099b15ed7a8680f93bb'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:20.422672 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-cd6a65e5-6920-4bef-b95c-bfe5e71b14c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '589bd91dbf434099b15ed7a8680f93bb'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:20.442905 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1134/2271] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:35:20 2022] DELETE /identity/v3/users/589bd91dbf434099b15ed7a8680f93bb => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:20.721740 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9efc261-77ba-43e0-9cf0-8509ef389ae4 service placement] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:20.753226 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9efc261-77ba-43e0-9cf0-8509ef389ae4 service placement] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:20.859127 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63feb8f5-b1d8-4031-a38d-26cf65556ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:20.861648 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63feb8f5-b1d8-4031-a38d-26cf65556ea6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:20.862176 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63feb8f5-b1d8-4031-a38d-26cf65556ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:20.863146 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63feb8f5-b1d8-4031-a38d-26cf65556ea6 admin admin] PATH_INFO: `/v3/projects/b09f049bcfa64015bf7495ae9ec2924a` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:20.865492 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63feb8f5-b1d8-4031-a38d-26cf65556ea6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b09f049bcfa64015bf7495ae9ec2924a)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:20.868765 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63feb8f5-b1d8-4031-a38d-26cf65556ea6 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:20.957053 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-63feb8f5-b1d8-4031-a38d-26cf65556ea6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b09f049bcfa64015bf7495ae9ec2924a', 'request_id': 'req-63feb8f5-b1d8-4031-a38d-26cf65556ea6'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:20.966468 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-63feb8f5-b1d8-4031-a38d-26cf65556ea6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b09f049bcfa64015bf7495ae9ec2924a', 'request_id': 'req-63feb8f5-b1d8-4031-a38d-26cf65556ea6'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:20.974240 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-63feb8f5-b1d8-4031-a38d-26cf65556ea6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b09f049bcfa64015bf7495ae9ec2924a', 'request_id': 'req-63feb8f5-b1d8-4031-a38d-26cf65556ea6'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:20.991655 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-63feb8f5-b1d8-4031-a38d-26cf65556ea6 admin admin] The token cache is being invalidate because project b09f049bcfa64015bf7495ae9ec2924a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:35:20.992079 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-63feb8f5-b1d8-4031-a38d-26cf65556ea6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:20.992887 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-63feb8f5-b1d8-4031-a38d-26cf65556ea6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:20.994646 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1138/2272] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:35:20 2022] DELETE /identity/v3/projects/b09f049bcfa64015bf7495ae9ec2924a => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:21.002905 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea49dcc-7bb1-4ec6-b63d-e915c22664e0 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:21.003394 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea49dcc-7bb1-4ec6-b63d-e915c22664e0 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:21.003953 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea49dcc-7bb1-4ec6-b63d-e915c22664e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:21.078963 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-4ea49dcc-7bb1-4ec6-b63d-e915c22664e0 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:21.081296 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-4ea49dcc-7bb1-4ec6-b63d-e915c22664e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:21.118479 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:21.196276 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1135/2273] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:35:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:21.210878 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefade79-a28f-4202-99d4-aa402e539d99 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:21.211388 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefade79-a28f-4202-99d4-aa402e539d99 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:21.211526 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefade79-a28f-4202-99d4-aa402e539d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:21.238716 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-cefade79-a28f-4202-99d4-aa402e539d99 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:21.240711 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-cefade79-a28f-4202-99d4-aa402e539d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:21.258674 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1139/2274] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:35:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:21.266216 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea49dcc-7bb1-4ec6-b63d-e915c22664e0 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:21.285765 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea49dcc-7bb1-4ec6-b63d-e915c22664e0 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:21.303809 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3e6f3e-e333-42a3-b0a9-543497956c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:21.308732 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e6f3e-e333-42a3-b0a9-543497956c3f admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:21.309108 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e6f3e-e333-42a3-b0a9-543497956c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:21.309287 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e6f3e-e333-42a3-b0a9-543497956c3f admin admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:21.309994 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3e6f3e-e333-42a3-b0a9-543497956c3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:35:21.310479 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3e6f3e-e333-42a3-b0a9-543497956c3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:21.312270 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3e6f3e-e333-42a3-b0a9-543497956c3f admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:21.327970 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1136/2275] 10.222.0.91 () {58 vars in 1153 bytes} [Tue Aug 30 04:35:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:35:21.333018 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefade79-a28f-4202-99d4-aa402e539d99 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:21.348684 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefade79-a28f-4202-99d4-aa402e539d99 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:21.358066 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da7b41-afe3-40dc-a7c7-02830cae8202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:21.359018 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da7b41-afe3-40dc-a7c7-02830cae8202 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:21.359440 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da7b41-afe3-40dc-a7c7-02830cae8202 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:21.359863 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da7b41-afe3-40dc-a7c7-02830cae8202 admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:21.361004 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8da7b41-afe3-40dc-a7c7-02830cae8202 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:21.364137 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8da7b41-afe3-40dc-a7c7-02830cae8202 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:21.464972 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1140/2276] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:35:21 2022] POST /identity/v3/projects => generated 371 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:35:21.466603 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3e6f3e-e333-42a3-b0a9-543497956c3f admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:21.484096 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3e6f3e-e333-42a3-b0a9-543497956c3f admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:21.583022 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735afcc7-a859-4bba-a148-059d02f228d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:21.584252 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735afcc7-a859-4bba-a148-059d02f228d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:21.584948 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735afcc7-a859-4bba-a148-059d02f228d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:21.585199 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735afcc7-a859-4bba-a148-059d02f228d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:21.586364 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735afcc7-a859-4bba-a148-059d02f228d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:21.589977 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735afcc7-a859-4bba-a148-059d02f228d6 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:21.634591 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1137/2277] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:35:21 2022] POST /identity/v3/users => generated 286 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:35:21.641178 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da7b41-afe3-40dc-a7c7-02830cae8202 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:21.657567 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da7b41-afe3-40dc-a7c7-02830cae8202 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:21.666537 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90e9011-8272-4b6d-80be-f1ae0898fe62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:21.667238 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e9011-8272-4b6d-80be-f1ae0898fe62 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:21.667622 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e9011-8272-4b6d-80be-f1ae0898fe62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:21.668034 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e9011-8272-4b6d-80be-f1ae0898fe62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:21.669310 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90e9011-8272-4b6d-80be-f1ae0898fe62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:21.671437 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90e9011-8272-4b6d-80be-f1ae0898fe62 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:21.692807 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1141/2278] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:35:21 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:35:21.695075 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735afcc7-a859-4bba-a148-059d02f228d6 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:21.706724 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735afcc7-a859-4bba-a148-059d02f228d6 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:21.711948 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ccf808-cf21-4c5a-829c-4424486cafc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:21.712586 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ccf808-cf21-4c5a-829c-4424486cafc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:21.712859 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ccf808-cf21-4c5a-829c-4424486cafc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:21.713124 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ccf808-cf21-4c5a-829c-4424486cafc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:21.713786 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ccf808-cf21-4c5a-829c-4424486cafc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:21.715468 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ccf808-cf21-4c5a-829c-4424486cafc2 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:21.739415 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1138/2279] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:35:21 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:35:21.745012 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90e9011-8272-4b6d-80be-f1ae0898fe62 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:21.758061 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90e9011-8272-4b6d-80be-f1ae0898fe62 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:21.765183 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f1635-6414-419b-b310-0c09a0e8e41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:21.765990 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f1635-6414-419b-b310-0c09a0e8e41b admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:21.766371 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f1635-6414-419b-b310-0c09a0e8e41b admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:21.767708 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f1635-6414-419b-b310-0c09a0e8e41b admin admin] PATH_INFO: `/v3/projects/1e78ed62eb5d4cd795b5bde3e9cf220f/users/3de21d9890574158b2171b0567aaf042/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:21.807326 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f1635-6414-419b-b310-0c09a0e8e41b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e78ed62eb5d4cd795b5bde3e9cf220f, user_id=3de21d9890574158b2171b0567aaf042, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:21.814147 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f1635-6414-419b-b310-0c09a0e8e41b admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:21.847234 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1142/2280] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:35:21 2022] PUT /identity/v3/projects/1e78ed62eb5d4cd795b5bde3e9cf220f/users/3de21d9890574158b2171b0567aaf042/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:21.860450 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34661d-3134-41bd-85ad-43002cf251f4 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:21.860823 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34661d-3134-41bd-85ad-43002cf251f4 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:21.861696 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34661d-3134-41bd-85ad-43002cf251f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:21.937123 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-2c34661d-3134-41bd-85ad-43002cf251f4 None None] MFA Rules not processed for user `3de21d9890574158b2171b0567aaf042`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:21.939642 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-2c34661d-3134-41bd-85ad-43002cf251f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:22.131074 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f1635-6414-419b-b310-0c09a0e8e41b admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:22.132653 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1139/2281] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:35:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:35:22.165947 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:22.289192 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f1635-6414-419b-b310-0c09a0e8e41b admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:22.303061 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b19e9-bca0-4627-b993-ba69d98ae9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:22.307605 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b19e9-bca0-4627-b993-ba69d98ae9e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:22.307605 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b19e9-bca0-4627-b993-ba69d98ae9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:22.307605 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b19e9-bca0-4627-b993-ba69d98ae9e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:22.307605 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50b19e9-bca0-4627-b993-ba69d98ae9e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:22.310188 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50b19e9-bca0-4627-b993-ba69d98ae9e1 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:22.368861 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1143/2282] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:35:22 2022] POST /identity/v3/projects => generated 371 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:35:22.373853 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34661d-3134-41bd-85ad-43002cf251f4 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:22.395004 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34661d-3134-41bd-85ad-43002cf251f4 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:22.426562 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:22.517708 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7623b0d-17c7-4f4c-b632-2fb8995fd45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:22.518845 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7623b0d-17c7-4f4c-b632-2fb8995fd45d admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:22.519320 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7623b0d-17c7-4f4c-b632-2fb8995fd45d admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:22.519867 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7623b0d-17c7-4f4c-b632-2fb8995fd45d admin admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:22.522173 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7623b0d-17c7-4f4c-b632-2fb8995fd45d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:22.524765 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7623b0d-17c7-4f4c-b632-2fb8995fd45d admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:22.562897 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1140/2283] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:35:22 2022] POST /identity/v3/users => generated 292 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:35:22.569201 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b19e9-bca0-4627-b993-ba69d98ae9e1 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:22.582929 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b19e9-bca0-4627-b993-ba69d98ae9e1 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:22.589833 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ec1fe-4bb9-4760-b1cb-1ed710adebe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:22.590522 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ec1fe-4bb9-4760-b1cb-1ed710adebe8 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:22.590786 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ec1fe-4bb9-4760-b1cb-1ed710adebe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:22.591124 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ec1fe-4bb9-4760-b1cb-1ed710adebe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:22.591887 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ec1fe-4bb9-4760-b1cb-1ed710adebe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:22.593796 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ec1fe-4bb9-4760-b1cb-1ed710adebe8 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:22.611530 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1144/2284] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:35:22 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:35:22.617386 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7623b0d-17c7-4f4c-b632-2fb8995fd45d admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:22.632352 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7623b0d-17c7-4f4c-b632-2fb8995fd45d admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:22.637995 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8566ed-4a42-48ed-8979-2638ffe4a0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:22.639985 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8566ed-4a42-48ed-8979-2638ffe4a0a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:22.639985 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8566ed-4a42-48ed-8979-2638ffe4a0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:22.641274 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8566ed-4a42-48ed-8979-2638ffe4a0a1 admin admin] PATH_INFO: `/v3/projects/476df39140ae4169a759ad569f2cee7e/users/f3a845d5d731491caaf0609339de5adf/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:22.672197 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8566ed-4a42-48ed-8979-2638ffe4a0a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=476df39140ae4169a759ad569f2cee7e, user_id=f3a845d5d731491caaf0609339de5adf, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:22.676714 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8566ed-4a42-48ed-8979-2638ffe4a0a1 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:22.706758 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1141/2285] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:35:22 2022] PUT /identity/v3/projects/476df39140ae4169a759ad569f2cee7e/users/f3a845d5d731491caaf0609339de5adf/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:22.713002 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ec1fe-4bb9-4760-b1cb-1ed710adebe8 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:22.735781 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ec1fe-4bb9-4760-b1cb-1ed710adebe8 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:22.842655 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a8ae4b-84a0-49a3-ae6d-8e9d0286b5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:22.843202 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8ae4b-84a0-49a3-ae6d-8e9d0286b5bd admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:22.843463 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8ae4b-84a0-49a3-ae6d-8e9d0286b5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:22.843720 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8ae4b-84a0-49a3-ae6d-8e9d0286b5bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:22.844462 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a8ae4b-84a0-49a3-ae6d-8e9d0286b5bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:22.846738 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a8ae4b-84a0-49a3-ae6d-8e9d0286b5bd admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:22.860827 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1145/2286] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:35:22 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:35:22.866064 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8566ed-4a42-48ed-8979-2638ffe4a0a1 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:22.884545 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8566ed-4a42-48ed-8979-2638ffe4a0a1 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:22.892615 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3eaed3-506d-4e0c-929d-aa7637f13eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:22.893702 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3eaed3-506d-4e0c-929d-aa7637f13eed admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:22.894162 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3eaed3-506d-4e0c-929d-aa7637f13eed admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:22.894614 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3eaed3-506d-4e0c-929d-aa7637f13eed admin admin] PATH_INFO: `/v3/projects/476df39140ae4169a759ad569f2cee7e/users/f3a845d5d731491caaf0609339de5adf/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:22.898505 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3eaed3-506d-4e0c-929d-aa7637f13eed admin admin] RBAC: Authorizing `identity:create_grant(project_id=476df39140ae4169a759ad569f2cee7e, user_id=f3a845d5d731491caaf0609339de5adf, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:22.903249 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3eaed3-506d-4e0c-929d-aa7637f13eed admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:22.919869 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1142/2287] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:35:22 2022] PUT /identity/v3/projects/476df39140ae4169a759ad569f2cee7e/users/f3a845d5d731491caaf0609339de5adf/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:35:22.932572 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2432808-42cf-45dc-b2b1-57969075f238 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:22.932909 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2432808-42cf-45dc-b2b1-57969075f238 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:22.933127 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2432808-42cf-45dc-b2b1-57969075f238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:22.980378 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-c2432808-42cf-45dc-b2b1-57969075f238 None None] MFA Rules not processed for user `f3a845d5d731491caaf0609339de5adf`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:22.982685 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-c2432808-42cf-45dc-b2b1-57969075f238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:23.098199 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1146/2288] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:35:22 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:23.110181 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3eaed3-506d-4e0c-929d-aa7637f13eed admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:23.112511 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-fd3eaed3-506d-4e0c-929d-aa7637f13eed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:23.216198 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3eaed3-506d-4e0c-929d-aa7637f13eed admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:23.220152 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f72ea9a-c374-4447-a766-9a34ea817fee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:23.220786 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72ea9a-c374-4447-a766-9a34ea817fee service cinder] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:23.221063 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72ea9a-c374-4447-a766-9a34ea817fee service cinder] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:23.221428 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72ea9a-c374-4447-a766-9a34ea817fee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:23.232566 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f72ea9a-c374-4447-a766-9a34ea817fee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:23.234133 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f72ea9a-c374-4447-a766-9a34ea817fee service cinder] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:23.245828 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1143/2289] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:35:23 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:35:23.872989 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2432808-42cf-45dc-b2b1-57969075f238 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:23.891495 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:23.966440 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2432808-42cf-45dc-b2b1-57969075f238 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:23.971871 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe705a9-2e4f-435f-ae3d-979d723f64bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:23.972701 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe705a9-2e4f-435f-ae3d-979d723f64bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:23.973052 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe705a9-2e4f-435f-ae3d-979d723f64bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:23.973400 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe705a9-2e4f-435f-ae3d-979d723f64bf admin admin] PATH_INFO: `/v3/users/3de21d9890574158b2171b0567aaf042` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:23.975545 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe705a9-2e4f-435f-ae3d-979d723f64bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=3de21d9890574158b2171b0567aaf042)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:23.977719 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe705a9-2e4f-435f-ae3d-979d723f64bf admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:24.048513 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-6fe705a9-2e4f-435f-ae3d-979d723f64bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3de21d9890574158b2171b0567aaf042'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:24.062788 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-6fe705a9-2e4f-435f-ae3d-979d723f64bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3de21d9890574158b2171b0567aaf042'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:24.076458 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-6fe705a9-2e4f-435f-ae3d-979d723f64bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3de21d9890574158b2171b0567aaf042'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:24.077477 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-6fe705a9-2e4f-435f-ae3d-979d723f64bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3de21d9890574158b2171b0567aaf042'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:24.101223 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-6fe705a9-2e4f-435f-ae3d-979d723f64bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3de21d9890574158b2171b0567aaf042'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:24.110746 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1147/2290] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:35:23 2022] DELETE /identity/v3/users/3de21d9890574158b2171b0567aaf042 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:24.119467 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd4885-51f0-4d42-9634-c0037e715a6f None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:24.120084 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd4885-51f0-4d42-9634-c0037e715a6f None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:24.122100 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd4885-51f0-4d42-9634-c0037e715a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:24.162020 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-63cd4885-51f0-4d42-9634-c0037e715a6f None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:24.165244 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-63cd4885-51f0-4d42-9634-c0037e715a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:24.258232 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:24.276416 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1144/2291] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:35:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:24.293260 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe705a9-2e4f-435f-ae3d-979d723f64bf admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:24.296127 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-6fe705a9-2e4f-435f-ae3d-979d723f64bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:24.455767 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe705a9-2e4f-435f-ae3d-979d723f64bf admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:24.460610 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5429c05-17cc-4daa-a95f-a1707dec363f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:24.461304 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5429c05-17cc-4daa-a95f-a1707dec363f service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:24.461622 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5429c05-17cc-4daa-a95f-a1707dec363f service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:24.461934 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5429c05-17cc-4daa-a95f-a1707dec363f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:24.473401 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5429c05-17cc-4daa-a95f-a1707dec363f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:24.475265 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5429c05-17cc-4daa-a95f-a1707dec363f service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:24.489013 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1148/2292] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:35:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:35:24.952151 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd4885-51f0-4d42-9634-c0037e715a6f None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:24.953964 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-63cd4885-51f0-4d42-9634-c0037e715a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:24.974969 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd4885-51f0-4d42-9634-c0037e715a6f None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:24.984822 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746ace78-e9a0-4dae-a3a5-2ff07cd12e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:24.986128 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ace78-e9a0-4dae-a3a5-2ff07cd12e1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:24.986892 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ace78-e9a0-4dae-a3a5-2ff07cd12e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:24.987499 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ace78-e9a0-4dae-a3a5-2ff07cd12e1a admin admin] PATH_INFO: `/v3/projects/1e78ed62eb5d4cd795b5bde3e9cf220f` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:24.990931 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746ace78-e9a0-4dae-a3a5-2ff07cd12e1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e78ed62eb5d4cd795b5bde3e9cf220f)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:24.994855 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746ace78-e9a0-4dae-a3a5-2ff07cd12e1a admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:25.109607 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-746ace78-e9a0-4dae-a3a5-2ff07cd12e1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e78ed62eb5d4cd795b5bde3e9cf220f', 'request_id': 'req-746ace78-e9a0-4dae-a3a5-2ff07cd12e1a'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:25.118928 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-746ace78-e9a0-4dae-a3a5-2ff07cd12e1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e78ed62eb5d4cd795b5bde3e9cf220f', 'request_id': 'req-746ace78-e9a0-4dae-a3a5-2ff07cd12e1a'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:25.133002 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-746ace78-e9a0-4dae-a3a5-2ff07cd12e1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e78ed62eb5d4cd795b5bde3e9cf220f', 'request_id': 'req-746ace78-e9a0-4dae-a3a5-2ff07cd12e1a'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:25.152936 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-746ace78-e9a0-4dae-a3a5-2ff07cd12e1a admin admin] The token cache is being invalidate because project 1e78ed62eb5d4cd795b5bde3e9cf220f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:35:25.153557 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-746ace78-e9a0-4dae-a3a5-2ff07cd12e1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:25.154541 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-746ace78-e9a0-4dae-a3a5-2ff07cd12e1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:25.156811 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1145/2293] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:35:24 2022] DELETE /identity/v3/projects/1e78ed62eb5d4cd795b5bde3e9cf220f => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:25.163210 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5429c05-17cc-4daa-a95f-a1707dec363f service neutron] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:25.179431 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5429c05-17cc-4daa-a95f-a1707dec363f service neutron] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:25.202073 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:25.304834 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5be23d-0cbb-47b1-9cfe-63f0531d7f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:25.306052 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5be23d-0cbb-47b1-9cfe-63f0531d7f8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:25.306578 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5be23d-0cbb-47b1-9cfe-63f0531d7f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:25.307161 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5be23d-0cbb-47b1-9cfe-63f0531d7f8e admin admin] PATH_INFO: `/v3/users/f3a845d5d731491caaf0609339de5adf` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:25.309259 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5be23d-0cbb-47b1-9cfe-63f0531d7f8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3a845d5d731491caaf0609339de5adf)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:25.313012 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5be23d-0cbb-47b1-9cfe-63f0531d7f8e admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:25.406272 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-1b5be23d-0cbb-47b1-9cfe-63f0531d7f8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3a845d5d731491caaf0609339de5adf'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:25.428898 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-1b5be23d-0cbb-47b1-9cfe-63f0531d7f8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3a845d5d731491caaf0609339de5adf'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:25.456402 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-1b5be23d-0cbb-47b1-9cfe-63f0531d7f8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3a845d5d731491caaf0609339de5adf'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:25.457388 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-1b5be23d-0cbb-47b1-9cfe-63f0531d7f8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3a845d5d731491caaf0609339de5adf'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:25.494806 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-1b5be23d-0cbb-47b1-9cfe-63f0531d7f8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3a845d5d731491caaf0609339de5adf'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:25.515898 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1149/2294] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:35:25 2022] DELETE /identity/v3/users/f3a845d5d731491caaf0609339de5adf => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:25.660245 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746ace78-e9a0-4dae-a3a5-2ff07cd12e1a admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:25.663225 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-746ace78-e9a0-4dae-a3a5-2ff07cd12e1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:25.822243 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746ace78-e9a0-4dae-a3a5-2ff07cd12e1a admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:25.951489 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0161fe2-a68a-41d4-b4ea-c9367cc57895 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd806295278ae4997b5c6968aa553290c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:25.951489 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0161fe2-a68a-41d4-b4ea-c9367cc57895 service nova] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:25.951983 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0161fe2-a68a-41d4-b4ea-c9367cc57895 service nova] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:25.952334 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0161fe2-a68a-41d4-b4ea-c9367cc57895 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:25.955088 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-a0161fe2-a68a-41d4-b4ea-c9367cc57895 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:25.982752 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:26.065842 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5be23d-0cbb-47b1-9cfe-63f0531d7f8e admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:26.067573 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-1b5be23d-0cbb-47b1-9cfe-63f0531d7f8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:26.086605 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0161fe2-a68a-41d4-b4ea-c9367cc57895 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:26.089435 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0161fe2-a68a-41d4-b4ea-c9367cc57895 service nova] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:26.103242 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1146/2295] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:35:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:35:26.197597 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5be23d-0cbb-47b1-9cfe-63f0531d7f8e admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:26.205292 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354535b9-bf50-4d33-ae1c-c80d382a4c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:26.206447 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354535b9-bf50-4d33-ae1c-c80d382a4c18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:26.206721 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354535b9-bf50-4d33-ae1c-c80d382a4c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:26.206992 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354535b9-bf50-4d33-ae1c-c80d382a4c18 admin admin] PATH_INFO: `/v3/projects/476df39140ae4169a759ad569f2cee7e` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:26.208505 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354535b9-bf50-4d33-ae1c-c80d382a4c18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=476df39140ae4169a759ad569f2cee7e)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:26.210952 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354535b9-bf50-4d33-ae1c-c80d382a4c18 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:26.307734 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:26.327887 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-354535b9-bf50-4d33-ae1c-c80d382a4c18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '476df39140ae4169a759ad569f2cee7e', 'request_id': 'req-354535b9-bf50-4d33-ae1c-c80d382a4c18'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:26.354356 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-354535b9-bf50-4d33-ae1c-c80d382a4c18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '476df39140ae4169a759ad569f2cee7e', 'request_id': 'req-354535b9-bf50-4d33-ae1c-c80d382a4c18'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:26.363623 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-354535b9-bf50-4d33-ae1c-c80d382a4c18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '476df39140ae4169a759ad569f2cee7e', 'request_id': 'req-354535b9-bf50-4d33-ae1c-c80d382a4c18'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:26.389951 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-354535b9-bf50-4d33-ae1c-c80d382a4c18 admin admin] The token cache is being invalidate because project 476df39140ae4169a759ad569f2cee7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:35:26.390518 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-354535b9-bf50-4d33-ae1c-c80d382a4c18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:26.391867 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-354535b9-bf50-4d33-ae1c-c80d382a4c18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:26.396892 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1150/2296] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:35:26 2022] DELETE /identity/v3/projects/476df39140ae4169a759ad569f2cee7e => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:35:26.402695 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08f12c-fa79-458c-ad24-cb6db888a9e1 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:26.403318 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08f12c-fa79-458c-ad24-cb6db888a9e1 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:26.403898 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08f12c-fa79-458c-ad24-cb6db888a9e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:26.451762 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-1c08f12c-fa79-458c-ad24-cb6db888a9e1 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:26.455278 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-1c08f12c-fa79-458c-ad24-cb6db888a9e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:26.661430 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1147/2297] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:35:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:26.673718 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869cabb-6c83-436e-95ed-d86e1fb89f4d None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:26.674510 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869cabb-6c83-436e-95ed-d86e1fb89f4d None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:26.675038 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869cabb-6c83-436e-95ed-d86e1fb89f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:26.715398 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-2869cabb-6c83-436e-95ed-d86e1fb89f4d None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:26.717754 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-2869cabb-6c83-436e-95ed-d86e1fb89f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:26.737869 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1151/2298] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:35:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:26.743825 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c08f12c-fa79-458c-ad24-cb6db888a9e1 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:26.772802 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c08f12c-fa79-458c-ad24-cb6db888a9e1 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:26.786595 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd2080b-bbe1-4b1d-8863-eb883fc2a9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:26.788026 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd2080b-bbe1-4b1d-8863-eb883fc2a9f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:26.789013 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd2080b-bbe1-4b1d-8863-eb883fc2a9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:26.789803 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd2080b-bbe1-4b1d-8863-eb883fc2a9f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:26.791286 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd2080b-bbe1-4b1d-8863-eb883fc2a9f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:35:26.791748 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd2080b-bbe1-4b1d-8863-eb883fc2a9f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:26.795509 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd2080b-bbe1-4b1d-8863-eb883fc2a9f3 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:26.838949 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1148/2299] 10.222.0.91 () {58 vars in 1153 bytes} [Tue Aug 30 04:35:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:35:26.840364 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2869cabb-6c83-436e-95ed-d86e1fb89f4d None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:26.856598 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2869cabb-6c83-436e-95ed-d86e1fb89f4d None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:26.862188 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781052c-c47d-4160-96e4-f0f7c5ec15c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:26.862834 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781052c-c47d-4160-96e4-f0f7c5ec15c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:26.863380 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781052c-c47d-4160-96e4-f0f7c5ec15c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:26.863659 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781052c-c47d-4160-96e4-f0f7c5ec15c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:26.866103 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781052c-c47d-4160-96e4-f0f7c5ec15c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:26.868533 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781052c-c47d-4160-96e4-f0f7c5ec15c0 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:26.923953 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1152/2300] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:35:26 2022] POST /identity/v3/projects => generated 363 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:35:26.927998 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd2080b-bbe1-4b1d-8863-eb883fc2a9f3 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:26.940199 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd2080b-bbe1-4b1d-8863-eb883fc2a9f3 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:27.093667 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8acf20-bd4f-4fb7-99a1-77fbeeb16e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:27.094874 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8acf20-bd4f-4fb7-99a1-77fbeeb16e49 admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:27.095527 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8acf20-bd4f-4fb7-99a1-77fbeeb16e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:27.096237 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8acf20-bd4f-4fb7-99a1-77fbeeb16e49 admin admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:27.097388 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8acf20-bd4f-4fb7-99a1-77fbeeb16e49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:27.101573 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8acf20-bd4f-4fb7-99a1-77fbeeb16e49 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:27.149381 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781052c-c47d-4160-96e4-f0f7c5ec15c0 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:27.151373 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1149/2301] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:35:26 2022] POST /identity/v3/users => generated 282 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:35:27.167500 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781052c-c47d-4160-96e4-f0f7c5ec15c0 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:27.190254 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db2fa2-b556-41ba-98cd-666729444c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:27.191184 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db2fa2-b556-41ba-98cd-666729444c53 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:27.191437 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db2fa2-b556-41ba-98cd-666729444c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:27.191789 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db2fa2-b556-41ba-98cd-666729444c53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:27.193202 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3db2fa2-b556-41ba-98cd-666729444c53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:27.196504 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3db2fa2-b556-41ba-98cd-666729444c53 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:27.213362 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1153/2302] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:35:27 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:35:27.225339 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8acf20-bd4f-4fb7-99a1-77fbeeb16e49 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:27.253840 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8acf20-bd4f-4fb7-99a1-77fbeeb16e49 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:27.260231 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f075f17-4b9d-4947-8cf9-ee6ff1bd196e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:27.260887 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f075f17-4b9d-4947-8cf9-ee6ff1bd196e admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:27.261151 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f075f17-4b9d-4947-8cf9-ee6ff1bd196e admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:27.261423 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f075f17-4b9d-4947-8cf9-ee6ff1bd196e admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:27.262172 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f075f17-4b9d-4947-8cf9-ee6ff1bd196e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:27.263894 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f075f17-4b9d-4947-8cf9-ee6ff1bd196e admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:27.293514 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1150/2303] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:35:27 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:35:27.301326 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db2fa2-b556-41ba-98cd-666729444c53 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:27.325148 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db2fa2-b556-41ba-98cd-666729444c53 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:27.335639 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2045c50-6d83-4367-8bec-34c8fc5ac8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:27.336962 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2045c50-6d83-4367-8bec-34c8fc5ac8ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:27.337507 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2045c50-6d83-4367-8bec-34c8fc5ac8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:27.338052 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2045c50-6d83-4367-8bec-34c8fc5ac8ae admin admin] PATH_INFO: `/v3/projects/54a258d766fb4e57a418a7df07534e3a/users/3fe478ddb8b74797994963f725f23144/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:27.380740 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2045c50-6d83-4367-8bec-34c8fc5ac8ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=54a258d766fb4e57a418a7df07534e3a, user_id=3fe478ddb8b74797994963f725f23144, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:27.385131 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2045c50-6d83-4367-8bec-34c8fc5ac8ae admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:27.438830 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1154/2304] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:35:27 2022] PUT /identity/v3/projects/54a258d766fb4e57a418a7df07534e3a/users/3fe478ddb8b74797994963f725f23144/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:27.462883 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d63099c-c220-488f-af4f-345dae9ecf1c None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:27.463181 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d63099c-c220-488f-af4f-345dae9ecf1c None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:27.463514 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d63099c-c220-488f-af4f-345dae9ecf1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:27.542528 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-4d63099c-c220-488f-af4f-345dae9ecf1c None None] MFA Rules not processed for user `3fe478ddb8b74797994963f725f23144`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:27.545481 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-4d63099c-c220-488f-af4f-345dae9ecf1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:27.578745 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:27.720796 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1151/2305] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:35:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:27.730136 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2045c50-6d83-4367-8bec-34c8fc5ac8ae admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:27.868454 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2045c50-6d83-4367-8bec-34c8fc5ac8ae admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:27.890455 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf8aca-0744-4ac0-a027-0f927b530deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:27.890455 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf8aca-0744-4ac0-a027-0f927b530deb admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:27.890455 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf8aca-0744-4ac0-a027-0f927b530deb admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:27.890455 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf8aca-0744-4ac0-a027-0f927b530deb admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:27.891013 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baf8aca-0744-4ac0-a027-0f927b530deb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:27.893495 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baf8aca-0744-4ac0-a027-0f927b530deb admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:27.953817 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1155/2306] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:35:27 2022] POST /identity/v3/projects => generated 363 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:35:27.959242 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d63099c-c220-488f-af4f-345dae9ecf1c None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:27.982996 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d63099c-c220-488f-af4f-345dae9ecf1c None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:28.104668 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5639ba32-375d-4020-83bd-3703863453ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:28.105685 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639ba32-375d-4020-83bd-3703863453ff admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:28.106040 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639ba32-375d-4020-83bd-3703863453ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:28.106468 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639ba32-375d-4020-83bd-3703863453ff admin admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:28.107524 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5639ba32-375d-4020-83bd-3703863453ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:28.111519 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5639ba32-375d-4020-83bd-3703863453ff admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:28.163257 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1152/2307] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:35:27 2022] POST /identity/v3/users => generated 288 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:35:28.165513 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf8aca-0744-4ac0-a027-0f927b530deb admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:28.193928 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf8aca-0744-4ac0-a027-0f927b530deb admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:28.212042 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d967958a-79e6-47c9-a863-8f9b77156baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:28.213933 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967958a-79e6-47c9-a863-8f9b77156baa admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:28.214972 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967958a-79e6-47c9-a863-8f9b77156baa admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:28.214972 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967958a-79e6-47c9-a863-8f9b77156baa admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:28.216945 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d967958a-79e6-47c9-a863-8f9b77156baa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:28.224781 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d967958a-79e6-47c9-a863-8f9b77156baa admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:28.251600 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1156/2308] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:35:28 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:35:28.259487 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5639ba32-375d-4020-83bd-3703863453ff admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:28.294597 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5639ba32-375d-4020-83bd-3703863453ff admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:28.315521 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b7c897-e8b1-4ece-8c13-49aad8fd9d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:28.316810 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7c897-e8b1-4ece-8c13-49aad8fd9d2d admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:28.317389 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7c897-e8b1-4ece-8c13-49aad8fd9d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:28.317953 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7c897-e8b1-4ece-8c13-49aad8fd9d2d admin admin] PATH_INFO: `/v3/projects/7d5b6851ea4242d3b5a034fe9feda7a1/users/cb6e81ea7ca44b63b27384cb3a1f7b7a/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:28.348173 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b7c897-e8b1-4ece-8c13-49aad8fd9d2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d5b6851ea4242d3b5a034fe9feda7a1, user_id=cb6e81ea7ca44b63b27384cb3a1f7b7a, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:28.353893 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b7c897-e8b1-4ece-8c13-49aad8fd9d2d admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:28.388471 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1153/2309] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:35:28 2022] PUT /identity/v3/projects/7d5b6851ea4242d3b5a034fe9feda7a1/users/cb6e81ea7ca44b63b27384cb3a1f7b7a/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:28.397457 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d967958a-79e6-47c9-a863-8f9b77156baa admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:28.430595 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d967958a-79e6-47c9-a863-8f9b77156baa admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:28.525805 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b7c897-e8b1-4ece-8c13-49aad8fd9d2d admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:28.543153 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-88b7c897-e8b1-4ece-8c13-49aad8fd9d2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:28.595761 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:28.664118 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b7c897-e8b1-4ece-8c13-49aad8fd9d2d admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:28.669368 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d881859f-6472-48f8-8785-ed383d60c7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:28.670138 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881859f-6472-48f8-8785-ed383d60c7d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:28.670475 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881859f-6472-48f8-8785-ed383d60c7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:28.670656 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881859f-6472-48f8-8785-ed383d60c7d6 admin admin] PATH_INFO: `/v3/users/ba9817cf82004a5e824a93d1b3ede5cb` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:28.672092 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d881859f-6472-48f8-8785-ed383d60c7d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba9817cf82004a5e824a93d1b3ede5cb)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:28.674414 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d881859f-6472-48f8-8785-ed383d60c7d6 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:28.682613 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b185e192-a437-4775-8435-dbf504f0a725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:28.684397 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185e192-a437-4775-8435-dbf504f0a725 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:28.685315 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185e192-a437-4775-8435-dbf504f0a725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:28.685743 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185e192-a437-4775-8435-dbf504f0a725 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:28.686848 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b185e192-a437-4775-8435-dbf504f0a725 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:28.693142 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b185e192-a437-4775-8435-dbf504f0a725 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:28.717618 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1157/2310] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:35:28 2022] GET /identity/v3/roles => generated 1420 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:35:28.725699 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:28.727938 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b185e192-a437-4775-8435-dbf504f0a725 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:28.747853 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b185e192-a437-4775-8435-dbf504f0a725 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:28.759350 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc7a6af-ae3d-4207-a91d-9e0acd3a5d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:28.760914 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc7a6af-ae3d-4207-a91d-9e0acd3a5d15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:28.762528 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc7a6af-ae3d-4207-a91d-9e0acd3a5d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:28.763068 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc7a6af-ae3d-4207-a91d-9e0acd3a5d15 admin admin] PATH_INFO: `/v3/projects/7d5b6851ea4242d3b5a034fe9feda7a1/users/cb6e81ea7ca44b63b27384cb3a1f7b7a/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:28.766741 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc7a6af-ae3d-4207-a91d-9e0acd3a5d15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d5b6851ea4242d3b5a034fe9feda7a1, user_id=cb6e81ea7ca44b63b27384cb3a1f7b7a, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:28.772670 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc7a6af-ae3d-4207-a91d-9e0acd3a5d15 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:28.774912 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-d881859f-6472-48f8-8785-ed383d60c7d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba9817cf82004a5e824a93d1b3ede5cb'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:28.775784 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-d881859f-6472-48f8-8785-ed383d60c7d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba9817cf82004a5e824a93d1b3ede5cb'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:28.776606 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-d881859f-6472-48f8-8785-ed383d60c7d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba9817cf82004a5e824a93d1b3ede5cb'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:28.790485 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-d881859f-6472-48f8-8785-ed383d60c7d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba9817cf82004a5e824a93d1b3ede5cb'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:28.794282 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1158/2311] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:35:28 2022] PUT /identity/v3/projects/7d5b6851ea4242d3b5a034fe9feda7a1/users/cb6e81ea7ca44b63b27384cb3a1f7b7a/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:28.810923 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-d881859f-6472-48f8-8785-ed383d60c7d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba9817cf82004a5e824a93d1b3ede5cb'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:28.815418 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91245c-70c8-4757-8abc-c623769c6c86 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:28.816019 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91245c-70c8-4757-8abc-c623769c6c86 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:28.816646 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91245c-70c8-4757-8abc-c623769c6c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:28.834357 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1154/2312] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:35:28 2022] DELETE /identity/v3/users/ba9817cf82004a5e824a93d1b3ede5cb => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:28.868899 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-2e91245c-70c8-4757-8abc-c623769c6c86 None None] MFA Rules not processed for user `cb6e81ea7ca44b63b27384cb3a1f7b7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:28.870180 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-2e91245c-70c8-4757-8abc-c623769c6c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:28.980976 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1159/2313] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:35:28 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:35:28.993553 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d881859f-6472-48f8-8785-ed383d60c7d6 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:28.994999 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-d881859f-6472-48f8-8785-ed383d60c7d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:29.101500 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d881859f-6472-48f8-8785-ed383d60c7d6 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:29.123064 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dccb5f5-6a06-4750-bff2-6b715feb248a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:29.123064 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dccb5f5-6a06-4750-bff2-6b715feb248a service cinder] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:29.123556 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dccb5f5-6a06-4750-bff2-6b715feb248a service cinder] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:29.124093 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dccb5f5-6a06-4750-bff2-6b715feb248a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:29.137922 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dccb5f5-6a06-4750-bff2-6b715feb248a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:29.139643 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dccb5f5-6a06-4750-bff2-6b715feb248a service cinder] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:29.157593 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1155/2314] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:35:28 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:35:29.173683 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e91245c-70c8-4757-8abc-c623769c6c86 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:29.178136 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-2e91245c-70c8-4757-8abc-c623769c6c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:29.288698 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e91245c-70c8-4757-8abc-c623769c6c86 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:29.294207 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02cb91-c5cc-445c-b2f8-ee6c61f8bb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:29.294875 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02cb91-c5cc-445c-b2f8-ee6c61f8bb73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:29.295175 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02cb91-c5cc-445c-b2f8-ee6c61f8bb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:29.295428 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02cb91-c5cc-445c-b2f8-ee6c61f8bb73 admin admin] PATH_INFO: `/v3/projects/da2baee55e704f8cbcf73b9bab63bd9a` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:29.296696 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b02cb91-c5cc-445c-b2f8-ee6c61f8bb73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da2baee55e704f8cbcf73b9bab63bd9a)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:29.298637 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b02cb91-c5cc-445c-b2f8-ee6c61f8bb73 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:29.365515 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:29.372970 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-1b02cb91-c5cc-445c-b2f8-ee6c61f8bb73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da2baee55e704f8cbcf73b9bab63bd9a', 'request_id': 'req-1b02cb91-c5cc-445c-b2f8-ee6c61f8bb73'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:29.392208 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-1b02cb91-c5cc-445c-b2f8-ee6c61f8bb73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da2baee55e704f8cbcf73b9bab63bd9a', 'request_id': 'req-1b02cb91-c5cc-445c-b2f8-ee6c61f8bb73'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:29.392208 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-1b02cb91-c5cc-445c-b2f8-ee6c61f8bb73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da2baee55e704f8cbcf73b9bab63bd9a', 'request_id': 'req-1b02cb91-c5cc-445c-b2f8-ee6c61f8bb73'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:29.415828 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-1b02cb91-c5cc-445c-b2f8-ee6c61f8bb73 admin admin] The token cache is being invalidate because project da2baee55e704f8cbcf73b9bab63bd9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:35:29.416547 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-1b02cb91-c5cc-445c-b2f8-ee6c61f8bb73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:29.417658 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-1b02cb91-c5cc-445c-b2f8-ee6c61f8bb73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:29.420403 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1160/2315] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:35:29 2022] DELETE /identity/v3/projects/da2baee55e704f8cbcf73b9bab63bd9a => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:29.425084 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dccb5f5-6a06-4750-bff2-6b715feb248a service cinder] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:29.449970 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dccb5f5-6a06-4750-bff2-6b715feb248a service cinder] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:29.578630 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5291e78-476a-4fe9-87a4-92df5a523d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:29.579426 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5291e78-476a-4fe9-87a4-92df5a523d29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:29.579743 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5291e78-476a-4fe9-87a4-92df5a523d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:29.580114 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5291e78-476a-4fe9-87a4-92df5a523d29 admin admin] PATH_INFO: `/v3/users/6a76139959714c6eb61ecca502ab7138` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:29.581406 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5291e78-476a-4fe9-87a4-92df5a523d29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a76139959714c6eb61ecca502ab7138)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:29.584555 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5291e78-476a-4fe9-87a4-92df5a523d29 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:29.657700 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:29.667601 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-a5291e78-476a-4fe9-87a4-92df5a523d29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a76139959714c6eb61ecca502ab7138'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:29.669541 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-a5291e78-476a-4fe9-87a4-92df5a523d29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a76139959714c6eb61ecca502ab7138'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:29.670614 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-a5291e78-476a-4fe9-87a4-92df5a523d29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a76139959714c6eb61ecca502ab7138'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:29.683978 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-a5291e78-476a-4fe9-87a4-92df5a523d29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a76139959714c6eb61ecca502ab7138'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:29.730578 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-a5291e78-476a-4fe9-87a4-92df5a523d29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a76139959714c6eb61ecca502ab7138'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:29.764293 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1156/2316] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:35:29 2022] DELETE /identity/v3/users/6a76139959714c6eb61ecca502ab7138 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:35:29.935097 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02cb91-c5cc-445c-b2f8-ee6c61f8bb73 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:29.936659 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-1b02cb91-c5cc-445c-b2f8-ee6c61f8bb73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:29.961115 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02cb91-c5cc-445c-b2f8-ee6c61f8bb73 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:30.096359 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9244739-fcf4-41d2-8f44-e02177cc7c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:30.098242 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9244739-fcf4-41d2-8f44-e02177cc7c3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:30.098379 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9244739-fcf4-41d2-8f44-e02177cc7c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:30.098740 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9244739-fcf4-41d2-8f44-e02177cc7c3f admin admin] PATH_INFO: `/v3/users/3fe478ddb8b74797994963f725f23144` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:30.101635 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9244739-fcf4-41d2-8f44-e02177cc7c3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fe478ddb8b74797994963f725f23144)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:30.104164 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9244739-fcf4-41d2-8f44-e02177cc7c3f admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:30.121035 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5291e78-476a-4fe9-87a4-92df5a523d29 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:30.123067 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-a5291e78-476a-4fe9-87a4-92df5a523d29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:30.158339 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5291e78-476a-4fe9-87a4-92df5a523d29 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:30.168958 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed81de6-cce9-47f3-87e4-f49dcb58e85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:30.170398 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed81de6-cce9-47f3-87e4-f49dcb58e85e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:30.170877 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed81de6-cce9-47f3-87e4-f49dcb58e85e admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:30.171342 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed81de6-cce9-47f3-87e4-f49dcb58e85e admin admin] PATH_INFO: `/v3/projects/6529d016e7774d7689b965de00c5d1a9` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:30.173665 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed81de6-cce9-47f3-87e4-f49dcb58e85e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6529d016e7774d7689b965de00c5d1a9)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:30.178556 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed81de6-cce9-47f3-87e4-f49dcb58e85e admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:30.215734 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-c9244739-fcf4-41d2-8f44-e02177cc7c3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fe478ddb8b74797994963f725f23144'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:30.228792 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-c9244739-fcf4-41d2-8f44-e02177cc7c3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fe478ddb8b74797994963f725f23144'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:30.240536 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-c9244739-fcf4-41d2-8f44-e02177cc7c3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fe478ddb8b74797994963f725f23144'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:30.241593 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-c9244739-fcf4-41d2-8f44-e02177cc7c3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fe478ddb8b74797994963f725f23144'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:30.269754 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-c9244739-fcf4-41d2-8f44-e02177cc7c3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fe478ddb8b74797994963f725f23144'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:30.277809 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-0ed81de6-cce9-47f3-87e4-f49dcb58e85e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6529d016e7774d7689b965de00c5d1a9', 'request_id': 'req-0ed81de6-cce9-47f3-87e4-f49dcb58e85e'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:30.281219 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1161/2317] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:35:29 2022] DELETE /identity/v3/users/3fe478ddb8b74797994963f725f23144 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:35:30.287952 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c11ea-c407-4ef4-acd2-366b0d289a82 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:30.289252 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c11ea-c407-4ef4-acd2-366b0d289a82 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:30.290406 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-0ed81de6-cce9-47f3-87e4-f49dcb58e85e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6529d016e7774d7689b965de00c5d1a9', 'request_id': 'req-0ed81de6-cce9-47f3-87e4-f49dcb58e85e'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:30.290766 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c11ea-c407-4ef4-acd2-366b0d289a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:30.302300 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-0ed81de6-cce9-47f3-87e4-f49dcb58e85e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6529d016e7774d7689b965de00c5d1a9', 'request_id': 'req-0ed81de6-cce9-47f3-87e4-f49dcb58e85e'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:30.317288 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-0ed81de6-cce9-47f3-87e4-f49dcb58e85e admin admin] The token cache is being invalidate because project 6529d016e7774d7689b965de00c5d1a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:35:30.317288 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-0ed81de6-cce9-47f3-87e4-f49dcb58e85e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:30.318262 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-0ed81de6-cce9-47f3-87e4-f49dcb58e85e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:30.321036 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1157/2318] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:35:30 2022] DELETE /identity/v3/projects/6529d016e7774d7689b965de00c5d1a9 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:35:30.325497 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-2e6c11ea-c407-4ef4-acd2-366b0d289a82 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:30.327448 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-2e6c11ea-c407-4ef4-acd2-366b0d289a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:30.397385 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:30.424484 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1162/2319] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:35:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:35:30.437811 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed81de6-cce9-47f3-87e4-f49dcb58e85e admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:30.439777 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-0ed81de6-cce9-47f3-87e4-f49dcb58e85e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:30.541302 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed81de6-cce9-47f3-87e4-f49dcb58e85e admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:30.623061 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab4b59-41e0-43a3-8835-db30427da589 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:30.623774 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab4b59-41e0-43a3-8835-db30427da589 service neutron] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:30.624090 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab4b59-41e0-43a3-8835-db30427da589 service neutron] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:30.624364 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab4b59-41e0-43a3-8835-db30427da589 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:30.647259 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab4b59-41e0-43a3-8835-db30427da589 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:30.650248 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab4b59-41e0-43a3-8835-db30427da589 service neutron] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:30.663017 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:30.684365 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1158/2320] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:35:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:35:31.047679 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c11ea-c407-4ef4-acd2-366b0d289a82 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:31.050665 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-2e6c11ea-c407-4ef4-acd2-366b0d289a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:31.075591 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c11ea-c407-4ef4-acd2-366b0d289a82 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:31.086264 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c87390c-8788-45d1-934c-9d5fd643fb9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:31.089739 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87390c-8788-45d1-934c-9d5fd643fb9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:31.089739 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87390c-8788-45d1-934c-9d5fd643fb9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:31.089739 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87390c-8788-45d1-934c-9d5fd643fb9b admin admin] PATH_INFO: `/v3/projects/54a258d766fb4e57a418a7df07534e3a` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:31.093021 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c87390c-8788-45d1-934c-9d5fd643fb9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=54a258d766fb4e57a418a7df07534e3a)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:31.096951 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c87390c-8788-45d1-934c-9d5fd643fb9b admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:31.202186 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-0c87390c-8788-45d1-934c-9d5fd643fb9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54a258d766fb4e57a418a7df07534e3a', 'request_id': 'req-0c87390c-8788-45d1-934c-9d5fd643fb9b'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:31.211619 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-0c87390c-8788-45d1-934c-9d5fd643fb9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54a258d766fb4e57a418a7df07534e3a', 'request_id': 'req-0c87390c-8788-45d1-934c-9d5fd643fb9b'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:31.220461 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-0c87390c-8788-45d1-934c-9d5fd643fb9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54a258d766fb4e57a418a7df07534e3a', 'request_id': 'req-0c87390c-8788-45d1-934c-9d5fd643fb9b'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:31.245549 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-0c87390c-8788-45d1-934c-9d5fd643fb9b admin admin] The token cache is being invalidate because project 54a258d766fb4e57a418a7df07534e3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:35:31.246412 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-0c87390c-8788-45d1-934c-9d5fd643fb9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:31.248262 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-0c87390c-8788-45d1-934c-9d5fd643fb9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:31.252298 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1163/2321] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:35:31 2022] DELETE /identity/v3/projects/54a258d766fb4e57a418a7df07534e3a => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:31.255075 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab4b59-41e0-43a3-8835-db30427da589 service neutron] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:31.271736 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab4b59-41e0-43a3-8835-db30427da589 service neutron] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:31.372594 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5118b16d-ec44-4e06-ae6c-b71f6cf31194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:31.373256 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5118b16d-ec44-4e06-ae6c-b71f6cf31194 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:31.373540 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5118b16d-ec44-4e06-ae6c-b71f6cf31194 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:31.373808 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5118b16d-ec44-4e06-ae6c-b71f6cf31194 admin admin] PATH_INFO: `/v3/users/cb6e81ea7ca44b63b27384cb3a1f7b7a` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:31.375053 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5118b16d-ec44-4e06-ae6c-b71f6cf31194 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb6e81ea7ca44b63b27384cb3a1f7b7a)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:31.377130 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5118b16d-ec44-4e06-ae6c-b71f6cf31194 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:31.451120 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-5118b16d-ec44-4e06-ae6c-b71f6cf31194 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb6e81ea7ca44b63b27384cb3a1f7b7a'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:31.451721 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-5118b16d-ec44-4e06-ae6c-b71f6cf31194 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb6e81ea7ca44b63b27384cb3a1f7b7a'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:31.452366 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-5118b16d-ec44-4e06-ae6c-b71f6cf31194 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb6e81ea7ca44b63b27384cb3a1f7b7a'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:31.467564 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-5118b16d-ec44-4e06-ae6c-b71f6cf31194 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb6e81ea7ca44b63b27384cb3a1f7b7a'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:31.484202 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-5118b16d-ec44-4e06-ae6c-b71f6cf31194 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb6e81ea7ca44b63b27384cb3a1f7b7a'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:31.499895 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1159/2322] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:35:31 2022] DELETE /identity/v3/users/cb6e81ea7ca44b63b27384cb3a1f7b7a => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:31.876265 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c87390c-8788-45d1-934c-9d5fd643fb9b admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:31.878275 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-0c87390c-8788-45d1-934c-9d5fd643fb9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:31.902840 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c87390c-8788-45d1-934c-9d5fd643fb9b admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:31.979794 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af38f2d-ca3c-40c1-8aa5-259c62d41483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:31.980457 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af38f2d-ca3c-40c1-8aa5-259c62d41483 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:31.980739 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af38f2d-ca3c-40c1-8aa5-259c62d41483 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:31.981011 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af38f2d-ca3c-40c1-8aa5-259c62d41483 admin admin] PATH_INFO: `/v3/projects/7d5b6851ea4242d3b5a034fe9feda7a1` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:31.982305 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af38f2d-ca3c-40c1-8aa5-259c62d41483 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d5b6851ea4242d3b5a034fe9feda7a1)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:31.984402 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af38f2d-ca3c-40c1-8aa5-259c62d41483 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:32.047705 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-8af38f2d-ca3c-40c1-8aa5-259c62d41483 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d5b6851ea4242d3b5a034fe9feda7a1', 'request_id': 'req-8af38f2d-ca3c-40c1-8aa5-259c62d41483'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:32.055708 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-8af38f2d-ca3c-40c1-8aa5-259c62d41483 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d5b6851ea4242d3b5a034fe9feda7a1', 'request_id': 'req-8af38f2d-ca3c-40c1-8aa5-259c62d41483'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:32.063453 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-8af38f2d-ca3c-40c1-8aa5-259c62d41483 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d5b6851ea4242d3b5a034fe9feda7a1', 'request_id': 'req-8af38f2d-ca3c-40c1-8aa5-259c62d41483'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:32.081800 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-8af38f2d-ca3c-40c1-8aa5-259c62d41483 admin admin] The token cache is being invalidate because project 7d5b6851ea4242d3b5a034fe9feda7a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:35:32.082160 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-8af38f2d-ca3c-40c1-8aa5-259c62d41483 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:32.082765 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-8af38f2d-ca3c-40c1-8aa5-259c62d41483 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:32.084723 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1164/2323] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:35:31 2022] DELETE /identity/v3/projects/7d5b6851ea4242d3b5a034fe9feda7a1 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:32.090028 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11fb198-bd06-41ad-b317-06eded893bc7 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:32.090343 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11fb198-bd06-41ad-b317-06eded893bc7 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:32.090827 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11fb198-bd06-41ad-b317-06eded893bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:32.113376 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-b11fb198-bd06-41ad-b317-06eded893bc7 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:32.114695 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-b11fb198-bd06-41ad-b317-06eded893bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:32.198154 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1160/2324] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:35:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:32.207191 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8672136-22a3-4330-8a50-465d9a766d48 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:32.207479 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8672136-22a3-4330-8a50-465d9a766d48 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:32.207724 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8672136-22a3-4330-8a50-465d9a766d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:32.217399 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:32.232756 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-c8672136-22a3-4330-8a50-465d9a766d48 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:32.234859 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-c8672136-22a3-4330-8a50-465d9a766d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:32.244819 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1165/2325] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:35:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:32.249721 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11fb198-bd06-41ad-b317-06eded893bc7 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:32.260619 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11fb198-bd06-41ad-b317-06eded893bc7 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:32.266138 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1fa1a5-d3a0-4e32-a339-4bf9bb5a386f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:32.266833 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1fa1a5-d3a0-4e32-a339-4bf9bb5a386f admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:32.267157 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1fa1a5-d3a0-4e32-a339-4bf9bb5a386f admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:32.267457 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1fa1a5-d3a0-4e32-a339-4bf9bb5a386f admin admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:32.268247 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1fa1a5-d3a0-4e32-a339-4bf9bb5a386f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:35:32.268585 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1fa1a5-d3a0-4e32-a339-4bf9bb5a386f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:32.270281 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1fa1a5-d3a0-4e32-a339-4bf9bb5a386f admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:32.283706 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1161/2326] 10.222.0.91 () {58 vars in 1153 bytes} [Tue Aug 30 04:35:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:35:32.289578 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8672136-22a3-4330-8a50-465d9a766d48 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:32.306558 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8672136-22a3-4330-8a50-465d9a766d48 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:32.314534 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cea950-171e-4257-94dc-05efd55f63fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:32.315569 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cea950-171e-4257-94dc-05efd55f63fd admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:32.316116 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cea950-171e-4257-94dc-05efd55f63fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:32.316604 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cea950-171e-4257-94dc-05efd55f63fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:32.317846 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cea950-171e-4257-94dc-05efd55f63fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:32.321890 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cea950-171e-4257-94dc-05efd55f63fd admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:32.374825 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1166/2327] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:35:32 2022] POST /identity/v3/projects => generated 365 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:35:32.380866 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1fa1a5-d3a0-4e32-a339-4bf9bb5a386f admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:32.394314 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1fa1a5-d3a0-4e32-a339-4bf9bb5a386f admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:32.400192 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:32.505149 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379bf264-e9f6-493d-a61f-2197c506d311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:32.506343 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379bf264-e9f6-493d-a61f-2197c506d311 admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:32.506803 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379bf264-e9f6-493d-a61f-2197c506d311 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:32.507229 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379bf264-e9f6-493d-a61f-2197c506d311 admin admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:32.508400 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379bf264-e9f6-493d-a61f-2197c506d311 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:32.512068 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379bf264-e9f6-493d-a61f-2197c506d311 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:32.546651 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1162/2328] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:35:32 2022] POST /identity/v3/users => generated 283 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:35:32.552282 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cea950-171e-4257-94dc-05efd55f63fd admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:32.571156 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cea950-171e-4257-94dc-05efd55f63fd admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:32.578367 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218a10b-8a10-4e6d-831d-6de90bcbc361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:32.579494 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218a10b-8a10-4e6d-831d-6de90bcbc361 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:32.580065 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218a10b-8a10-4e6d-831d-6de90bcbc361 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:32.580620 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218a10b-8a10-4e6d-831d-6de90bcbc361 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:32.581793 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5218a10b-8a10-4e6d-831d-6de90bcbc361 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:32.584643 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5218a10b-8a10-4e6d-831d-6de90bcbc361 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:32.612217 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1167/2329] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:35:32.614342 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379bf264-e9f6-493d-a61f-2197c506d311 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:32.640320 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379bf264-e9f6-493d-a61f-2197c506d311 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:32.651042 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f5091-f3f7-4fcc-923d-1320d542ea85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:32.651824 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f5091-f3f7-4fcc-923d-1320d542ea85 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:32.652285 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f5091-f3f7-4fcc-923d-1320d542ea85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:32.652671 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f5091-f3f7-4fcc-923d-1320d542ea85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:32.653490 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0f5091-f3f7-4fcc-923d-1320d542ea85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:32.655679 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0f5091-f3f7-4fcc-923d-1320d542ea85 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:32.674068 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1163/2330] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:35:32.680588 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218a10b-8a10-4e6d-831d-6de90bcbc361 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:32.702279 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218a10b-8a10-4e6d-831d-6de90bcbc361 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:32.711537 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965e6486-52b8-4a42-adce-1aefe5a93ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:32.712654 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e6486-52b8-4a42-adce-1aefe5a93ba1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:32.713091 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e6486-52b8-4a42-adce-1aefe5a93ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:32.713558 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e6486-52b8-4a42-adce-1aefe5a93ba1 admin admin] PATH_INFO: `/v3/projects/faeef655b8894babbac95491d5698d5f/users/ac06aa0e6d6f4531808552976e412293/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:32.748741 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965e6486-52b8-4a42-adce-1aefe5a93ba1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=faeef655b8894babbac95491d5698d5f, user_id=ac06aa0e6d6f4531808552976e412293, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:32.753950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965e6486-52b8-4a42-adce-1aefe5a93ba1 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:32.793123 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1168/2331] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:35:32 2022] PUT /identity/v3/projects/faeef655b8894babbac95491d5698d5f/users/ac06aa0e6d6f4531808552976e412293/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:32.807860 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ab4bc-472f-4005-a4cc-b6914712a3b2 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:32.808402 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ab4bc-472f-4005-a4cc-b6914712a3b2 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:32.808828 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ab4bc-472f-4005-a4cc-b6914712a3b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:32.863162 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-838ab4bc-472f-4005-a4cc-b6914712a3b2 None None] MFA Rules not processed for user `ac06aa0e6d6f4531808552976e412293`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:32.865461 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-838ab4bc-472f-4005-a4cc-b6914712a3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:32.996130 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1164/2332] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:35:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:35:33.000241 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965e6486-52b8-4a42-adce-1aefe5a93ba1 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:33.128893 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965e6486-52b8-4a42-adce-1aefe5a93ba1 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:33.138764 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d3fd2f-70ce-4874-a268-c6862cac784c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:33.139488 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3fd2f-70ce-4874-a268-c6862cac784c admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:33.139766 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3fd2f-70ce-4874-a268-c6862cac784c admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:33.140079 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3fd2f-70ce-4874-a268-c6862cac784c admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:33.140823 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d3fd2f-70ce-4874-a268-c6862cac784c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:33.142830 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d3fd2f-70ce-4874-a268-c6862cac784c admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:33.190643 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1169/2333] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:35:32 2022] POST /identity/v3/projects => generated 363 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:35:33.196062 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ab4bc-472f-4005-a4cc-b6914712a3b2 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:33.212489 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ab4bc-472f-4005-a4cc-b6914712a3b2 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:33.327822 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61995d8-f156-4695-a53e-ac80aa643df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:33.328624 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61995d8-f156-4695-a53e-ac80aa643df7 admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:33.328971 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61995d8-f156-4695-a53e-ac80aa643df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:33.329305 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61995d8-f156-4695-a53e-ac80aa643df7 admin admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:33.330055 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61995d8-f156-4695-a53e-ac80aa643df7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:33.333059 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61995d8-f156-4695-a53e-ac80aa643df7 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:33.365368 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1165/2334] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:35:33 2022] POST /identity/v3/users => generated 288 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:35:33.369903 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d3fd2f-70ce-4874-a268-c6862cac784c admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:33.385897 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d3fd2f-70ce-4874-a268-c6862cac784c admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:33.391848 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b90e07d-ba51-4b91-9d36-25106c1bfd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:33.393458 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b90e07d-ba51-4b91-9d36-25106c1bfd05 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:33.393458 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b90e07d-ba51-4b91-9d36-25106c1bfd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:33.393458 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b90e07d-ba51-4b91-9d36-25106c1bfd05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:33.394050 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b90e07d-ba51-4b91-9d36-25106c1bfd05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:33.396232 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b90e07d-ba51-4b91-9d36-25106c1bfd05 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:33.409798 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1170/2335] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:35:33 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:35:33.416648 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61995d8-f156-4695-a53e-ac80aa643df7 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:33.425753 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:33.433354 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61995d8-f156-4695-a53e-ac80aa643df7 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:33.438622 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ddf13a-d8c9-4d7c-867b-ac9d435dcafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:33.440455 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ddf13a-d8c9-4d7c-867b-ac9d435dcafb admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:33.440455 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ddf13a-d8c9-4d7c-867b-ac9d435dcafb admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:33.440910 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ddf13a-d8c9-4d7c-867b-ac9d435dcafb admin admin] PATH_INFO: `/v3/projects/de0000a8b015460abcb14a18142fea2f/users/596013f2adcc47709bd824f56c4c9e31/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:33.465999 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ddf13a-d8c9-4d7c-867b-ac9d435dcafb admin admin] RBAC: Authorizing `identity:create_grant(project_id=de0000a8b015460abcb14a18142fea2f, user_id=596013f2adcc47709bd824f56c4c9e31, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:33.474071 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ddf13a-d8c9-4d7c-867b-ac9d435dcafb admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:33.495857 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1166/2336] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:35:33 2022] PUT /identity/v3/projects/de0000a8b015460abcb14a18142fea2f/users/596013f2adcc47709bd824f56c4c9e31/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:35:33.501462 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b90e07d-ba51-4b91-9d36-25106c1bfd05 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:33.522275 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b90e07d-ba51-4b91-9d36-25106c1bfd05 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:33.662873 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb35a906-646f-472a-be74-3fdf13abe6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:33.663873 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35a906-646f-472a-be74-3fdf13abe6a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:33.664189 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35a906-646f-472a-be74-3fdf13abe6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:33.664460 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35a906-646f-472a-be74-3fdf13abe6a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:33.665272 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb35a906-646f-472a-be74-3fdf13abe6a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:33.667087 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb35a906-646f-472a-be74-3fdf13abe6a8 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:33.685299 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1171/2337] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:35:33 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:35:33.694908 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ddf13a-d8c9-4d7c-867b-ac9d435dcafb admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:33.716104 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ddf13a-d8c9-4d7c-867b-ac9d435dcafb admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:33.722113 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e1a89-521e-482b-9b3e-1236e409e41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:33.723185 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e1a89-521e-482b-9b3e-1236e409e41f admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:33.723461 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e1a89-521e-482b-9b3e-1236e409e41f admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:33.723742 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e1a89-521e-482b-9b3e-1236e409e41f admin admin] PATH_INFO: `/v3/projects/de0000a8b015460abcb14a18142fea2f/users/596013f2adcc47709bd824f56c4c9e31/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:33.726317 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780e1a89-521e-482b-9b3e-1236e409e41f admin admin] RBAC: Authorizing `identity:create_grant(project_id=de0000a8b015460abcb14a18142fea2f, user_id=596013f2adcc47709bd824f56c4c9e31, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:33.731039 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780e1a89-521e-482b-9b3e-1236e409e41f admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:33.744486 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1167/2338] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:35:33 2022] PUT /identity/v3/projects/de0000a8b015460abcb14a18142fea2f/users/596013f2adcc47709bd824f56c4c9e31/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:33.764899 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7da4b6-2ee8-4b72-a39f-3f264fc1e6dd None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:33.765416 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7da4b6-2ee8-4b72-a39f-3f264fc1e6dd None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:33.765887 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7da4b6-2ee8-4b72-a39f-3f264fc1e6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:33.805768 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:33.819237 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-7f7da4b6-2ee8-4b72-a39f-3f264fc1e6dd None None] MFA Rules not processed for user `596013f2adcc47709bd824f56c4c9e31`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:33.821817 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-7f7da4b6-2ee8-4b72-a39f-3f264fc1e6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:33.937556 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1172/2339] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:35:33 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:33.950976 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e1a89-521e-482b-9b3e-1236e409e41f admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:33.953014 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-780e1a89-521e-482b-9b3e-1236e409e41f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:34.037717 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e1a89-521e-482b-9b3e-1236e409e41f admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:34.042499 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc7f0a-9509-4bf3-ab5b-a180af1b6ae1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:34.043207 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc7f0a-9509-4bf3-ab5b-a180af1b6ae1 service cinder] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:34.043527 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc7f0a-9509-4bf3-ab5b-a180af1b6ae1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:34.043849 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc7f0a-9509-4bf3-ab5b-a180af1b6ae1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:34.055017 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cc7f0a-9509-4bf3-ab5b-a180af1b6ae1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:34.056557 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cc7f0a-9509-4bf3-ab5b-a180af1b6ae1 service cinder] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:34.068149 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1168/2340] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:35:33 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:35:34.188613 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7da4b6-2ee8-4b72-a39f-3f264fc1e6dd None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:34.208700 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7da4b6-2ee8-4b72-a39f-3f264fc1e6dd None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:34.213487 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d7aae-7528-4099-a93e-4ed0d983100f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:34.214312 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d7aae-7528-4099-a93e-4ed0d983100f service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:34.214760 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d7aae-7528-4099-a93e-4ed0d983100f service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:34.215077 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d7aae-7528-4099-a93e-4ed0d983100f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:34.311626 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229d7aae-7528-4099-a93e-4ed0d983100f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:34.313296 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229d7aae-7528-4099-a93e-4ed0d983100f service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:34.327877 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1173/2341] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:35:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:35:37.462750 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc7f0a-9509-4bf3-ab5b-a180af1b6ae1 service cinder] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:37.555932 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc7f0a-9509-4bf3-ab5b-a180af1b6ae1 service cinder] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:37.562335 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c391b60-d31a-4efe-b3a0-1d56346d8a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:37.562992 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c391b60-d31a-4efe-b3a0-1d56346d8a05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:37.563277 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c391b60-d31a-4efe-b3a0-1d56346d8a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:37.563550 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c391b60-d31a-4efe-b3a0-1d56346d8a05 admin admin] PATH_INFO: `/v3/users/ac06aa0e6d6f4531808552976e412293` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:37.565059 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c391b60-d31a-4efe-b3a0-1d56346d8a05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac06aa0e6d6f4531808552976e412293)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:37.570207 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c391b60-d31a-4efe-b3a0-1d56346d8a05 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:37.663279 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-5c391b60-d31a-4efe-b3a0-1d56346d8a05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac06aa0e6d6f4531808552976e412293'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:37.664600 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-5c391b60-d31a-4efe-b3a0-1d56346d8a05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac06aa0e6d6f4531808552976e412293'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:37.665294 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-5c391b60-d31a-4efe-b3a0-1d56346d8a05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac06aa0e6d6f4531808552976e412293'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:37.676973 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-5c391b60-d31a-4efe-b3a0-1d56346d8a05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac06aa0e6d6f4531808552976e412293'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:37.699770 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-5c391b60-d31a-4efe-b3a0-1d56346d8a05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac06aa0e6d6f4531808552976e412293'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:37.701540 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:37.737005 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1169/2342] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:35:37 2022] DELETE /identity/v3/users/ac06aa0e6d6f4531808552976e412293 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:35:37.745281 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb103f-9b96-49a2-86ed-aaf807aed49a None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:37.745847 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb103f-9b96-49a2-86ed-aaf807aed49a None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:37.746322 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb103f-9b96-49a2-86ed-aaf807aed49a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:37.783313 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-caeb103f-9b96-49a2-86ed-aaf807aed49a None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:37.784699 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-caeb103f-9b96-49a2-86ed-aaf807aed49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:37.914674 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1174/2343] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:35:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:37.930374 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c391b60-d31a-4efe-b3a0-1d56346d8a05 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:37.932829 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-5c391b60-d31a-4efe-b3a0-1d56346d8a05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:38.037188 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c391b60-d31a-4efe-b3a0-1d56346d8a05 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:38.044561 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb2c553-2b00-4134-93ba-3d2ed46c33b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:38.045685 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2c553-2b00-4134-93ba-3d2ed46c33b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:38.046136 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2c553-2b00-4134-93ba-3d2ed46c33b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:38.046583 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2c553-2b00-4134-93ba-3d2ed46c33b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:38.064552 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb2c553-2b00-4134-93ba-3d2ed46c33b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:38.066279 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb2c553-2b00-4134-93ba-3d2ed46c33b9 service neutron] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:38.079233 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1170/2344] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:35:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:35:38.531231 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb103f-9b96-49a2-86ed-aaf807aed49a None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:38.536477 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-caeb103f-9b96-49a2-86ed-aaf807aed49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:38.578103 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb103f-9b96-49a2-86ed-aaf807aed49a None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:38.586712 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed04832-6191-4016-a928-3d99d735ba14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:38.587807 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed04832-6191-4016-a928-3d99d735ba14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:38.588328 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed04832-6191-4016-a928-3d99d735ba14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:38.588809 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed04832-6191-4016-a928-3d99d735ba14 admin admin] PATH_INFO: `/v3/projects/faeef655b8894babbac95491d5698d5f` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:38.591309 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed04832-6191-4016-a928-3d99d735ba14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=faeef655b8894babbac95491d5698d5f)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:38.596365 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed04832-6191-4016-a928-3d99d735ba14 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:38.651672 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:38.677264 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-6ed04832-6191-4016-a928-3d99d735ba14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faeef655b8894babbac95491d5698d5f', 'request_id': 'req-6ed04832-6191-4016-a928-3d99d735ba14'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:38.689757 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-6ed04832-6191-4016-a928-3d99d735ba14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faeef655b8894babbac95491d5698d5f', 'request_id': 'req-6ed04832-6191-4016-a928-3d99d735ba14'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:38.702172 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-6ed04832-6191-4016-a928-3d99d735ba14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faeef655b8894babbac95491d5698d5f', 'request_id': 'req-6ed04832-6191-4016-a928-3d99d735ba14'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:38.730415 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-6ed04832-6191-4016-a928-3d99d735ba14 admin admin] The token cache is being invalidate because project faeef655b8894babbac95491d5698d5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:35:38.730736 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-6ed04832-6191-4016-a928-3d99d735ba14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:38.731282 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-6ed04832-6191-4016-a928-3d99d735ba14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:38.733118 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1175/2345] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:35:38 2022] DELETE /identity/v3/projects/faeef655b8894babbac95491d5698d5f => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:38.738181 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb2c553-2b00-4134-93ba-3d2ed46c33b9 service neutron] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:38.751836 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb2c553-2b00-4134-93ba-3d2ed46c33b9 service neutron] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:38.877325 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82bb7b0-6b8d-47a9-b1b7-370f377835d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:38.878263 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82bb7b0-6b8d-47a9-b1b7-370f377835d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:38.878728 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82bb7b0-6b8d-47a9-b1b7-370f377835d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:38.879251 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82bb7b0-6b8d-47a9-b1b7-370f377835d4 admin admin] PATH_INFO: `/v3/users/596013f2adcc47709bd824f56c4c9e31` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:38.880720 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82bb7b0-6b8d-47a9-b1b7-370f377835d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=596013f2adcc47709bd824f56c4c9e31)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:38.884590 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82bb7b0-6b8d-47a9-b1b7-370f377835d4 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:39.005555 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-d82bb7b0-6b8d-47a9-b1b7-370f377835d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '596013f2adcc47709bd824f56c4c9e31'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:39.007288 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-d82bb7b0-6b8d-47a9-b1b7-370f377835d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '596013f2adcc47709bd824f56c4c9e31'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:39.011567 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-d82bb7b0-6b8d-47a9-b1b7-370f377835d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '596013f2adcc47709bd824f56c4c9e31'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:39.032664 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-d82bb7b0-6b8d-47a9-b1b7-370f377835d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '596013f2adcc47709bd824f56c4c9e31'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:39.061120 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-d82bb7b0-6b8d-47a9-b1b7-370f377835d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '596013f2adcc47709bd824f56c4c9e31'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:39.082040 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1171/2346] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:35:38 2022] DELETE /identity/v3/users/596013f2adcc47709bd824f56c4c9e31 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:35:39.566896 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed04832-6191-4016-a928-3d99d735ba14 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:39.568862 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-6ed04832-6191-4016-a928-3d99d735ba14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:39.609867 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed04832-6191-4016-a928-3d99d735ba14 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:39.754571 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77478e5e-228a-4dcb-8305-b645aac7f594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:39.755230 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77478e5e-228a-4dcb-8305-b645aac7f594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:39.755713 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77478e5e-228a-4dcb-8305-b645aac7f594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:39.756085 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77478e5e-228a-4dcb-8305-b645aac7f594 admin admin] PATH_INFO: `/v3/projects/de0000a8b015460abcb14a18142fea2f` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:39.757361 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77478e5e-228a-4dcb-8305-b645aac7f594 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de0000a8b015460abcb14a18142fea2f)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:39.762673 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77478e5e-228a-4dcb-8305-b645aac7f594 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:39.854025 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-77478e5e-228a-4dcb-8305-b645aac7f594 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de0000a8b015460abcb14a18142fea2f', 'request_id': 'req-77478e5e-228a-4dcb-8305-b645aac7f594'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:39.867029 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-77478e5e-228a-4dcb-8305-b645aac7f594 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de0000a8b015460abcb14a18142fea2f', 'request_id': 'req-77478e5e-228a-4dcb-8305-b645aac7f594'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:39.878521 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-77478e5e-228a-4dcb-8305-b645aac7f594 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de0000a8b015460abcb14a18142fea2f', 'request_id': 'req-77478e5e-228a-4dcb-8305-b645aac7f594'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:39.909992 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-77478e5e-228a-4dcb-8305-b645aac7f594 admin admin] The token cache is being invalidate because project de0000a8b015460abcb14a18142fea2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:35:39.910466 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-77478e5e-228a-4dcb-8305-b645aac7f594 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:39.911847 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-77478e5e-228a-4dcb-8305-b645aac7f594 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:39.914876 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1176/2347] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:35:39 2022] DELETE /identity/v3/projects/de0000a8b015460abcb14a18142fea2f => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:35:39.923650 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291afe6-7edc-4461-a2d6-8cfe46114433 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:39.923650 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291afe6-7edc-4461-a2d6-8cfe46114433 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:39.923650 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291afe6-7edc-4461-a2d6-8cfe46114433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:39.954458 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-f291afe6-7edc-4461-a2d6-8cfe46114433 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:39.955876 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-f291afe6-7edc-4461-a2d6-8cfe46114433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:39.963118 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:40.083992 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1172/2348] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:35:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:40.096964 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4f930-3920-44ef-bdcb-8f4d4c7bc305 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:40.097554 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4f930-3920-44ef-bdcb-8f4d4c7bc305 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:40.098113 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4f930-3920-44ef-bdcb-8f4d4c7bc305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:40.143254 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-98b4f930-3920-44ef-bdcb-8f4d4c7bc305 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:40.147412 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-98b4f930-3920-44ef-bdcb-8f4d4c7bc305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:40.169299 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1177/2349] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:35:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:40.171204 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f291afe6-7edc-4461-a2d6-8cfe46114433 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:40.189990 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f291afe6-7edc-4461-a2d6-8cfe46114433 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:40.199640 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f923bcc-dc5c-4c99-97f7-2a24587002f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:40.200649 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f923bcc-dc5c-4c99-97f7-2a24587002f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:40.201139 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f923bcc-dc5c-4c99-97f7-2a24587002f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:40.201643 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f923bcc-dc5c-4c99-97f7-2a24587002f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:40.202510 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f923bcc-dc5c-4c99-97f7-2a24587002f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:35:40.203055 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f923bcc-dc5c-4c99-97f7-2a24587002f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:40.205291 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f923bcc-dc5c-4c99-97f7-2a24587002f0 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:40.231988 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1173/2350] 10.222.0.91 () {58 vars in 1153 bytes} [Tue Aug 30 04:35:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:35:40.234926 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b4f930-3920-44ef-bdcb-8f4d4c7bc305 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:40.252445 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b4f930-3920-44ef-bdcb-8f4d4c7bc305 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:40.264455 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742551b9-a941-48fd-a999-8036f69877b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:40.265530 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742551b9-a941-48fd-a999-8036f69877b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:40.266019 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742551b9-a941-48fd-a999-8036f69877b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:40.266531 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742551b9-a941-48fd-a999-8036f69877b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:40.267731 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742551b9-a941-48fd-a999-8036f69877b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:40.272034 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742551b9-a941-48fd-a999-8036f69877b3 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:40.323797 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1178/2351] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:35:40 2022] POST /identity/v3/projects => generated 377 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:35:40.325449 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f923bcc-dc5c-4c99-97f7-2a24587002f0 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:40.340042 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f923bcc-dc5c-4c99-97f7-2a24587002f0 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:40.422859 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9b0136-9b7f-4d4e-8099-4807abfe84c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:40.423544 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b0136-9b7f-4d4e-8099-4807abfe84c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:40.423979 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b0136-9b7f-4d4e-8099-4807abfe84c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:40.424319 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b0136-9b7f-4d4e-8099-4807abfe84c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:40.425071 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9b0136-9b7f-4d4e-8099-4807abfe84c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:40.427608 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9b0136-9b7f-4d4e-8099-4807abfe84c4 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:40.455374 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1174/2352] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:35:40 2022] POST /identity/v3/users => generated 289 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:35:40.461245 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742551b9-a941-48fd-a999-8036f69877b3 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:40.473441 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742551b9-a941-48fd-a999-8036f69877b3 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:40.479325 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835fb57c-9f1a-489a-b126-f819f117f176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:40.480397 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835fb57c-9f1a-489a-b126-f819f117f176 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:40.480817 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835fb57c-9f1a-489a-b126-f819f117f176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:40.481220 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835fb57c-9f1a-489a-b126-f819f117f176 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:40.482151 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835fb57c-9f1a-489a-b126-f819f117f176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:40.484155 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835fb57c-9f1a-489a-b126-f819f117f176 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:40.497546 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1179/2353] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:35:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:35:40.501924 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9b0136-9b7f-4d4e-8099-4807abfe84c4 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:40.513776 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9b0136-9b7f-4d4e-8099-4807abfe84c4 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:40.519507 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f53d9ca-52cd-42a0-9678-e99c3aca1f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:40.520132 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53d9ca-52cd-42a0-9678-e99c3aca1f76 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:40.520520 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53d9ca-52cd-42a0-9678-e99c3aca1f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:40.520937 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53d9ca-52cd-42a0-9678-e99c3aca1f76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:40.521765 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f53d9ca-52cd-42a0-9678-e99c3aca1f76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:40.523587 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f53d9ca-52cd-42a0-9678-e99c3aca1f76 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:40.537260 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1175/2354] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:35:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:35:40.545327 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835fb57c-9f1a-489a-b126-f819f117f176 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:40.565249 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835fb57c-9f1a-489a-b126-f819f117f176 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:40.575012 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee9293b-eb71-4477-a18e-629105541886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:40.576194 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee9293b-eb71-4477-a18e-629105541886 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:40.576685 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee9293b-eb71-4477-a18e-629105541886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:40.577190 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee9293b-eb71-4477-a18e-629105541886 admin admin] PATH_INFO: `/v3/projects/a27627846c7a4201abb95eae257e8335/users/97912603695c41d988fded00bd15d2be/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:40.584346 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:40.603922 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee9293b-eb71-4477-a18e-629105541886 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a27627846c7a4201abb95eae257e8335, user_id=97912603695c41d988fded00bd15d2be, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:40.608159 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee9293b-eb71-4477-a18e-629105541886 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:40.629553 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1180/2355] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:35:40 2022] PUT /identity/v3/projects/a27627846c7a4201abb95eae257e8335/users/97912603695c41d988fded00bd15d2be/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:40.653806 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af5992-46d3-4572-8e89-93467cea1849 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:40.654258 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af5992-46d3-4572-8e89-93467cea1849 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:40.654541 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af5992-46d3-4572-8e89-93467cea1849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:40.691036 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-a3af5992-46d3-4572-8e89-93467cea1849 None None] MFA Rules not processed for user `97912603695c41d988fded00bd15d2be`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:40.692335 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-a3af5992-46d3-4572-8e89-93467cea1849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:40.777780 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1176/2356] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:35:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:40.782885 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee9293b-eb71-4477-a18e-629105541886 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:40.880036 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee9293b-eb71-4477-a18e-629105541886 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:40.891838 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00c5a1-ae53-45aa-92f8-0db4a159d126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:40.892931 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00c5a1-ae53-45aa-92f8-0db4a159d126 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:40.893475 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00c5a1-ae53-45aa-92f8-0db4a159d126 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:40.893955 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00c5a1-ae53-45aa-92f8-0db4a159d126 admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:40.895375 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff00c5a1-ae53-45aa-92f8-0db4a159d126 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:40.900439 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff00c5a1-ae53-45aa-92f8-0db4a159d126 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:40.947510 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1181/2357] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:35:40 2022] POST /identity/v3/projects => generated 375 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:35:40.952839 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af5992-46d3-4572-8e89-93467cea1849 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:40.972976 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af5992-46d3-4572-8e89-93467cea1849 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:40.980661 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:41.062657 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ac96b2-3f1d-4368-9977-2a4b34d2c351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:41.063195 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac96b2-3f1d-4368-9977-2a4b34d2c351 admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:41.063473 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac96b2-3f1d-4368-9977-2a4b34d2c351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:41.063736 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac96b2-3f1d-4368-9977-2a4b34d2c351 admin admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:41.064499 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ac96b2-3f1d-4368-9977-2a4b34d2c351 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:41.066866 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ac96b2-3f1d-4368-9977-2a4b34d2c351 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:41.095925 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1177/2358] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:35:40 2022] POST /identity/v3/users => generated 294 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:35:41.100616 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00c5a1-ae53-45aa-92f8-0db4a159d126 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:41.112628 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00c5a1-ae53-45aa-92f8-0db4a159d126 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:41.120474 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405da366-60a4-4017-8057-54f596972990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:41.121273 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405da366-60a4-4017-8057-54f596972990 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:41.121681 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405da366-60a4-4017-8057-54f596972990 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:41.122075 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405da366-60a4-4017-8057-54f596972990 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:41.122875 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405da366-60a4-4017-8057-54f596972990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:41.125097 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405da366-60a4-4017-8057-54f596972990 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:41.142537 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1182/2359] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:35:41 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:35:41.148852 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ac96b2-3f1d-4368-9977-2a4b34d2c351 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:41.170546 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ac96b2-3f1d-4368-9977-2a4b34d2c351 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:41.182108 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb7e6e1-f51b-4c81-b96c-7452de147480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:41.183384 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb7e6e1-f51b-4c81-b96c-7452de147480 admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:41.183958 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb7e6e1-f51b-4c81-b96c-7452de147480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:41.184564 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb7e6e1-f51b-4c81-b96c-7452de147480 admin admin] PATH_INFO: `/v3/projects/30c9e5e4d92142e191f26691dfe9d70f/users/6fe5d622a5be4fe3952214cd31ee2013/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:41.206245 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb7e6e1-f51b-4c81-b96c-7452de147480 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30c9e5e4d92142e191f26691dfe9d70f, user_id=6fe5d622a5be4fe3952214cd31ee2013, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:41.209285 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb7e6e1-f51b-4c81-b96c-7452de147480 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:41.237908 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1178/2360] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:35:41 2022] PUT /identity/v3/projects/30c9e5e4d92142e191f26691dfe9d70f/users/6fe5d622a5be4fe3952214cd31ee2013/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:41.244400 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405da366-60a4-4017-8057-54f596972990 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:41.257299 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405da366-60a4-4017-8057-54f596972990 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:41.328928 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ecc08-6942-4922-9f8b-bb41fc3e8848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:41.329460 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ecc08-6942-4922-9f8b-bb41fc3e8848 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:41.329750 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ecc08-6942-4922-9f8b-bb41fc3e8848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:41.330058 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ecc08-6942-4922-9f8b-bb41fc3e8848 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:41.330733 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588ecc08-6942-4922-9f8b-bb41fc3e8848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:41.332441 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588ecc08-6942-4922-9f8b-bb41fc3e8848 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:41.345416 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1183/2361] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:35:41 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:35:41.349745 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb7e6e1-f51b-4c81-b96c-7452de147480 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:41.362875 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb7e6e1-f51b-4c81-b96c-7452de147480 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:41.369201 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0479fb-59ce-4262-a1cb-2d6fa82e524a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:41.370043 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0479fb-59ce-4262-a1cb-2d6fa82e524a admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:41.370375 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0479fb-59ce-4262-a1cb-2d6fa82e524a admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:41.370819 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0479fb-59ce-4262-a1cb-2d6fa82e524a admin admin] PATH_INFO: `/v3/projects/30c9e5e4d92142e191f26691dfe9d70f/users/6fe5d622a5be4fe3952214cd31ee2013/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:41.373402 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0479fb-59ce-4262-a1cb-2d6fa82e524a admin admin] RBAC: Authorizing `identity:create_grant(project_id=30c9e5e4d92142e191f26691dfe9d70f, user_id=6fe5d622a5be4fe3952214cd31ee2013, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:41.376543 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0479fb-59ce-4262-a1cb-2d6fa82e524a admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:41.391834 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1179/2362] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:35:41 2022] PUT /identity/v3/projects/30c9e5e4d92142e191f26691dfe9d70f/users/6fe5d622a5be4fe3952214cd31ee2013/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:41.410689 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c73a5-5396-4287-9f74-7ae29eaae8c7 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:41.411141 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c73a5-5396-4287-9f74-7ae29eaae8c7 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:41.411680 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c73a5-5396-4287-9f74-7ae29eaae8c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:41.471213 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-3e8c73a5-5396-4287-9f74-7ae29eaae8c7 None None] MFA Rules not processed for user `6fe5d622a5be4fe3952214cd31ee2013`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:41.472616 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-3e8c73a5-5396-4287-9f74-7ae29eaae8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:41.532255 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:41.565714 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1184/2363] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:35:41 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:41.578185 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0479fb-59ce-4262-a1cb-2d6fa82e524a admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:41.580519 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-4e0479fb-59ce-4262-a1cb-2d6fa82e524a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:41.672689 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0479fb-59ce-4262-a1cb-2d6fa82e524a admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:41.677992 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db5a751-bfcf-416a-b166-4031ec701fd9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:41.678804 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5a751-bfcf-416a-b166-4031ec701fd9 service cinder] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:41.679088 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5a751-bfcf-416a-b166-4031ec701fd9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:41.679374 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5a751-bfcf-416a-b166-4031ec701fd9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:41.758480 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db5a751-bfcf-416a-b166-4031ec701fd9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:41.761028 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db5a751-bfcf-416a-b166-4031ec701fd9 service cinder] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:41.778088 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1180/2364] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:35:41 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:35:44.769609 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c73a5-5396-4287-9f74-7ae29eaae8c7 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:44.785342 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c73a5-5396-4287-9f74-7ae29eaae8c7 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:44.792667 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0802423d-bfca-42b0-bbb3-2dc1f13a11e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:44.793351 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802423d-bfca-42b0-bbb3-2dc1f13a11e1 service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:44.793646 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802423d-bfca-42b0-bbb3-2dc1f13a11e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:44.793909 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802423d-bfca-42b0-bbb3-2dc1f13a11e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:44.809387 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0802423d-bfca-42b0-bbb3-2dc1f13a11e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:44.819640 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0802423d-bfca-42b0-bbb3-2dc1f13a11e1 service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:44.840321 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1185/2365] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:35:44 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:35:49.032753 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db5a751-bfcf-416a-b166-4031ec701fd9 service cinder] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:49.036342 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-5db5a751-bfcf-416a-b166-4031ec701fd9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:49.064023 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:49.176875 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db5a751-bfcf-416a-b166-4031ec701fd9 service cinder] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:49.190724 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd491c30-cb18-438a-91ec-d4e7814eb65d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd806295278ae4997b5c6968aa553290c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:49.191816 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd491c30-cb18-438a-91ec-d4e7814eb65d service nova] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:49.192350 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd491c30-cb18-438a-91ec-d4e7814eb65d service nova] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:49.192914 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd491c30-cb18-438a-91ec-d4e7814eb65d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:49.205176 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-dd491c30-cb18-438a-91ec-d4e7814eb65d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:49.236827 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd491c30-cb18-438a-91ec-d4e7814eb65d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:49.240216 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd491c30-cb18-438a-91ec-d4e7814eb65d service nova] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:49.274771 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1181/2366] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:35:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:35:51.015360 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0802423d-bfca-42b0-bbb3-2dc1f13a11e1 service cinder] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:51.016907 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-0802423d-bfca-42b0-bbb3-2dc1f13a11e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:51.080108 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0802423d-bfca-42b0-bbb3-2dc1f13a11e1 service cinder] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:51.084229 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7c116c-d160-45fb-bbef-52ab54a749b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:51.084912 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c116c-d160-45fb-bbef-52ab54a749b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:51.085197 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c116c-d160-45fb-bbef-52ab54a749b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:51.085478 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c116c-d160-45fb-bbef-52ab54a749b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:51.087483 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-bc7c116c-d160-45fb-bbef-52ab54a749b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:51.161152 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7c116c-d160-45fb-bbef-52ab54a749b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:51.163023 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7c116c-d160-45fb-bbef-52ab54a749b1 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:51.174544 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1186/2367] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:35:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:35:57.114565 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd491c30-cb18-438a-91ec-d4e7814eb65d service nova] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:57.117207 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-dd491c30-cb18-438a-91ec-d4e7814eb65d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:57.142409 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd491c30-cb18-438a-91ec-d4e7814eb65d service nova] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:57.150070 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcc15d1-bb67-401c-84e6-815f7c399bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:57.151498 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc15d1-bb67-401c-84e6-815f7c399bc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:57.151672 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc15d1-bb67-401c-84e6-815f7c399bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:57.152081 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc15d1-bb67-401c-84e6-815f7c399bc6 admin admin] PATH_INFO: `/v3/users/9a872454622d41ce9462890af418182d` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:57.154236 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcc15d1-bb67-401c-84e6-815f7c399bc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a872454622d41ce9462890af418182d)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:57.156989 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcc15d1-bb67-401c-84e6-815f7c399bc6 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:57.254054 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-9bcc15d1-bb67-401c-84e6-815f7c399bc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a872454622d41ce9462890af418182d'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:57.254817 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-9bcc15d1-bb67-401c-84e6-815f7c399bc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a872454622d41ce9462890af418182d'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:57.255707 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-9bcc15d1-bb67-401c-84e6-815f7c399bc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a872454622d41ce9462890af418182d'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:57.266397 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-9bcc15d1-bb67-401c-84e6-815f7c399bc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a872454622d41ce9462890af418182d'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:57.284717 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-9bcc15d1-bb67-401c-84e6-815f7c399bc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a872454622d41ce9462890af418182d'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:57.300873 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1182/2368] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:35:57 2022] DELETE /identity/v3/users/9a872454622d41ce9462890af418182d => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:35:57.530190 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7c116c-d160-45fb-bbef-52ab54a749b1 service neutron] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:57.549255 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7c116c-d160-45fb-bbef-52ab54a749b1 service neutron] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:57.683427 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ea74f-c161-4a5e-9a80-7258830dc3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:57.685139 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ea74f-c161-4a5e-9a80-7258830dc3fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:57.685885 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ea74f-c161-4a5e-9a80-7258830dc3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:57.686377 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ea74f-c161-4a5e-9a80-7258830dc3fc admin admin] PATH_INFO: `/v3/projects/1638b6f183134b83b87ce6f2eb995d7a` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:57.688715 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496ea74f-c161-4a5e-9a80-7258830dc3fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1638b6f183134b83b87ce6f2eb995d7a)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:57.692622 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496ea74f-c161-4a5e-9a80-7258830dc3fc admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:57.729043 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:57.773091 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-496ea74f-c161-4a5e-9a80-7258830dc3fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1638b6f183134b83b87ce6f2eb995d7a', 'request_id': 'req-496ea74f-c161-4a5e-9a80-7258830dc3fc'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:57.782527 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-496ea74f-c161-4a5e-9a80-7258830dc3fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1638b6f183134b83b87ce6f2eb995d7a', 'request_id': 'req-496ea74f-c161-4a5e-9a80-7258830dc3fc'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:57.799291 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-496ea74f-c161-4a5e-9a80-7258830dc3fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1638b6f183134b83b87ce6f2eb995d7a', 'request_id': 'req-496ea74f-c161-4a5e-9a80-7258830dc3fc'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:57.823264 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-496ea74f-c161-4a5e-9a80-7258830dc3fc admin admin] The token cache is being invalidate because project 1638b6f183134b83b87ce6f2eb995d7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:35:57.823764 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-496ea74f-c161-4a5e-9a80-7258830dc3fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:57.824948 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-496ea74f-c161-4a5e-9a80-7258830dc3fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:57.828673 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1187/2369] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:35:57 2022] DELETE /identity/v3/projects/1638b6f183134b83b87ce6f2eb995d7a => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:57.835128 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ef283-d8e1-4d27-a82a-73a663c99156 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:57.835498 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ef283-d8e1-4d27-a82a-73a663c99156 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:57.836423 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ef283-d8e1-4d27-a82a-73a663c99156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:57.876938 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-e69ef283-d8e1-4d27-a82a-73a663c99156 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:57.879861 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-e69ef283-d8e1-4d27-a82a-73a663c99156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:57.963695 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1183/2370] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:35:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:35:57.972183 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed346a9-9274-49f3-b9c7-8176daf1adc8 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:57.972463 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed346a9-9274-49f3-b9c7-8176daf1adc8 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:57.972728 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed346a9-9274-49f3-b9c7-8176daf1adc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:57.994889 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-5ed346a9-9274-49f3-b9c7-8176daf1adc8 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:57.996199 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-5ed346a9-9274-49f3-b9c7-8176daf1adc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:58.004674 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1188/2371] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:35:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:58.009652 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69ef283-d8e1-4d27-a82a-73a663c99156 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:58.023644 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69ef283-d8e1-4d27-a82a-73a663c99156 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:58.028850 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5f0b5-5822-44dd-8b70-4d108354f47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:58.029547 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5f0b5-5822-44dd-8b70-4d108354f47e admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:58.029865 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5f0b5-5822-44dd-8b70-4d108354f47e admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:58.030180 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5f0b5-5822-44dd-8b70-4d108354f47e admin admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:58.030911 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a5f0b5-5822-44dd-8b70-4d108354f47e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:35:58.031259 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a5f0b5-5822-44dd-8b70-4d108354f47e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:58.033388 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a5f0b5-5822-44dd-8b70-4d108354f47e admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:58.042019 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:58.049092 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1184/2372] 10.222.0.91 () {58 vars in 1153 bytes} [Tue Aug 30 04:35:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:35:58.054120 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed346a9-9274-49f3-b9c7-8176daf1adc8 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:58.066117 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed346a9-9274-49f3-b9c7-8176daf1adc8 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:58.071466 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d1f57-574c-4781-aec5-56e4fed780a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:58.072108 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d1f57-574c-4781-aec5-56e4fed780a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:58.072382 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d1f57-574c-4781-aec5-56e4fed780a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:58.072699 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d1f57-574c-4781-aec5-56e4fed780a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:58.073356 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8d1f57-574c-4781-aec5-56e4fed780a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:58.075347 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8d1f57-574c-4781-aec5-56e4fed780a0 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:58.109202 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1189/2373] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:35:58 2022] POST /identity/v3/projects => generated 363 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:35:58.113834 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5f0b5-5822-44dd-8b70-4d108354f47e admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:58.125698 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5f0b5-5822-44dd-8b70-4d108354f47e admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:58.210891 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa15e08-d197-41d2-a60e-08de87b0021f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:58.211523 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa15e08-d197-41d2-a60e-08de87b0021f admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:58.211799 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa15e08-d197-41d2-a60e-08de87b0021f admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:58.212112 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa15e08-d197-41d2-a60e-08de87b0021f admin admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:58.212766 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa15e08-d197-41d2-a60e-08de87b0021f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:58.215087 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa15e08-d197-41d2-a60e-08de87b0021f admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:58.249712 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1185/2374] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:35:58 2022] POST /identity/v3/users => generated 282 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:35:58.252090 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d1f57-574c-4781-aec5-56e4fed780a0 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:58.270448 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d1f57-574c-4781-aec5-56e4fed780a0 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:58.279558 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a66b43-6744-434e-affc-22c8dacb48eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:58.280596 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a66b43-6744-434e-affc-22c8dacb48eb admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:58.283424 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a66b43-6744-434e-affc-22c8dacb48eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:58.283424 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a66b43-6744-434e-affc-22c8dacb48eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:58.283424 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a66b43-6744-434e-affc-22c8dacb48eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:58.286145 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a66b43-6744-434e-affc-22c8dacb48eb admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:58.307434 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1190/2375] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:35:58 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:35:58.312576 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa15e08-d197-41d2-a60e-08de87b0021f admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:58.330767 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa15e08-d197-41d2-a60e-08de87b0021f admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:58.338613 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db760f2-2f42-4c6b-8308-bfdb9cff8255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:58.339664 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db760f2-2f42-4c6b-8308-bfdb9cff8255 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:58.340192 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db760f2-2f42-4c6b-8308-bfdb9cff8255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:58.340677 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db760f2-2f42-4c6b-8308-bfdb9cff8255 admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:58.341889 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db760f2-2f42-4c6b-8308-bfdb9cff8255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:58.345084 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db760f2-2f42-4c6b-8308-bfdb9cff8255 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:58.368143 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1186/2376] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:35:58 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:35:58.373878 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a66b43-6744-434e-affc-22c8dacb48eb admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:58.386201 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a66b43-6744-434e-affc-22c8dacb48eb admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:58.392755 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc79ea46-bd21-4489-a2f4-a2262f8f4f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:58.394122 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79ea46-bd21-4489-a2f4-a2262f8f4f21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:58.395155 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79ea46-bd21-4489-a2f4-a2262f8f4f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:58.395543 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79ea46-bd21-4489-a2f4-a2262f8f4f21 admin admin] PATH_INFO: `/v3/projects/50955590fe40487bb001229b3da49e64/users/197713bcd3e048d4ade79f2099331573/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:58.415897 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc79ea46-bd21-4489-a2f4-a2262f8f4f21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50955590fe40487bb001229b3da49e64, user_id=197713bcd3e048d4ade79f2099331573, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:58.418713 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc79ea46-bd21-4489-a2f4-a2262f8f4f21 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:58.440706 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1191/2377] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:35:58 2022] PUT /identity/v3/projects/50955590fe40487bb001229b3da49e64/users/197713bcd3e048d4ade79f2099331573/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:35:58.457178 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386867a1-e141-4f30-8dd4-435a5b4a9f8f None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:58.458067 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386867a1-e141-4f30-8dd4-435a5b4a9f8f None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:58.458067 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386867a1-e141-4f30-8dd4-435a5b4a9f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:58.501781 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-386867a1-e141-4f30-8dd4-435a5b4a9f8f None None] MFA Rules not processed for user `197713bcd3e048d4ade79f2099331573`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:58.503078 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-386867a1-e141-4f30-8dd4-435a5b4a9f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:58.611984 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1187/2378] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:35:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:58.615905 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc79ea46-bd21-4489-a2f4-a2262f8f4f21 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:58.687162 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc79ea46-bd21-4489-a2f4-a2262f8f4f21 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:58.692265 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d96c8a9-be48-4129-9170-610b799980fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:58.693348 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96c8a9-be48-4129-9170-610b799980fe admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:58.693647 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96c8a9-be48-4129-9170-610b799980fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:58.694030 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96c8a9-be48-4129-9170-610b799980fe admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:58.694564 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d96c8a9-be48-4129-9170-610b799980fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:58.696606 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d96c8a9-be48-4129-9170-610b799980fe admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:58.730099 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1192/2379] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:35:58 2022] POST /identity/v3/projects => generated 365 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:35:58.735217 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386867a1-e141-4f30-8dd4-435a5b4a9f8f None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:58.748083 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386867a1-e141-4f30-8dd4-435a5b4a9f8f None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:58.837016 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a35bfd8-2b09-47c0-b580-5b41fd7fe114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:58.838066 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a35bfd8-2b09-47c0-b580-5b41fd7fe114 admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:58.838561 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a35bfd8-2b09-47c0-b580-5b41fd7fe114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:58.839043 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a35bfd8-2b09-47c0-b580-5b41fd7fe114 admin admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:58.840320 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a35bfd8-2b09-47c0-b580-5b41fd7fe114 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:58.845584 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a35bfd8-2b09-47c0-b580-5b41fd7fe114 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:58.885161 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:58.903711 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1188/2380] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:35:58 2022] POST /identity/v3/users => generated 289 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:35:58.910924 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d96c8a9-be48-4129-9170-610b799980fe admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:58.935514 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d96c8a9-be48-4129-9170-610b799980fe admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:58.948781 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19acc0-f74f-4d07-a0e5-e51281710073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:58.949794 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19acc0-f74f-4d07-a0e5-e51281710073 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:58.950259 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19acc0-f74f-4d07-a0e5-e51281710073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:58.950945 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19acc0-f74f-4d07-a0e5-e51281710073 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:58.952465 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f19acc0-f74f-4d07-a0e5-e51281710073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:58.954924 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f19acc0-f74f-4d07-a0e5-e51281710073 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:58.986707 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1193/2381] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:35:58 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:35:58.993940 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a35bfd8-2b09-47c0-b580-5b41fd7fe114 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:59.014182 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a35bfd8-2b09-47c0-b580-5b41fd7fe114 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:59.019880 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff97859-3d5b-4ae6-8751-81753ecef3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:59.021180 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff97859-3d5b-4ae6-8751-81753ecef3e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:59.021625 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff97859-3d5b-4ae6-8751-81753ecef3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:59.022037 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff97859-3d5b-4ae6-8751-81753ecef3e2 admin admin] PATH_INFO: `/v3/projects/c8916dddc2354d969f1aae293b75691b/users/f965ad27fe004d22828eddd36086fef5/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:59.060985 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff97859-3d5b-4ae6-8751-81753ecef3e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8916dddc2354d969f1aae293b75691b, user_id=f965ad27fe004d22828eddd36086fef5, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:59.067035 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff97859-3d5b-4ae6-8751-81753ecef3e2 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:59.094128 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1189/2382] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:35:58 2022] PUT /identity/v3/projects/c8916dddc2354d969f1aae293b75691b/users/f965ad27fe004d22828eddd36086fef5/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:35:59.099805 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19acc0-f74f-4d07-a0e5-e51281710073 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:59.119540 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19acc0-f74f-4d07-a0e5-e51281710073 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:59.152758 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:59.239249 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c32c8-ca1a-484c-b35a-13f0f6dbf20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:59.239796 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c32c8-ca1a-484c-b35a-13f0f6dbf20a admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:59.240247 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c32c8-ca1a-484c-b35a-13f0f6dbf20a admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:59.241280 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c32c8-ca1a-484c-b35a-13f0f6dbf20a admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:59.241562 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c32c8-ca1a-484c-b35a-13f0f6dbf20a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:59.243838 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c32c8-ca1a-484c-b35a-13f0f6dbf20a admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:59.258137 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1194/2383] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:35:59 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:35:59.263641 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff97859-3d5b-4ae6-8751-81753ecef3e2 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:59.283189 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff97859-3d5b-4ae6-8751-81753ecef3e2 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:59.296845 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3622bc-8f8f-40af-b6bb-2817e6aacfd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:59.299129 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3622bc-8f8f-40af-b6bb-2817e6aacfd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:59.305559 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3622bc-8f8f-40af-b6bb-2817e6aacfd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:59.305559 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3622bc-8f8f-40af-b6bb-2817e6aacfd3 admin admin] PATH_INFO: `/v3/projects/c8916dddc2354d969f1aae293b75691b/users/f965ad27fe004d22828eddd36086fef5/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:59.310015 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3622bc-8f8f-40af-b6bb-2817e6aacfd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8916dddc2354d969f1aae293b75691b, user_id=f965ad27fe004d22828eddd36086fef5, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:59.317081 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3622bc-8f8f-40af-b6bb-2817e6aacfd3 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:59.370778 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1190/2384] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:35:59 2022] PUT /identity/v3/projects/c8916dddc2354d969f1aae293b75691b/users/f965ad27fe004d22828eddd36086fef5/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:59.379492 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb90ca-4a31-4e2f-9953-9612d2261c7b None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:59.380178 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb90ca-4a31-4e2f-9953-9612d2261c7b None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:59.380856 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb90ca-4a31-4e2f-9953-9612d2261c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:59.400043 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3622bc-8f8f-40af-b6bb-2817e6aacfd3 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:59.403291 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-6d3622bc-8f8f-40af-b6bb-2817e6aacfd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:59.431493 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-ddeb90ca-4a31-4e2f-9953-9612d2261c7b None None] MFA Rules not processed for user `f965ad27fe004d22828eddd36086fef5`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:59.433296 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-ddeb90ca-4a31-4e2f-9953-9612d2261c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:59.553698 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1195/2385] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:35:59 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:59.575312 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb90ca-4a31-4e2f-9953-9612d2261c7b None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:59.579981 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-ddeb90ca-4a31-4e2f-9953-9612d2261c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:59.607828 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3622bc-8f8f-40af-b6bb-2817e6aacfd3 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:59.619850 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7937bafb-9cad-45c6-962f-55e71e9626b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:59.620910 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937bafb-9cad-45c6-962f-55e71e9626b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:59.621844 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937bafb-9cad-45c6-962f-55e71e9626b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:59.621970 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937bafb-9cad-45c6-962f-55e71e9626b8 admin admin] PATH_INFO: `/v3/users/97912603695c41d988fded00bd15d2be` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:59.624312 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7937bafb-9cad-45c6-962f-55e71e9626b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97912603695c41d988fded00bd15d2be)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:59.626333 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7937bafb-9cad-45c6-962f-55e71e9626b8 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:59.681270 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb90ca-4a31-4e2f-9953-9612d2261c7b None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:59.686797 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c8563d-5732-4c1f-a8c3-91356b77ab58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:59.687454 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c8563d-5732-4c1f-a8c3-91356b77ab58 service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:59.687888 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c8563d-5732-4c1f-a8c3-91356b77ab58 service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:59.692136 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c8563d-5732-4c1f-a8c3-91356b77ab58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:59.713562 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c8563d-5732-4c1f-a8c3-91356b77ab58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:59.716161 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-7937bafb-9cad-45c6-962f-55e71e9626b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97912603695c41d988fded00bd15d2be'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:59.716322 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c8563d-5732-4c1f-a8c3-91356b77ab58 service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:59.717247 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-7937bafb-9cad-45c6-962f-55e71e9626b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97912603695c41d988fded00bd15d2be'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:59.718143 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-7937bafb-9cad-45c6-962f-55e71e9626b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97912603695c41d988fded00bd15d2be'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:59.733443 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-7937bafb-9cad-45c6-962f-55e71e9626b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97912603695c41d988fded00bd15d2be'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:59.743129 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1196/2386] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:35:59 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:35:59.756897 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-7937bafb-9cad-45c6-962f-55e71e9626b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97912603695c41d988fded00bd15d2be'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:59.787321 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1191/2387] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:35:59 2022] DELETE /identity/v3/users/97912603695c41d988fded00bd15d2be => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:35:59.802654 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3644da60-5bea-4357-9303-6f3429e01c16 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:59.803551 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3644da60-5bea-4357-9303-6f3429e01c16 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:59.804138 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3644da60-5bea-4357-9303-6f3429e01c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:59.846315 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-3644da60-5bea-4357-9303-6f3429e01c16 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:59.849717 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-3644da60-5bea-4357-9303-6f3429e01c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:59.886684 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7937bafb-9cad-45c6-962f-55e71e9626b8 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:59.892936 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-7937bafb-9cad-45c6-962f-55e71e9626b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:59.935448 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:59.973541 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1197/2388] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:35:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:59.978334 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:59.990489 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3644da60-5bea-4357-9303-6f3429e01c16 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:59.993151 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-3644da60-5bea-4357-9303-6f3429e01c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:00.003582 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7937bafb-9cad-45c6-962f-55e71e9626b8 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:00.009958 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c390e087-c9f5-4454-ba3b-45bf769ea468 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:00.011088 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390e087-c9f5-4454-ba3b-45bf769ea468 service cinder] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:00.011515 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390e087-c9f5-4454-ba3b-45bf769ea468 service cinder] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:00.011985 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390e087-c9f5-4454-ba3b-45bf769ea468 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:00.014196 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-c390e087-c9f5-4454-ba3b-45bf769ea468 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:00.069454 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3644da60-5bea-4357-9303-6f3429e01c16 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:00.073959 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22cac82-e1d7-4d2e-b273-f9ce170ac0e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:00.074599 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22cac82-e1d7-4d2e-b273-f9ce170ac0e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:00.074942 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22cac82-e1d7-4d2e-b273-f9ce170ac0e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:00.075287 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22cac82-e1d7-4d2e-b273-f9ce170ac0e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:00.089109 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22cac82-e1d7-4d2e-b273-f9ce170ac0e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:00.090830 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22cac82-e1d7-4d2e-b273-f9ce170ac0e8 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:00.107172 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1198/2389] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:35:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:36:00.109899 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c390e087-c9f5-4454-ba3b-45bf769ea468 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:00.111577 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c390e087-c9f5-4454-ba3b-45bf769ea468 service cinder] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:00.123684 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1192/2390] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:35:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:36:00.684494 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22cac82-e1d7-4d2e-b273-f9ce170ac0e8 service neutron] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:00.690020 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-a22cac82-e1d7-4d2e-b273-f9ce170ac0e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:00.746147 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22cac82-e1d7-4d2e-b273-f9ce170ac0e8 service neutron] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:00.754846 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a6067a-4f38-48c9-96a4-92916078c80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:00.755411 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6067a-4f38-48c9-96a4-92916078c80e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:00.756161 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6067a-4f38-48c9-96a4-92916078c80e admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:00.756865 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6067a-4f38-48c9-96a4-92916078c80e admin admin] PATH_INFO: `/v3/projects/a27627846c7a4201abb95eae257e8335` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:00.758901 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a6067a-4f38-48c9-96a4-92916078c80e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a27627846c7a4201abb95eae257e8335)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:00.761179 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a6067a-4f38-48c9-96a4-92916078c80e admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:00.854797 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-70a6067a-4f38-48c9-96a4-92916078c80e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a27627846c7a4201abb95eae257e8335', 'request_id': 'req-70a6067a-4f38-48c9-96a4-92916078c80e'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:00.869637 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-70a6067a-4f38-48c9-96a4-92916078c80e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a27627846c7a4201abb95eae257e8335', 'request_id': 'req-70a6067a-4f38-48c9-96a4-92916078c80e'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:00.880689 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-70a6067a-4f38-48c9-96a4-92916078c80e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a27627846c7a4201abb95eae257e8335', 'request_id': 'req-70a6067a-4f38-48c9-96a4-92916078c80e'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:00.904018 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-70a6067a-4f38-48c9-96a4-92916078c80e admin admin] The token cache is being invalidate because project a27627846c7a4201abb95eae257e8335 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:36:00.904474 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-70a6067a-4f38-48c9-96a4-92916078c80e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:00.905668 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-70a6067a-4f38-48c9-96a4-92916078c80e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:00.908498 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1199/2391] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:36:00 2022] DELETE /identity/v3/projects/a27627846c7a4201abb95eae257e8335 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:36:00.914876 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c390e087-c9f5-4454-ba3b-45bf769ea468 service cinder] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:00.933612 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c390e087-c9f5-4454-ba3b-45bf769ea468 service cinder] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:01.026492 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c518f9-7810-42e3-a157-51a07d41131d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:01.027259 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c518f9-7810-42e3-a157-51a07d41131d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:01.027711 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c518f9-7810-42e3-a157-51a07d41131d admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:01.028137 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c518f9-7810-42e3-a157-51a07d41131d admin admin] PATH_INFO: `/v3/users/6fe5d622a5be4fe3952214cd31ee2013` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:01.029688 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c518f9-7810-42e3-a157-51a07d41131d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fe5d622a5be4fe3952214cd31ee2013)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:01.031942 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c518f9-7810-42e3-a157-51a07d41131d admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:01.108343 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-41c518f9-7810-42e3-a157-51a07d41131d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fe5d622a5be4fe3952214cd31ee2013'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:01.109224 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-41c518f9-7810-42e3-a157-51a07d41131d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fe5d622a5be4fe3952214cd31ee2013'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:01.109884 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-41c518f9-7810-42e3-a157-51a07d41131d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fe5d622a5be4fe3952214cd31ee2013'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:01.124666 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-41c518f9-7810-42e3-a157-51a07d41131d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fe5d622a5be4fe3952214cd31ee2013'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:01.156981 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-41c518f9-7810-42e3-a157-51a07d41131d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fe5d622a5be4fe3952214cd31ee2013'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:01.195113 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1193/2392] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:36:00 2022] DELETE /identity/v3/users/6fe5d622a5be4fe3952214cd31ee2013 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:36:02.090550 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a6067a-4f38-48c9-96a4-92916078c80e admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:02.094236 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-70a6067a-4f38-48c9-96a4-92916078c80e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:02.140075 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a6067a-4f38-48c9-96a4-92916078c80e admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:02.376086 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f531c1b-c51a-48b7-94b0-98c8f2d8ccc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:02.383806 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f531c1b-c51a-48b7-94b0-98c8f2d8ccc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:02.386419 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f531c1b-c51a-48b7-94b0-98c8f2d8ccc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:02.389538 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f531c1b-c51a-48b7-94b0-98c8f2d8ccc0 admin admin] PATH_INFO: `/v3/projects/30c9e5e4d92142e191f26691dfe9d70f` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:02.395505 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7d50e-0610-4004-b7da-213291a575ea None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:02.396919 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f531c1b-c51a-48b7-94b0-98c8f2d8ccc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30c9e5e4d92142e191f26691dfe9d70f)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:02.397105 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7d50e-0610-4004-b7da-213291a575ea None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:02.397105 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7d50e-0610-4004-b7da-213291a575ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:02.403388 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f531c1b-c51a-48b7-94b0-98c8f2d8ccc0 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:02.430859 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-d0b7d50e-0610-4004-b7da-213291a575ea None None] MFA Rules not processed for user `1bc12faf48984335a3515dcde85b5cb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:36:02.432915 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-d0b7d50e-0610-4004-b7da-213291a575ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:02.443628 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:02.445378 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:02.550502 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-8f531c1b-c51a-48b7-94b0-98c8f2d8ccc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30c9e5e4d92142e191f26691dfe9d70f', 'request_id': 'req-8f531c1b-c51a-48b7-94b0-98c8f2d8ccc0'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:02.568754 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-8f531c1b-c51a-48b7-94b0-98c8f2d8ccc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30c9e5e4d92142e191f26691dfe9d70f', 'request_id': 'req-8f531c1b-c51a-48b7-94b0-98c8f2d8ccc0'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:02.578563 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1194/2393] 10.222.0.91 () {58 vars in 1009 bytes} [Tue Aug 30 04:36:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:36:02.583403 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-8f531c1b-c51a-48b7-94b0-98c8f2d8ccc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30c9e5e4d92142e191f26691dfe9d70f', 'request_id': 'req-8f531c1b-c51a-48b7-94b0-98c8f2d8ccc0'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:02.608176 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b7d50e-0610-4004-b7da-213291a575ea None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:02.611267 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-d0b7d50e-0610-4004-b7da-213291a575ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:02.628462 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-8f531c1b-c51a-48b7-94b0-98c8f2d8ccc0 admin admin] The token cache is being invalidate because project 30c9e5e4d92142e191f26691dfe9d70f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:36:02.630820 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-8f531c1b-c51a-48b7-94b0-98c8f2d8ccc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:02.632882 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-8f531c1b-c51a-48b7-94b0-98c8f2d8ccc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:02.644956 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1200/2394] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:36:02 2022] DELETE /identity/v3/projects/30c9e5e4d92142e191f26691dfe9d70f => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:36:02.649383 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27698b13-03e9-42f0-bd9a-cd530ac5eb07 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:02.650346 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27698b13-03e9-42f0-bd9a-cd530ac5eb07 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:02.652587 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27698b13-03e9-42f0-bd9a-cd530ac5eb07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:02.721463 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-27698b13-03e9-42f0-bd9a-cd530ac5eb07 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:36:02.723566 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-27698b13-03e9-42f0-bd9a-cd530ac5eb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:02.737644 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b7d50e-0610-4004-b7da-213291a575ea None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:02.859735 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaefd30-2968-461c-8d77-2a942f7e0ffd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b50f9552124b07822ae63c1d553864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:02.861130 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaefd30-2968-461c-8d77-2a942f7e0ffd service swift] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:02.861785 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaefd30-2968-461c-8d77-2a942f7e0ffd service swift] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:02.862398 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaefd30-2968-461c-8d77-2a942f7e0ffd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:02.865170 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1201/2395] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:36:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:36:02.869227 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-3eaefd30-2968-461c-8d77-2a942f7e0ffd service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:02.879019 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db3976-9ffd-4901-9633-178113f81c95 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:02.880102 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db3976-9ffd-4901-9633-178113f81c95 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:02.880980 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db3976-9ffd-4901-9633-178113f81c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:02.923368 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-36db3976-9ffd-4901-9633-178113f81c95 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:36:02.925906 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-36db3976-9ffd-4901-9633-178113f81c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:02.945550 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1202/2396] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:36:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:36:02.953543 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36db3976-9ffd-4901-9633-178113f81c95 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:02.965580 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaefd30-2968-461c-8d77-2a942f7e0ffd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:02.967675 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaefd30-2968-461c-8d77-2a942f7e0ffd service swift] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:02.973874 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:02.978478 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36db3976-9ffd-4901-9633-178113f81c95 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:02.991691 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1195/2397] 10.222.0.91 () {60 vars in 1384 bytes} [Tue Aug 30 04:36:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:36:03.000155 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c77499-6710-4d0a-a868-713c2535d224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:03.001721 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c77499-6710-4d0a-a868-713c2535d224 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:03.001942 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c77499-6710-4d0a-a868-713c2535d224 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:03.002183 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c77499-6710-4d0a-a868-713c2535d224 admin admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:03.002818 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c77499-6710-4d0a-a868-713c2535d224 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:36:03.003536 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c77499-6710-4d0a-a868-713c2535d224 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:03.005667 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c77499-6710-4d0a-a868-713c2535d224 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:03.059237 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1203/2398] 10.222.0.91 () {58 vars in 1153 bytes} [Tue Aug 30 04:36:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:36:03.070195 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaefd30-2968-461c-8d77-2a942f7e0ffd service swift] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:03.086095 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaefd30-2968-461c-8d77-2a942f7e0ffd service swift] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:03.105686 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc45fc8-6728-43c7-adbd-28a0a13fe03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:03.106894 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc45fc8-6728-43c7-adbd-28a0a13fe03a admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:03.107369 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc45fc8-6728-43c7-adbd-28a0a13fe03a admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:03.107848 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc45fc8-6728-43c7-adbd-28a0a13fe03a admin admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:03.109215 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc45fc8-6728-43c7-adbd-28a0a13fe03a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:03.122071 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc45fc8-6728-43c7-adbd-28a0a13fe03a admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:03.218405 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1196/2399] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:36:03 2022] POST /identity/v3/projects => generated 365 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:36:03.224146 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c77499-6710-4d0a-a868-713c2535d224 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:03.244103 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c77499-6710-4d0a-a868-713c2535d224 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:03.466869 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81866ed8-7099-4e0e-92ea-ce759651c417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:03.470075 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81866ed8-7099-4e0e-92ea-ce759651c417 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:03.470703 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81866ed8-7099-4e0e-92ea-ce759651c417 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:03.471352 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81866ed8-7099-4e0e-92ea-ce759651c417 admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:03.472510 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81866ed8-7099-4e0e-92ea-ce759651c417 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:03.475518 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81866ed8-7099-4e0e-92ea-ce759651c417 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:03.536175 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1204/2400] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:36:03 2022] POST /identity/v3/users => generated 283 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:36:03.541823 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc45fc8-6728-43c7-adbd-28a0a13fe03a admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:03.567220 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc45fc8-6728-43c7-adbd-28a0a13fe03a admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:03.576505 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d07339-46f9-447a-a9bd-983b17f5a946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:03.577268 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d07339-46f9-447a-a9bd-983b17f5a946 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:03.577535 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d07339-46f9-447a-a9bd-983b17f5a946 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:03.577832 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d07339-46f9-447a-a9bd-983b17f5a946 admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:03.578470 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d07339-46f9-447a-a9bd-983b17f5a946 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:03.584327 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d07339-46f9-447a-a9bd-983b17f5a946 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:03.610987 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1197/2401] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:36:03.626799 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81866ed8-7099-4e0e-92ea-ce759651c417 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:03.668439 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81866ed8-7099-4e0e-92ea-ce759651c417 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:03.685135 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c9246c-ca26-4239-a2bd-0f016bca8d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:03.686185 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9246c-ca26-4239-a2bd-0f016bca8d73 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:03.686661 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9246c-ca26-4239-a2bd-0f016bca8d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:03.687250 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9246c-ca26-4239-a2bd-0f016bca8d73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:03.688483 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c9246c-ca26-4239-a2bd-0f016bca8d73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:03.692922 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c9246c-ca26-4239-a2bd-0f016bca8d73 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:03.705461 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:03.793021 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d07339-46f9-447a-a9bd-983b17f5a946 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:03.794297 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1205/2402] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:36:03.820403 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d07339-46f9-447a-a9bd-983b17f5a946 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:03.832395 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fa16be-a1c5-497e-a7b3-da605a29f9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:03.833213 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa16be-a1c5-497e-a7b3-da605a29f9bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:03.833517 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa16be-a1c5-497e-a7b3-da605a29f9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:03.834100 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa16be-a1c5-497e-a7b3-da605a29f9bd admin admin] PATH_INFO: `/v3/projects/e1aba9b80c6e47268cc7caeb5ce50576/users/a2d2aa856bf748daae511b1dd8e6484e/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:03.922018 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fa16be-a1c5-497e-a7b3-da605a29f9bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1aba9b80c6e47268cc7caeb5ce50576, user_id=a2d2aa856bf748daae511b1dd8e6484e, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:03.927448 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fa16be-a1c5-497e-a7b3-da605a29f9bd admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:03.967015 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1198/2403] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:36:03 2022] PUT /identity/v3/projects/e1aba9b80c6e47268cc7caeb5ce50576/users/a2d2aa856bf748daae511b1dd8e6484e/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:36:03.982181 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd22b1d-25f4-49ed-b622-bd65ca6635a3 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:03.982468 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd22b1d-25f4-49ed-b622-bd65ca6635a3 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:03.982739 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd22b1d-25f4-49ed-b622-bd65ca6635a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:04.060543 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-9bd22b1d-25f4-49ed-b622-bd65ca6635a3 None None] MFA Rules not processed for user `a2d2aa856bf748daae511b1dd8e6484e`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:36:04.062769 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-9bd22b1d-25f4-49ed-b622-bd65ca6635a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:04.191222 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1206/2404] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:36:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:36:04.196045 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fa16be-a1c5-497e-a7b3-da605a29f9bd admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:04.327693 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fa16be-a1c5-497e-a7b3-da605a29f9bd admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:04.334593 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a148e171-94f9-45be-b619-695d370520b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:04.335408 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148e171-94f9-45be-b619-695d370520b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:04.335687 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148e171-94f9-45be-b619-695d370520b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:04.337181 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148e171-94f9-45be-b619-695d370520b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:04.337990 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a148e171-94f9-45be-b619-695d370520b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:04.340123 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a148e171-94f9-45be-b619-695d370520b7 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:04.391279 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1199/2405] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:36:04 2022] POST /identity/v3/projects => generated 367 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:36:04.395904 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd22b1d-25f4-49ed-b622-bd65ca6635a3 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:04.410189 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd22b1d-25f4-49ed-b622-bd65ca6635a3 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:04.644049 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c7ba4-100e-47a3-8d1d-98dde6fb33ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:04.644996 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c7ba4-100e-47a3-8d1d-98dde6fb33ff admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:04.645580 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c7ba4-100e-47a3-8d1d-98dde6fb33ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:04.645903 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c7ba4-100e-47a3-8d1d-98dde6fb33ff admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:04.648503 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0c7ba4-100e-47a3-8d1d-98dde6fb33ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:04.658272 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0c7ba4-100e-47a3-8d1d-98dde6fb33ff admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:04.733361 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1207/2406] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:36:04 2022] POST /identity/v3/users => generated 290 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:36:04.740544 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a148e171-94f9-45be-b619-695d370520b7 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:04.769135 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a148e171-94f9-45be-b619-695d370520b7 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:04.781332 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e57351-66c2-4903-bec5-5f79bd004812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:04.782729 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e57351-66c2-4903-bec5-5f79bd004812 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:04.783139 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e57351-66c2-4903-bec5-5f79bd004812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:04.783623 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e57351-66c2-4903-bec5-5f79bd004812 admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:04.784973 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e57351-66c2-4903-bec5-5f79bd004812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:04.787854 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e57351-66c2-4903-bec5-5f79bd004812 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:04.816088 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1200/2407] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:36:04 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:36:04.818286 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c7ba4-100e-47a3-8d1d-98dde6fb33ff admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:04.839056 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c7ba4-100e-47a3-8d1d-98dde6fb33ff admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:04.847712 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1497a1f2-7ef6-40a2-89d9-fc20451480cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:04.848784 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497a1f2-7ef6-40a2-89d9-fc20451480cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:04.849355 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497a1f2-7ef6-40a2-89d9-fc20451480cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:04.849753 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497a1f2-7ef6-40a2-89d9-fc20451480cb admin admin] PATH_INFO: `/v3/projects/ca9acef67cce47f1bc5beb33eb66cc1c/users/474f83e343754180b9452e9d8d735d83/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:04.911447 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1497a1f2-7ef6-40a2-89d9-fc20451480cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca9acef67cce47f1bc5beb33eb66cc1c, user_id=474f83e343754180b9452e9d8d735d83, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:04.916211 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1497a1f2-7ef6-40a2-89d9-fc20451480cb admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:04.973746 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1208/2408] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:36:04 2022] PUT /identity/v3/projects/ca9acef67cce47f1bc5beb33eb66cc1c/users/474f83e343754180b9452e9d8d735d83/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:36:04.978611 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e57351-66c2-4903-bec5-5f79bd004812 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:04.999819 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e57351-66c2-4903-bec5-5f79bd004812 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:05.241824 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec62c16-330f-46d4-ac63-a7dd96a11b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:05.246896 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec62c16-330f-46d4-ac63-a7dd96a11b08 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:05.248061 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec62c16-330f-46d4-ac63-a7dd96a11b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:05.248061 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec62c16-330f-46d4-ac63-a7dd96a11b08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:05.250345 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec62c16-330f-46d4-ac63-a7dd96a11b08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:05.254721 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec62c16-330f-46d4-ac63-a7dd96a11b08 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:05.292254 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1201/2409] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:36:04 2022] GET /identity/v3/roles => generated 1420 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:36:05.310512 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1497a1f2-7ef6-40a2-89d9-fc20451480cb admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:05.361207 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1497a1f2-7ef6-40a2-89d9-fc20451480cb admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:05.376946 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4720b2cc-363e-456b-8c6e-509e793c65f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:05.379812 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720b2cc-363e-456b-8c6e-509e793c65f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:05.380332 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720b2cc-363e-456b-8c6e-509e793c65f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:05.380908 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720b2cc-363e-456b-8c6e-509e793c65f1 admin admin] PATH_INFO: `/v3/projects/ca9acef67cce47f1bc5beb33eb66cc1c/users/474f83e343754180b9452e9d8d735d83/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:05.387644 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4720b2cc-363e-456b-8c6e-509e793c65f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca9acef67cce47f1bc5beb33eb66cc1c, user_id=474f83e343754180b9452e9d8d735d83, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:05.400301 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4720b2cc-363e-456b-8c6e-509e793c65f1 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:05.417130 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1209/2410] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:36:05 2022] PUT /identity/v3/projects/ca9acef67cce47f1bc5beb33eb66cc1c/users/474f83e343754180b9452e9d8d735d83/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:36:05.434373 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56160b4f-2817-4aea-bd02-ead489e4d53c None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:05.434855 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56160b4f-2817-4aea-bd02-ead489e4d53c None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:05.435246 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56160b4f-2817-4aea-bd02-ead489e4d53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:05.512921 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:05.518011 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-56160b4f-2817-4aea-bd02-ead489e4d53c None None] MFA Rules not processed for user `474f83e343754180b9452e9d8d735d83`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:36:05.521328 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-56160b4f-2817-4aea-bd02-ead489e4d53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:05.679715 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1202/2411] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:36:05 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:36:05.703026 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4720b2cc-363e-456b-8c6e-509e793c65f1 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:05.705389 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-4720b2cc-363e-456b-8c6e-509e793c65f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:05.801455 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:05.850599 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4720b2cc-363e-456b-8c6e-509e793c65f1 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:05.855728 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa92fa88-64c4-424e-8822-ca9048b78286 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:05.856416 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92fa88-64c4-424e-8822-ca9048b78286 service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:05.856719 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92fa88-64c4-424e-8822-ca9048b78286 service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:05.856966 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92fa88-64c4-424e-8822-ca9048b78286 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:05.875226 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa92fa88-64c4-424e-8822-ca9048b78286 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:05.876999 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa92fa88-64c4-424e-8822-ca9048b78286 service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:05.903444 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1210/2412] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:36:05 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:36:06.053763 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56160b4f-2817-4aea-bd02-ead489e4d53c None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:06.058417 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-56160b4f-2817-4aea-bd02-ead489e4d53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:06.081557 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56160b4f-2817-4aea-bd02-ead489e4d53c None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:06.090125 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e401f7-b38f-465f-8ff8-457584d0d6b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:06.091704 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e401f7-b38f-465f-8ff8-457584d0d6b2 service cinder] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:06.093476 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e401f7-b38f-465f-8ff8-457584d0d6b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:06.094380 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e401f7-b38f-465f-8ff8-457584d0d6b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:06.211675 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e401f7-b38f-465f-8ff8-457584d0d6b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:06.214173 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e401f7-b38f-465f-8ff8-457584d0d6b2 service cinder] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:06.232132 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1203/2413] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:36:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:36:07.435668 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8534b6d5-41a1-4102-847f-385437387fc7 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:07.436369 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8534b6d5-41a1-4102-847f-385437387fc7 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:07.436483 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8534b6d5-41a1-4102-847f-385437387fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:07.491982 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-8534b6d5-41a1-4102-847f-385437387fc7 None None] MFA Rules not processed for user `5adb079fad6c41aca6a619a71a3b7c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:36:07.493694 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-8534b6d5-41a1-4102-847f-385437387fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:07.606810 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1211/2414] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:36:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:36:07.617241 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e401f7-b38f-465f-8ff8-457584d0d6b2 service cinder] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:07.620395 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-77e401f7-b38f-465f-8ff8-457584d0d6b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:07.761034 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e401f7-b38f-465f-8ff8-457584d0d6b2 service cinder] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:07.768260 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da241ff8-c453-4e8d-9fe4-164c8491ade6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd806295278ae4997b5c6968aa553290c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:07.768931 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da241ff8-c453-4e8d-9fe4-164c8491ade6 service nova] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:07.769214 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da241ff8-c453-4e8d-9fe4-164c8491ade6 service nova] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:07.769871 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da241ff8-c453-4e8d-9fe4-164c8491ade6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:07.775179 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-da241ff8-c453-4e8d-9fe4-164c8491ade6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:07.791461 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da241ff8-c453-4e8d-9fe4-164c8491ade6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:07.795110 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da241ff8-c453-4e8d-9fe4-164c8491ade6 service nova] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:07.819860 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1204/2415] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:36:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:36:09.090829 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8534b6d5-41a1-4102-847f-385437387fc7 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:09.092503 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-8534b6d5-41a1-4102-847f-385437387fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:09.230601 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8534b6d5-41a1-4102-847f-385437387fc7 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:09.238822 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10209ac6-4c7a-4f57-991b-80686b072428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:09.239470 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10209ac6-4c7a-4f57-991b-80686b072428 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:09.239746 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10209ac6-4c7a-4f57-991b-80686b072428 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:09.242468 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10209ac6-4c7a-4f57-991b-80686b072428 admin admin] PATH_INFO: `/v3/users/197713bcd3e048d4ade79f2099331573` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:09.243932 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10209ac6-4c7a-4f57-991b-80686b072428 admin admin] RBAC: Authorizing `identity:delete_user(user_id=197713bcd3e048d4ade79f2099331573)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:09.247244 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10209ac6-4c7a-4f57-991b-80686b072428 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:09.424766 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-10209ac6-4c7a-4f57-991b-80686b072428 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '197713bcd3e048d4ade79f2099331573'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:09.446852 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-10209ac6-4c7a-4f57-991b-80686b072428 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '197713bcd3e048d4ade79f2099331573'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:09.469930 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-10209ac6-4c7a-4f57-991b-80686b072428 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '197713bcd3e048d4ade79f2099331573'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:09.479136 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-10209ac6-4c7a-4f57-991b-80686b072428 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '197713bcd3e048d4ade79f2099331573'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:09.524507 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-10209ac6-4c7a-4f57-991b-80686b072428 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '197713bcd3e048d4ade79f2099331573'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:09.534509 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1212/2416] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:36:09 2022] DELETE /identity/v3/users/197713bcd3e048d4ade79f2099331573 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:36:09.542193 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e75ad-629b-49d8-b20d-8a7286d78d54 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:09.543332 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e75ad-629b-49d8-b20d-8a7286d78d54 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:09.543842 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e75ad-629b-49d8-b20d-8a7286d78d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:09.569149 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-8d8e75ad-629b-49d8-b20d-8a7286d78d54 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:36:09.570864 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-8d8e75ad-629b-49d8-b20d-8a7286d78d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:09.593985 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:09.737041 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1205/2417] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:36:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:36:09.744812 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10209ac6-4c7a-4f57-991b-80686b072428 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:09.748858 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-10209ac6-4c7a-4f57-991b-80686b072428 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:09.768844 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:09.945021 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10209ac6-4c7a-4f57-991b-80686b072428 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:09.950676 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c6c3a-bc47-4294-bfba-0e87a89676a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:09.951722 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c6c3a-bc47-4294-bfba-0e87a89676a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:09.952315 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c6c3a-bc47-4294-bfba-0e87a89676a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:09.952774 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c6c3a-bc47-4294-bfba-0e87a89676a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:09.967492 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988c6c3a-bc47-4294-bfba-0e87a89676a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:09.969274 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988c6c3a-bc47-4294-bfba-0e87a89676a3 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:10.001784 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1213/2418] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:36:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:36:10.536393 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8e75ad-629b-49d8-b20d-8a7286d78d54 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:10.539776 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-8d8e75ad-629b-49d8-b20d-8a7286d78d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:10.584678 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8e75ad-629b-49d8-b20d-8a7286d78d54 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:10.609321 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d0e44f-4d7c-4ada-9fb9-af9c6b92e453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:10.609998 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d0e44f-4d7c-4ada-9fb9-af9c6b92e453 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:10.610398 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d0e44f-4d7c-4ada-9fb9-af9c6b92e453 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:10.610674 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d0e44f-4d7c-4ada-9fb9-af9c6b92e453 admin admin] PATH_INFO: `/v3/projects/50955590fe40487bb001229b3da49e64` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:10.616518 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d0e44f-4d7c-4ada-9fb9-af9c6b92e453 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50955590fe40487bb001229b3da49e64)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:10.619180 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d0e44f-4d7c-4ada-9fb9-af9c6b92e453 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:10.762328 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-d3d0e44f-4d7c-4ada-9fb9-af9c6b92e453 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50955590fe40487bb001229b3da49e64', 'request_id': 'req-d3d0e44f-4d7c-4ada-9fb9-af9c6b92e453'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:10.770652 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-d3d0e44f-4d7c-4ada-9fb9-af9c6b92e453 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50955590fe40487bb001229b3da49e64', 'request_id': 'req-d3d0e44f-4d7c-4ada-9fb9-af9c6b92e453'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:10.786924 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-d3d0e44f-4d7c-4ada-9fb9-af9c6b92e453 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50955590fe40487bb001229b3da49e64', 'request_id': 'req-d3d0e44f-4d7c-4ada-9fb9-af9c6b92e453'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:10.808185 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-d3d0e44f-4d7c-4ada-9fb9-af9c6b92e453 admin admin] The token cache is being invalidate because project 50955590fe40487bb001229b3da49e64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:36:10.809007 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-d3d0e44f-4d7c-4ada-9fb9-af9c6b92e453 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:10.811728 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-d3d0e44f-4d7c-4ada-9fb9-af9c6b92e453 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:10.814904 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1206/2419] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:36:10 2022] DELETE /identity/v3/projects/50955590fe40487bb001229b3da49e64 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:36:10.819032 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c6c3a-bc47-4294-bfba-0e87a89676a3 service neutron] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:10.834239 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c6c3a-bc47-4294-bfba-0e87a89676a3 service neutron] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:11.005640 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ddc9e-50a7-436e-931e-60849fe27a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:11.006303 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ddc9e-50a7-436e-931e-60849fe27a5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:11.006653 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ddc9e-50a7-436e-931e-60849fe27a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:11.006870 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ddc9e-50a7-436e-931e-60849fe27a5b admin admin] PATH_INFO: `/v3/users/f965ad27fe004d22828eddd36086fef5` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:11.008923 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68ddc9e-50a7-436e-931e-60849fe27a5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f965ad27fe004d22828eddd36086fef5)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:11.013761 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68ddc9e-50a7-436e-931e-60849fe27a5b admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:11.100147 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-c68ddc9e-50a7-436e-931e-60849fe27a5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f965ad27fe004d22828eddd36086fef5'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:11.110542 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-c68ddc9e-50a7-436e-931e-60849fe27a5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f965ad27fe004d22828eddd36086fef5'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:11.129241 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-c68ddc9e-50a7-436e-931e-60849fe27a5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f965ad27fe004d22828eddd36086fef5'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:11.130488 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-c68ddc9e-50a7-436e-931e-60849fe27a5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f965ad27fe004d22828eddd36086fef5'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:11.164162 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-c68ddc9e-50a7-436e-931e-60849fe27a5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f965ad27fe004d22828eddd36086fef5'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:11.175813 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1214/2420] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:36:10 2022] DELETE /identity/v3/users/f965ad27fe004d22828eddd36086fef5 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:36:11.975704 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d0e44f-4d7c-4ada-9fb9-af9c6b92e453 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:11.978301 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-d3d0e44f-4d7c-4ada-9fb9-af9c6b92e453 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:12.056433 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d0e44f-4d7c-4ada-9fb9-af9c6b92e453 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:12.320580 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5243b7a2-4f06-4b6b-9bfd-2c9b3821843d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:12.321363 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243b7a2-4f06-4b6b-9bfd-2c9b3821843d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:12.321511 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243b7a2-4f06-4b6b-9bfd-2c9b3821843d admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:12.321710 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243b7a2-4f06-4b6b-9bfd-2c9b3821843d admin admin] PATH_INFO: `/v3/projects/c8916dddc2354d969f1aae293b75691b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:12.323127 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5243b7a2-4f06-4b6b-9bfd-2c9b3821843d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8916dddc2354d969f1aae293b75691b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:12.325724 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5243b7a2-4f06-4b6b-9bfd-2c9b3821843d admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:12.430661 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:12.449112 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-5243b7a2-4f06-4b6b-9bfd-2c9b3821843d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8916dddc2354d969f1aae293b75691b', 'request_id': 'req-5243b7a2-4f06-4b6b-9bfd-2c9b3821843d'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:12.485396 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-5243b7a2-4f06-4b6b-9bfd-2c9b3821843d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8916dddc2354d969f1aae293b75691b', 'request_id': 'req-5243b7a2-4f06-4b6b-9bfd-2c9b3821843d'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:12.497646 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-5243b7a2-4f06-4b6b-9bfd-2c9b3821843d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8916dddc2354d969f1aae293b75691b', 'request_id': 'req-5243b7a2-4f06-4b6b-9bfd-2c9b3821843d'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:12.539768 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-5243b7a2-4f06-4b6b-9bfd-2c9b3821843d admin admin] The token cache is being invalidate because project c8916dddc2354d969f1aae293b75691b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:36:12.540717 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-5243b7a2-4f06-4b6b-9bfd-2c9b3821843d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:12.545501 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-5243b7a2-4f06-4b6b-9bfd-2c9b3821843d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:12.549268 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1207/2421] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:36:11 2022] DELETE /identity/v3/projects/c8916dddc2354d969f1aae293b75691b => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:36:12.556582 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17192a5-8e59-4cd6-b8c6-df54427ba1b3 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:12.557152 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17192a5-8e59-4cd6-b8c6-df54427ba1b3 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:12.557272 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17192a5-8e59-4cd6-b8c6-df54427ba1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:12.580208 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-d17192a5-8e59-4cd6-b8c6-df54427ba1b3 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:36:12.581541 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-d17192a5-8e59-4cd6-b8c6-df54427ba1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:12.629052 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:12.668666 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1215/2422] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:36:12.681556 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66153c7a-c0f5-4514-bb47-4041e8d5ad03 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:12.682261 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66153c7a-c0f5-4514-bb47-4041e8d5ad03 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:12.682752 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66153c7a-c0f5-4514-bb47-4041e8d5ad03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:12.709289 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-66153c7a-c0f5-4514-bb47-4041e8d5ad03 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:36:12.711612 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-66153c7a-c0f5-4514-bb47-4041e8d5ad03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:12.736301 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1208/2423] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:36:12.737139 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17192a5-8e59-4cd6-b8c6-df54427ba1b3 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:12.748811 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17192a5-8e59-4cd6-b8c6-df54427ba1b3 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:12.755359 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54480f63-8806-4235-aa30-e56437e7fce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:12.756190 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54480f63-8806-4235-aa30-e56437e7fce3 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:12.761100 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54480f63-8806-4235-aa30-e56437e7fce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:12.761100 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54480f63-8806-4235-aa30-e56437e7fce3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:12.761100 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54480f63-8806-4235-aa30-e56437e7fce3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:36:12.761100 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54480f63-8806-4235-aa30-e56437e7fce3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:12.761100 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54480f63-8806-4235-aa30-e56437e7fce3 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:12.778680 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1216/2424] 10.222.0.91 () {58 vars in 1153 bytes} [Tue Aug 30 04:36:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:36:12.787345 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66153c7a-c0f5-4514-bb47-4041e8d5ad03 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:12.805995 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66153c7a-c0f5-4514-bb47-4041e8d5ad03 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:12.815103 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ab5fc3-4cc8-4b57-b48e-c2021045236b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:12.816210 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ab5fc3-4cc8-4b57-b48e-c2021045236b admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:12.816631 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ab5fc3-4cc8-4b57-b48e-c2021045236b admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:12.817140 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ab5fc3-4cc8-4b57-b48e-c2021045236b admin admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:12.818711 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ab5fc3-4cc8-4b57-b48e-c2021045236b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:12.822388 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ab5fc3-4cc8-4b57-b48e-c2021045236b admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:12.883203 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1209/2425] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:36:12 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:36:12.891635 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54480f63-8806-4235-aa30-e56437e7fce3 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:12.927226 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54480f63-8806-4235-aa30-e56437e7fce3 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:13.155649 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c921d90b-692a-4909-af16-1c1ce2d5e4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:13.156756 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921d90b-692a-4909-af16-1c1ce2d5e4c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:13.157279 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921d90b-692a-4909-af16-1c1ce2d5e4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:13.157748 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921d90b-692a-4909-af16-1c1ce2d5e4c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:13.159107 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c921d90b-692a-4909-af16-1c1ce2d5e4c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:13.162476 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c921d90b-692a-4909-af16-1c1ce2d5e4c2 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:13.248337 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1217/2426] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:36:12 2022] POST /identity/v3/users => generated 292 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:36:13.256027 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ab5fc3-4cc8-4b57-b48e-c2021045236b admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:13.300732 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ab5fc3-4cc8-4b57-b48e-c2021045236b admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:13.323209 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f7d72d-3640-464b-a08f-caa163c43a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:13.324249 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7d72d-3640-464b-a08f-caa163c43a54 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:13.325211 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7d72d-3640-464b-a08f-caa163c43a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:13.325832 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7d72d-3640-464b-a08f-caa163c43a54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:13.327653 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f7d72d-3640-464b-a08f-caa163c43a54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:13.332246 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f7d72d-3640-464b-a08f-caa163c43a54 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:13.400547 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c921d90b-692a-4909-af16-1c1ce2d5e4c2 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:13.401372 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1210/2427] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:36:13 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:36:13.402846 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f7d72d-3640-464b-a08f-caa163c43a54 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:13.418960 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-c921d90b-692a-4909-af16-1c1ce2d5e4c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:13.430941 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f7d72d-3640-464b-a08f-caa163c43a54 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:13.446907 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c921d90b-692a-4909-af16-1c1ce2d5e4c2 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:13.458349 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e442af53-bf0b-4313-b875-bad84bad330e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:13.461818 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442af53-bf0b-4313-b875-bad84bad330e admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:13.462262 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442af53-bf0b-4313-b875-bad84bad330e admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:13.462711 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442af53-bf0b-4313-b875-bad84bad330e admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:13.464424 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e73025-fcb4-4963-8731-1dd51497290b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:13.466462 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e442af53-bf0b-4313-b875-bad84bad330e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:13.470166 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e442af53-bf0b-4313-b875-bad84bad330e admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:13.472535 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e73025-fcb4-4963-8731-1dd51497290b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:13.473531 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e73025-fcb4-4963-8731-1dd51497290b admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:13.474030 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e73025-fcb4-4963-8731-1dd51497290b admin admin] PATH_INFO: `/v3/users/a2d2aa856bf748daae511b1dd8e6484e` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:13.477329 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e73025-fcb4-4963-8731-1dd51497290b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2d2aa856bf748daae511b1dd8e6484e)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:13.481246 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e73025-fcb4-4963-8731-1dd51497290b admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:13.491502 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1211/2428] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:36:13 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:36:13.498632 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e442af53-bf0b-4313-b875-bad84bad330e admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:13.521971 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e442af53-bf0b-4313-b875-bad84bad330e admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:13.573131 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b2b7e-054f-4a36-a92c-bd55e4a5e184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:13.574371 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b2b7e-054f-4a36-a92c-bd55e4a5e184 admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:13.574820 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b2b7e-054f-4a36-a92c-bd55e4a5e184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:13.575352 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b2b7e-054f-4a36-a92c-bd55e4a5e184 admin admin] PATH_INFO: `/v3/projects/364851cacd74461699aecdd9c1380186/users/4de3677dcd224eed9816a1fbf6743e87/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:13.640000 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-89e73025-fcb4-4963-8731-1dd51497290b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2d2aa856bf748daae511b1dd8e6484e'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:13.659202 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4b2b7e-054f-4a36-a92c-bd55e4a5e184 admin admin] RBAC: Authorizing `identity:create_grant(project_id=364851cacd74461699aecdd9c1380186, user_id=4de3677dcd224eed9816a1fbf6743e87, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:13.675756 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4b2b7e-054f-4a36-a92c-bd55e4a5e184 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:13.687263 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-89e73025-fcb4-4963-8731-1dd51497290b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2d2aa856bf748daae511b1dd8e6484e'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:13.723348 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-89e73025-fcb4-4963-8731-1dd51497290b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2d2aa856bf748daae511b1dd8e6484e'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:13.725245 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-89e73025-fcb4-4963-8731-1dd51497290b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2d2aa856bf748daae511b1dd8e6484e'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:13.738010 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1212/2429] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:36:13 2022] PUT /identity/v3/projects/364851cacd74461699aecdd9c1380186/users/4de3677dcd224eed9816a1fbf6743e87/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:36:13.759063 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43fbe82-0c5c-4c4a-8dab-0ff6a0700baf None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:13.759963 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43fbe82-0c5c-4c4a-8dab-0ff6a0700baf None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:13.760682 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43fbe82-0c5c-4c4a-8dab-0ff6a0700baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:13.805713 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-89e73025-fcb4-4963-8731-1dd51497290b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2d2aa856bf748daae511b1dd8e6484e'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:13.820101 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1218/2430] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:36:13 2022] DELETE /identity/v3/users/a2d2aa856bf748daae511b1dd8e6484e => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:36:13.825320 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a734e-6849-4950-adba-d7a2d3c705a0 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:13.826218 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a734e-6849-4950-adba-d7a2d3c705a0 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:13.826503 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a734e-6849-4950-adba-d7a2d3c705a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:13.850272 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-985a734e-6849-4950-adba-d7a2d3c705a0 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:36:13.851705 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-985a734e-6849-4950-adba-d7a2d3c705a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:13.881469 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-e43fbe82-0c5c-4c4a-8dab-0ff6a0700baf None None] MFA Rules not processed for user `4de3677dcd224eed9816a1fbf6743e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:36:13.883428 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:13.885470 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-e43fbe82-0c5c-4c4a-8dab-0ff6a0700baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:13.989529 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1219/2431] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:36:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:36:14.029457 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985a734e-6849-4950-adba-d7a2d3c705a0 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:14.030994 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-985a734e-6849-4950-adba-d7a2d3c705a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:14.155964 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1213/2432] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:36:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:36:14.164893 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43fbe82-0c5c-4c4a-8dab-0ff6a0700baf None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:14.168244 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-e43fbe82-0c5c-4c4a-8dab-0ff6a0700baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:14.200488 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43fbe82-0c5c-4c4a-8dab-0ff6a0700baf None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:14.217577 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c6ba25-19e7-4a52-b028-d23d2f6fbcd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:14.221893 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c6ba25-19e7-4a52-b028-d23d2f6fbcd3 admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:14.223873 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c6ba25-19e7-4a52-b028-d23d2f6fbcd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:14.226196 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c6ba25-19e7-4a52-b028-d23d2f6fbcd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:14.234151 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c6ba25-19e7-4a52-b028-d23d2f6fbcd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:14.239619 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c6ba25-19e7-4a52-b028-d23d2f6fbcd3 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:14.259855 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985a734e-6849-4950-adba-d7a2d3c705a0 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:14.267625 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341b53ee-24d0-4e9f-84fb-1b344334a4b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:14.269318 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b53ee-24d0-4e9f-84fb-1b344334a4b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:14.269956 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b53ee-24d0-4e9f-84fb-1b344334a4b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:14.270621 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b53ee-24d0-4e9f-84fb-1b344334a4b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:14.292718 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341b53ee-24d0-4e9f-84fb-1b344334a4b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:14.295419 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341b53ee-24d0-4e9f-84fb-1b344334a4b5 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:14.310409 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1220/2433] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:36:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:36:14.325473 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1214/2434] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:36:14 2022] POST /identity/v3/projects => generated 381 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:36:14.331244 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341b53ee-24d0-4e9f-84fb-1b344334a4b5 service neutron] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:14.361325 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341b53ee-24d0-4e9f-84fb-1b344334a4b5 service neutron] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:14.537001 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8e23d-0e22-4d8c-bc4a-99fb57b7b9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:14.538683 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8e23d-0e22-4d8c-bc4a-99fb57b7b9c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:14.540790 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8e23d-0e22-4d8c-bc4a-99fb57b7b9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:14.541883 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8e23d-0e22-4d8c-bc4a-99fb57b7b9c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:14.543355 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d8e23d-0e22-4d8c-bc4a-99fb57b7b9c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:14.547565 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d8e23d-0e22-4d8c-bc4a-99fb57b7b9c6 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:14.619327 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1221/2435] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:36:14 2022] POST /identity/v3/users => generated 297 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:36:14.626047 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c6ba25-19e7-4a52-b028-d23d2f6fbcd3 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:14.738206 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c6ba25-19e7-4a52-b028-d23d2f6fbcd3 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:14.793816 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa296a-46a4-4c7e-9a96-c1b32413739c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:14.798435 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa296a-46a4-4c7e-9a96-c1b32413739c admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:14.799709 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa296a-46a4-4c7e-9a96-c1b32413739c admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:14.801600 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa296a-46a4-4c7e-9a96-c1b32413739c admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:14.811304 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aa296a-46a4-4c7e-9a96-c1b32413739c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:14.811304 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aa296a-46a4-4c7e-9a96-c1b32413739c admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:14.845585 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8e23d-0e22-4d8c-bc4a-99fb57b7b9c6 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:14.846448 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1215/2436] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:36:14 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:36:14.859059 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8e23d-0e22-4d8c-bc4a-99fb57b7b9c6 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:14.864992 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899a98a-ce88-4e6a-aff5-45995ccb242e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:14.865550 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899a98a-ce88-4e6a-aff5-45995ccb242e admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:14.865837 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899a98a-ce88-4e6a-aff5-45995ccb242e admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:14.866127 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899a98a-ce88-4e6a-aff5-45995ccb242e admin admin] PATH_INFO: `/v3/projects/53b6ae0b929e4c109dadf163eade9f3c/users/b35831acfb7f44cbbb5f3d05dc4d7a35/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:14.888840 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9899a98a-ce88-4e6a-aff5-45995ccb242e admin admin] RBAC: Authorizing `identity:create_grant(project_id=53b6ae0b929e4c109dadf163eade9f3c, user_id=b35831acfb7f44cbbb5f3d05dc4d7a35, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:14.891871 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9899a98a-ce88-4e6a-aff5-45995ccb242e admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:14.919181 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa296a-46a4-4c7e-9a96-c1b32413739c admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:14.920088 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1222/2437] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:36:14 2022] PUT /identity/v3/projects/53b6ae0b929e4c109dadf163eade9f3c/users/b35831acfb7f44cbbb5f3d05dc4d7a35/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:36:14.932253 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa296a-46a4-4c7e-9a96-c1b32413739c admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:14.948748 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:15.037408 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8169edd-5717-48b6-93c5-2128b3bf66d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:15.039153 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8169edd-5717-48b6-93c5-2128b3bf66d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:15.039950 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8169edd-5717-48b6-93c5-2128b3bf66d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:15.039950 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8169edd-5717-48b6-93c5-2128b3bf66d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:15.040744 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8169edd-5717-48b6-93c5-2128b3bf66d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:15.042683 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8169edd-5717-48b6-93c5-2128b3bf66d9 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:15.064531 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899a98a-ce88-4e6a-aff5-45995ccb242e admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:15.065497 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1216/2438] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:36:14 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:36:15.080265 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899a98a-ce88-4e6a-aff5-45995ccb242e admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:15.089485 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6dd4ce-56ea-43ad-ae4e-af19525d13c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:15.089485 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6dd4ce-56ea-43ad-ae4e-af19525d13c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:15.090247 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6dd4ce-56ea-43ad-ae4e-af19525d13c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:15.090949 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6dd4ce-56ea-43ad-ae4e-af19525d13c9 admin admin] PATH_INFO: `/v3/projects/53b6ae0b929e4c109dadf163eade9f3c/users/b35831acfb7f44cbbb5f3d05dc4d7a35/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:15.095076 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6dd4ce-56ea-43ad-ae4e-af19525d13c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53b6ae0b929e4c109dadf163eade9f3c, user_id=b35831acfb7f44cbbb5f3d05dc4d7a35, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:15.098890 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6dd4ce-56ea-43ad-ae4e-af19525d13c9 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:15.125020 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1ec68-5fc9-4d27-ac9f-e2be9b9ff87a None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:15.125449 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1ec68-5fc9-4d27-ac9f-e2be9b9ff87a None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:15.125758 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1ec68-5fc9-4d27-ac9f-e2be9b9ff87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:15.129592 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1223/2439] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:36:15 2022] PUT /identity/v3/projects/53b6ae0b929e4c109dadf163eade9f3c/users/b35831acfb7f44cbbb5f3d05dc4d7a35/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:36:15.191685 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-04f1ec68-5fc9-4d27-ac9f-e2be9b9ff87a None None] MFA Rules not processed for user `b35831acfb7f44cbbb5f3d05dc4d7a35`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:36:15.193940 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-04f1ec68-5fc9-4d27-ac9f-e2be9b9ff87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:15.380402 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1217/2440] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:36:15 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:36:15.396349 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6dd4ce-56ea-43ad-ae4e-af19525d13c9 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:15.400446 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-de6dd4ce-56ea-43ad-ae4e-af19525d13c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:15.458331 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:15.572358 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f1ec68-5fc9-4d27-ac9f-e2be9b9ff87a None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:15.574307 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-04f1ec68-5fc9-4d27-ac9f-e2be9b9ff87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:15.582404 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6dd4ce-56ea-43ad-ae4e-af19525d13c9 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:15.597274 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d8369f-9cab-4da9-9793-c1dd5cecbf1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:15.615583 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8369f-9cab-4da9-9793-c1dd5cecbf1e service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:15.618528 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8369f-9cab-4da9-9793-c1dd5cecbf1e service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:15.620688 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8369f-9cab-4da9-9793-c1dd5cecbf1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:15.713858 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d8369f-9cab-4da9-9793-c1dd5cecbf1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:15.723080 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d8369f-9cab-4da9-9793-c1dd5cecbf1e service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:15.765625 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1224/2441] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:36:15 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:36:15.867087 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f1ec68-5fc9-4d27-ac9f-e2be9b9ff87a None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:15.873367 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1915dc-1a7c-4fae-9739-bd135177b937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:15.874162 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1915dc-1a7c-4fae-9739-bd135177b937 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:15.874593 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1915dc-1a7c-4fae-9739-bd135177b937 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:15.874906 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1915dc-1a7c-4fae-9739-bd135177b937 admin admin] PATH_INFO: `/v3/projects/e1aba9b80c6e47268cc7caeb5ce50576` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:15.876574 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1915dc-1a7c-4fae-9739-bd135177b937 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1aba9b80c6e47268cc7caeb5ce50576)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:15.879057 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1915dc-1a7c-4fae-9739-bd135177b937 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:15.931615 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d8369f-9cab-4da9-9793-c1dd5cecbf1e service cinder] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:15.957508 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d8369f-9cab-4da9-9793-c1dd5cecbf1e service cinder] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:15.967032 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:15.989930 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-fc1915dc-1a7c-4fae-9739-bd135177b937 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1aba9b80c6e47268cc7caeb5ce50576', 'request_id': 'req-fc1915dc-1a7c-4fae-9739-bd135177b937'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:15.999844 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-fc1915dc-1a7c-4fae-9739-bd135177b937 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1aba9b80c6e47268cc7caeb5ce50576', 'request_id': 'req-fc1915dc-1a7c-4fae-9739-bd135177b937'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:16.018255 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-fc1915dc-1a7c-4fae-9739-bd135177b937 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1aba9b80c6e47268cc7caeb5ce50576', 'request_id': 'req-fc1915dc-1a7c-4fae-9739-bd135177b937'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:16.037804 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-fc1915dc-1a7c-4fae-9739-bd135177b937 admin admin] The token cache is being invalidate because project e1aba9b80c6e47268cc7caeb5ce50576 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:36:16.038345 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-fc1915dc-1a7c-4fae-9739-bd135177b937 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:16.039564 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-fc1915dc-1a7c-4fae-9739-bd135177b937 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:16.041781 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1218/2442] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:36:15 2022] DELETE /identity/v3/projects/e1aba9b80c6e47268cc7caeb5ce50576 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:36:16.047598 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1915dc-1a7c-4fae-9739-bd135177b937 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:16.050441 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-fc1915dc-1a7c-4fae-9739-bd135177b937 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:16.063779 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc4c98-7738-46a4-9fc7-af01aea0bc3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:16.067243 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc4c98-7738-46a4-9fc7-af01aea0bc3c service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:16.069590 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc4c98-7738-46a4-9fc7-af01aea0bc3c service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:16.071046 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc4c98-7738-46a4-9fc7-af01aea0bc3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:16.075758 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-a1bc4c98-7738-46a4-9fc7-af01aea0bc3c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:16.243780 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1915dc-1a7c-4fae-9739-bd135177b937 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:16.259549 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a19ca9-94e7-4b24-b356-211eeabfdcfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:16.260819 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a19ca9-94e7-4b24-b356-211eeabfdcfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:16.261247 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a19ca9-94e7-4b24-b356-211eeabfdcfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:16.261660 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a19ca9-94e7-4b24-b356-211eeabfdcfb admin admin] PATH_INFO: `/v3/users/474f83e343754180b9452e9d8d735d83` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:16.264597 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a19ca9-94e7-4b24-b356-211eeabfdcfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=474f83e343754180b9452e9d8d735d83)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:16.270759 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a19ca9-94e7-4b24-b356-211eeabfdcfb admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:16.290405 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bc4c98-7738-46a4-9fc7-af01aea0bc3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:16.293504 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bc4c98-7738-46a4-9fc7-af01aea0bc3c service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:16.322295 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1225/2443] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:36:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:36:16.369835 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-f2a19ca9-94e7-4b24-b356-211eeabfdcfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '474f83e343754180b9452e9d8d735d83'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:16.383571 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-f2a19ca9-94e7-4b24-b356-211eeabfdcfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '474f83e343754180b9452e9d8d735d83'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:16.404811 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-f2a19ca9-94e7-4b24-b356-211eeabfdcfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '474f83e343754180b9452e9d8d735d83'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:16.435984 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-f2a19ca9-94e7-4b24-b356-211eeabfdcfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '474f83e343754180b9452e9d8d735d83'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:16.487703 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-f2a19ca9-94e7-4b24-b356-211eeabfdcfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '474f83e343754180b9452e9d8d735d83'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:16.521584 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1219/2444] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:36:16 2022] DELETE /identity/v3/users/474f83e343754180b9452e9d8d735d83 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:36:17.074869 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc4c98-7738-46a4-9fc7-af01aea0bc3c service cinder] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:17.078236 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-a1bc4c98-7738-46a4-9fc7-af01aea0bc3c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:17.144285 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc4c98-7738-46a4-9fc7-af01aea0bc3c service cinder] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:17.315760 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac58f3-d159-43a4-9a77-3bb4d84cc925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:17.317079 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac58f3-d159-43a4-9a77-3bb4d84cc925 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:17.317570 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac58f3-d159-43a4-9a77-3bb4d84cc925 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:17.318115 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac58f3-d159-43a4-9a77-3bb4d84cc925 admin admin] PATH_INFO: `/v3/users/4de3677dcd224eed9816a1fbf6743e87` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:17.319738 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac58f3-d159-43a4-9a77-3bb4d84cc925 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4de3677dcd224eed9816a1fbf6743e87)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:17.322399 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac58f3-d159-43a4-9a77-3bb4d84cc925 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:17.341000 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:17.434868 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-4eac58f3-d159-43a4-9a77-3bb4d84cc925 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4de3677dcd224eed9816a1fbf6743e87'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:17.469326 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-4eac58f3-d159-43a4-9a77-3bb4d84cc925 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4de3677dcd224eed9816a1fbf6743e87'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:17.493496 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-4eac58f3-d159-43a4-9a77-3bb4d84cc925 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4de3677dcd224eed9816a1fbf6743e87'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:17.495486 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-4eac58f3-d159-43a4-9a77-3bb4d84cc925 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4de3677dcd224eed9816a1fbf6743e87'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:17.525583 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-4eac58f3-d159-43a4-9a77-3bb4d84cc925 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4de3677dcd224eed9816a1fbf6743e87'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:17.540221 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3233c-dde5-4162-9637-4a4019673b1e None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:17.541136 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3233c-dde5-4162-9637-4a4019673b1e None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:17.541136 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3233c-dde5-4162-9637-4a4019673b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:17.545165 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1226/2445] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:36:17 2022] DELETE /identity/v3/users/4de3677dcd224eed9816a1fbf6743e87 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:36:17.566015 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-f2c3233c-dde5-4162-9637-4a4019673b1e None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:36:17.567728 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-f2c3233c-dde5-4162-9637-4a4019673b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:17.651714 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:17.663046 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1220/2446] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:36:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:36:17.679028 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac58f3-d159-43a4-9a77-3bb4d84cc925 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:17.681655 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-4eac58f3-d159-43a4-9a77-3bb4d84cc925 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:17.865515 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c3233c-dde5-4162-9637-4a4019673b1e None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:17.867241 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-f2c3233c-dde5-4162-9637-4a4019673b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:17.873655 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac58f3-d159-43a4-9a77-3bb4d84cc925 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:17.882281 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968000eb-87c7-47b8-934c-81906f9cfee3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:17.883879 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968000eb-87c7-47b8-934c-81906f9cfee3 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:17.884940 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968000eb-87c7-47b8-934c-81906f9cfee3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:17.885699 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968000eb-87c7-47b8-934c-81906f9cfee3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:17.894431 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c3233c-dde5-4162-9637-4a4019673b1e None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:17.905678 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968000eb-87c7-47b8-934c-81906f9cfee3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:17.911605 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f6959c-9fc5-475a-a5bc-797c42119476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:17.915012 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6959c-9fc5-475a-a5bc-797c42119476 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:17.915881 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6959c-9fc5-475a-a5bc-797c42119476 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:17.917808 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6959c-9fc5-475a-a5bc-797c42119476 admin admin] PATH_INFO: `/v3/projects/ca9acef67cce47f1bc5beb33eb66cc1c` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:17.926766 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968000eb-87c7-47b8-934c-81906f9cfee3 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:17.932936 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f6959c-9fc5-475a-a5bc-797c42119476 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca9acef67cce47f1bc5beb33eb66cc1c)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:17.941265 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f6959c-9fc5-475a-a5bc-797c42119476 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:17.973394 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1227/2447] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:36:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:36:18.058109 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-41f6959c-9fc5-475a-a5bc-797c42119476 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca9acef67cce47f1bc5beb33eb66cc1c', 'request_id': 'req-41f6959c-9fc5-475a-a5bc-797c42119476'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:18.073857 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-41f6959c-9fc5-475a-a5bc-797c42119476 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca9acef67cce47f1bc5beb33eb66cc1c', 'request_id': 'req-41f6959c-9fc5-475a-a5bc-797c42119476'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:18.093861 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-41f6959c-9fc5-475a-a5bc-797c42119476 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca9acef67cce47f1bc5beb33eb66cc1c', 'request_id': 'req-41f6959c-9fc5-475a-a5bc-797c42119476'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:18.141312 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-41f6959c-9fc5-475a-a5bc-797c42119476 admin admin] The token cache is being invalidate because project ca9acef67cce47f1bc5beb33eb66cc1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:36:18.141827 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-41f6959c-9fc5-475a-a5bc-797c42119476 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:18.146531 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-41f6959c-9fc5-475a-a5bc-797c42119476 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:18.152072 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1221/2448] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:36:17 2022] DELETE /identity/v3/projects/ca9acef67cce47f1bc5beb33eb66cc1c => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:36:18.160496 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bfbffb-3a42-4d5e-9757-d70fb7bfd301 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:18.161623 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bfbffb-3a42-4d5e-9757-d70fb7bfd301 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:18.162043 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bfbffb-3a42-4d5e-9757-d70fb7bfd301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:18.242428 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-b9bfbffb-3a42-4d5e-9757-d70fb7bfd301 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:36:18.250696 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-b9bfbffb-3a42-4d5e-9757-d70fb7bfd301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:18.359429 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1228/2449] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:36:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:36:18.492520 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e234c-99fd-4272-94ab-4dc38058646f None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:18.492520 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e234c-99fd-4272-94ab-4dc38058646f None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:18.492520 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e234c-99fd-4272-94ab-4dc38058646f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:18.519524 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-be0e234c-99fd-4272-94ab-4dc38058646f None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:36:18.520858 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-be0e234c-99fd-4272-94ab-4dc38058646f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:18.538349 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1222/2450] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:36:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:36:18.539844 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bfbffb-3a42-4d5e-9757-d70fb7bfd301 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:18.562341 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bfbffb-3a42-4d5e-9757-d70fb7bfd301 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:18.575171 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adef6a00-f8ac-4162-8c6c-2fb611640425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:18.575771 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef6a00-f8ac-4162-8c6c-2fb611640425 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:18.576086 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef6a00-f8ac-4162-8c6c-2fb611640425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:18.577441 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef6a00-f8ac-4162-8c6c-2fb611640425 admin admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:18.578271 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adef6a00-f8ac-4162-8c6c-2fb611640425 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:36:18.578892 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adef6a00-f8ac-4162-8c6c-2fb611640425 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:18.580772 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adef6a00-f8ac-4162-8c6c-2fb611640425 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:18.603727 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1229/2451] 10.222.0.91 () {58 vars in 1153 bytes} [Tue Aug 30 04:36:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:36:18.605717 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e234c-99fd-4272-94ab-4dc38058646f None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:18.653457 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e234c-99fd-4272-94ab-4dc38058646f None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:18.668309 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a748c35-39d2-487d-89e7-791b4da59993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:18.669830 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a748c35-39d2-487d-89e7-791b4da59993 admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:18.670606 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a748c35-39d2-487d-89e7-791b4da59993 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:18.671319 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a748c35-39d2-487d-89e7-791b4da59993 admin admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:18.672819 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a748c35-39d2-487d-89e7-791b4da59993 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:18.678195 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a748c35-39d2-487d-89e7-791b4da59993 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:18.767898 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1223/2452] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:36:18 2022] POST /identity/v3/projects => generated 369 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:36:18.773288 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adef6a00-f8ac-4162-8c6c-2fb611640425 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:18.787708 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adef6a00-f8ac-4162-8c6c-2fb611640425 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:18.823556 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:18.938555 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b43d11-1ba6-47aa-ac96-581c18432793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:18.939265 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b43d11-1ba6-47aa-ac96-581c18432793 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:18.939535 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b43d11-1ba6-47aa-ac96-581c18432793 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:18.940016 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b43d11-1ba6-47aa-ac96-581c18432793 admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:18.941587 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b43d11-1ba6-47aa-ac96-581c18432793 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:18.944724 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b43d11-1ba6-47aa-ac96-581c18432793 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:18.979752 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a748c35-39d2-487d-89e7-791b4da59993 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:18.983799 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-3a748c35-39d2-487d-89e7-791b4da59993 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:19.003028 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1230/2453] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:36:18 2022] POST /identity/v3/users => generated 285 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:36:19.005592 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a748c35-39d2-487d-89e7-791b4da59993 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:19.013242 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b43d11-1ba6-47aa-ac96-581c18432793 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:19.031508 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e003eea1-6651-40a3-a555-e222e792e99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:19.032233 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003eea1-6651-40a3-a555-e222e792e99d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:19.032505 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003eea1-6651-40a3-a555-e222e792e99d admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:19.032772 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003eea1-6651-40a3-a555-e222e792e99d admin admin] PATH_INFO: `/v3/projects/364851cacd74461699aecdd9c1380186` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:19.035143 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e003eea1-6651-40a3-a555-e222e792e99d admin admin] RBAC: Authorizing `identity:delete_project(project_id=364851cacd74461699aecdd9c1380186)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:19.040036 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e003eea1-6651-40a3-a555-e222e792e99d admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:19.046717 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b43d11-1ba6-47aa-ac96-581c18432793 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:19.066180 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee664e2-d2b4-4ff3-afad-cfc506a9eb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:19.069254 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee664e2-d2b4-4ff3-afad-cfc506a9eb6a admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:19.069254 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee664e2-d2b4-4ff3-afad-cfc506a9eb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:19.069865 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee664e2-d2b4-4ff3-afad-cfc506a9eb6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:19.070698 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee664e2-d2b4-4ff3-afad-cfc506a9eb6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:19.072768 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee664e2-d2b4-4ff3-afad-cfc506a9eb6a admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:19.108517 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1231/2454] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:36:19 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:36:19.111119 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee664e2-d2b4-4ff3-afad-cfc506a9eb6a admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:19.129552 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee664e2-d2b4-4ff3-afad-cfc506a9eb6a admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:19.145482 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9af520-46b5-40bc-8247-9173c6259545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:19.146199 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9af520-46b5-40bc-8247-9173c6259545 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:19.146483 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9af520-46b5-40bc-8247-9173c6259545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:19.147943 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9af520-46b5-40bc-8247-9173c6259545 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:19.149590 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9af520-46b5-40bc-8247-9173c6259545 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:19.151343 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9af520-46b5-40bc-8247-9173c6259545 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:19.175617 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1232/2455] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:36:19 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:36:19.176784 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-e003eea1-6651-40a3-a555-e222e792e99d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '364851cacd74461699aecdd9c1380186', 'request_id': 'req-e003eea1-6651-40a3-a555-e222e792e99d'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:19.177976 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9af520-46b5-40bc-8247-9173c6259545 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:19.186802 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-e003eea1-6651-40a3-a555-e222e792e99d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '364851cacd74461699aecdd9c1380186', 'request_id': 'req-e003eea1-6651-40a3-a555-e222e792e99d'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:19.191354 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9af520-46b5-40bc-8247-9173c6259545 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:19.205256 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-e003eea1-6651-40a3-a555-e222e792e99d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '364851cacd74461699aecdd9c1380186', 'request_id': 'req-e003eea1-6651-40a3-a555-e222e792e99d'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:19.236929 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-e003eea1-6651-40a3-a555-e222e792e99d admin admin] The token cache is being invalidate because project 364851cacd74461699aecdd9c1380186 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:36:19.238961 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-e003eea1-6651-40a3-a555-e222e792e99d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:19.240463 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-e003eea1-6651-40a3-a555-e222e792e99d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:19.247237 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1224/2456] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:36:18 2022] DELETE /identity/v3/projects/364851cacd74461699aecdd9c1380186 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:36:19.252977 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e003eea1-6651-40a3-a555-e222e792e99d admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:19.258687 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-e003eea1-6651-40a3-a555-e222e792e99d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:19.355215 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:19.384229 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e8895e-2962-4427-b618-64016ead0e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:19.384229 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8895e-2962-4427-b618-64016ead0e19 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:19.385196 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8895e-2962-4427-b618-64016ead0e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:19.385196 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8895e-2962-4427-b618-64016ead0e19 admin admin] PATH_INFO: `/v3/projects/ad2ab634916340f6af005b2ef6edbf55/users/57da6464d4ea498bb39e8069ee786c8a/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:19.438960 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e8895e-2962-4427-b618-64016ead0e19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad2ab634916340f6af005b2ef6edbf55, user_id=57da6464d4ea498bb39e8069ee786c8a, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:19.460331 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e8895e-2962-4427-b618-64016ead0e19 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:19.468014 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e003eea1-6651-40a3-a555-e222e792e99d admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:19.493014 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebce5e9-80e0-4e7f-aefc-bcdea52f2e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:19.494805 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebce5e9-80e0-4e7f-aefc-bcdea52f2e51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:19.497114 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebce5e9-80e0-4e7f-aefc-bcdea52f2e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:19.498492 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebce5e9-80e0-4e7f-aefc-bcdea52f2e51 admin admin] PATH_INFO: `/v3/users/b35831acfb7f44cbbb5f3d05dc4d7a35` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:19.505292 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebce5e9-80e0-4e7f-aefc-bcdea52f2e51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b35831acfb7f44cbbb5f3d05dc4d7a35)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:19.508370 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1233/2457] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:36:19 2022] PUT /identity/v3/projects/ad2ab634916340f6af005b2ef6edbf55/users/57da6464d4ea498bb39e8069ee786c8a/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:36:19.511550 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebce5e9-80e0-4e7f-aefc-bcdea52f2e51 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:19.525528 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3eb66-0080-4aa0-8044-00b20cf6708c None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:19.526309 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3eb66-0080-4aa0-8044-00b20cf6708c None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:19.527365 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3eb66-0080-4aa0-8044-00b20cf6708c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:19.595509 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-bcc3eb66-0080-4aa0-8044-00b20cf6708c None None] MFA Rules not processed for user `57da6464d4ea498bb39e8069ee786c8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:36:19.600445 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-bcc3eb66-0080-4aa0-8044-00b20cf6708c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:19.660185 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-0ebce5e9-80e0-4e7f-aefc-bcdea52f2e51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b35831acfb7f44cbbb5f3d05dc4d7a35'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:19.665369 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-0ebce5e9-80e0-4e7f-aefc-bcdea52f2e51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b35831acfb7f44cbbb5f3d05dc4d7a35'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:19.666973 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-0ebce5e9-80e0-4e7f-aefc-bcdea52f2e51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b35831acfb7f44cbbb5f3d05dc4d7a35'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:19.698306 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-0ebce5e9-80e0-4e7f-aefc-bcdea52f2e51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b35831acfb7f44cbbb5f3d05dc4d7a35'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:19.718429 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-0ebce5e9-80e0-4e7f-aefc-bcdea52f2e51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b35831acfb7f44cbbb5f3d05dc4d7a35'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:19.743973 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1225/2458] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:36:19 2022] DELETE /identity/v3/users/b35831acfb7f44cbbb5f3d05dc4d7a35 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:36:19.790925 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:19.805086 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1234/2459] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:36:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:36:19.817498 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebce5e9-80e0-4e7f-aefc-bcdea52f2e51 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:19.819819 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-0ebce5e9-80e0-4e7f-aefc-bcdea52f2e51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:19.968985 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebce5e9-80e0-4e7f-aefc-bcdea52f2e51 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:19.977823 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3932d3e-e977-441b-b968-e00bae57c3f8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2e1344bc54bf388e5ec025ab94c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:19.979367 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3932d3e-e977-441b-b968-e00bae57c3f8 service glance] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:19.979935 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3932d3e-e977-441b-b968-e00bae57c3f8 service glance] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:19.980470 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3932d3e-e977-441b-b968-e00bae57c3f8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:20.194340 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3932d3e-e977-441b-b968-e00bae57c3f8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:20.202896 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3932d3e-e977-441b-b968-e00bae57c3f8 service glance] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:20.232383 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:20.265083 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1226/2460] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:36:19 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:36:20.552158 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc3eb66-0080-4aa0-8044-00b20cf6708c None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:20.558911 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-bcc3eb66-0080-4aa0-8044-00b20cf6708c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:20.851633 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc3eb66-0080-4aa0-8044-00b20cf6708c None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:21.038171 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b3272-920e-4d79-8f0b-320046a54983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:21.040150 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b3272-920e-4d79-8f0b-320046a54983 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:21.041163 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b3272-920e-4d79-8f0b-320046a54983 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:21.041896 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b3272-920e-4d79-8f0b-320046a54983 admin admin] PATH_INFO: `/v3/projects/53b6ae0b929e4c109dadf163eade9f3c` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:21.044482 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5b3272-920e-4d79-8f0b-320046a54983 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53b6ae0b929e4c109dadf163eade9f3c)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:21.048797 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5b3272-920e-4d79-8f0b-320046a54983 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:21.212890 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-4d5b3272-920e-4d79-8f0b-320046a54983 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53b6ae0b929e4c109dadf163eade9f3c', 'request_id': 'req-4d5b3272-920e-4d79-8f0b-320046a54983'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:21.228022 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-4d5b3272-920e-4d79-8f0b-320046a54983 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53b6ae0b929e4c109dadf163eade9f3c', 'request_id': 'req-4d5b3272-920e-4d79-8f0b-320046a54983'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:21.240774 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-4d5b3272-920e-4d79-8f0b-320046a54983 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53b6ae0b929e4c109dadf163eade9f3c', 'request_id': 'req-4d5b3272-920e-4d79-8f0b-320046a54983'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:21.286014 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-4d5b3272-920e-4d79-8f0b-320046a54983 admin admin] The token cache is being invalidate because project 53b6ae0b929e4c109dadf163eade9f3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:36:21.287286 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-4d5b3272-920e-4d79-8f0b-320046a54983 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:21.289759 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-4d5b3272-920e-4d79-8f0b-320046a54983 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:21.294274 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1235/2461] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:36:20 2022] DELETE /identity/v3/projects/53b6ae0b929e4c109dadf163eade9f3c => generated 0 bytes in 743 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:36:21.302435 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3bc02-e128-46fe-bd40-6bc8f924fb8c None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:21.304017 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3bc02-e128-46fe-bd40-6bc8f924fb8c None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:21.304017 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3bc02-e128-46fe-bd40-6bc8f924fb8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:21.347249 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-10b3bc02-e128-46fe-bd40-6bc8f924fb8c None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:36:21.350222 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-10b3bc02-e128-46fe-bd40-6bc8f924fb8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:21.441055 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb9847-2321-47b3-a61b-3371778086ca None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:21.441353 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb9847-2321-47b3-a61b-3371778086ca None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:21.441864 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb9847-2321-47b3-a61b-3371778086ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:21.445200 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1227/2462] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:36:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:36:21.514958 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-85cb9847-2321-47b3-a61b-3371778086ca None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:36:21.518828 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-85cb9847-2321-47b3-a61b-3371778086ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:21.563035 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1236/2463] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:36:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:36:21.568733 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3bc02-e128-46fe-bd40-6bc8f924fb8c None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:21.588394 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3bc02-e128-46fe-bd40-6bc8f924fb8c None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:21.595427 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd3f3b-dc74-4491-a22e-e843e36ef297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:21.596136 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd3f3b-dc74-4491-a22e-e843e36ef297 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:21.596668 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd3f3b-dc74-4491-a22e-e843e36ef297 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:21.597016 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd3f3b-dc74-4491-a22e-e843e36ef297 admin admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:21.597786 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdd3f3b-dc74-4491-a22e-e843e36ef297 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:36:21.598203 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdd3f3b-dc74-4491-a22e-e843e36ef297 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:21.600589 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdd3f3b-dc74-4491-a22e-e843e36ef297 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:21.624155 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1228/2464] 10.222.0.91 () {58 vars in 1153 bytes} [Tue Aug 30 04:36:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:36:21.629212 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb9847-2321-47b3-a61b-3371778086ca None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:21.665273 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb9847-2321-47b3-a61b-3371778086ca None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:21.682016 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48760276-950c-471e-9c4a-ca017515f404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:21.683827 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48760276-950c-471e-9c4a-ca017515f404 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:21.684845 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48760276-950c-471e-9c4a-ca017515f404 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:21.685666 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48760276-950c-471e-9c4a-ca017515f404 admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:21.687742 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48760276-950c-471e-9c4a-ca017515f404 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:21.693918 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48760276-950c-471e-9c4a-ca017515f404 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:21.776301 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1237/2465] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:36:21 2022] POST /identity/v3/projects => generated 371 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:36:21.782140 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd3f3b-dc74-4491-a22e-e843e36ef297 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:21.813428 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd3f3b-dc74-4491-a22e-e843e36ef297 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:21.964809 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da24f9-94c8-4fb0-b4c1-2c45a13c4816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:21.966044 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da24f9-94c8-4fb0-b4c1-2c45a13c4816 admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:21.966651 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da24f9-94c8-4fb0-b4c1-2c45a13c4816 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:21.967117 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da24f9-94c8-4fb0-b4c1-2c45a13c4816 admin admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:21.968229 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14da24f9-94c8-4fb0-b4c1-2c45a13c4816 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:21.972428 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14da24f9-94c8-4fb0-b4c1-2c45a13c4816 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:22.012380 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1229/2466] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:36:21 2022] POST /identity/v3/users => generated 286 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:36:22.018901 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48760276-950c-471e-9c4a-ca017515f404 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:22.057485 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48760276-950c-471e-9c4a-ca017515f404 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:22.069125 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de449039-fa60-4be3-af28-3a5335189b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:22.070433 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de449039-fa60-4be3-af28-3a5335189b98 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:22.071092 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de449039-fa60-4be3-af28-3a5335189b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:22.071944 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de449039-fa60-4be3-af28-3a5335189b98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:22.073722 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de449039-fa60-4be3-af28-3a5335189b98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:22.077405 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de449039-fa60-4be3-af28-3a5335189b98 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:22.082487 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:22.103602 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1238/2467] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:36:22 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:36:22.106511 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da24f9-94c8-4fb0-b4c1-2c45a13c4816 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:22.132005 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da24f9-94c8-4fb0-b4c1-2c45a13c4816 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:22.141616 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b165797c-2696-4713-aebc-61afc089d517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:22.142890 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165797c-2696-4713-aebc-61afc089d517 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:22.143303 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165797c-2696-4713-aebc-61afc089d517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:22.146741 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165797c-2696-4713-aebc-61afc089d517 admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:22.146741 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b165797c-2696-4713-aebc-61afc089d517 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:22.156297 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b165797c-2696-4713-aebc-61afc089d517 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:22.182293 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1230/2468] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:36:22 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:36:22.183248 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de449039-fa60-4be3-af28-3a5335189b98 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:22.204032 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de449039-fa60-4be3-af28-3a5335189b98 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:22.214667 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c9e797-28f4-4fbb-ab7f-5ab645054e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:22.217187 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9e797-28f4-4fbb-ab7f-5ab645054e68 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:22.218054 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9e797-28f4-4fbb-ab7f-5ab645054e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:22.218574 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9e797-28f4-4fbb-ab7f-5ab645054e68 admin admin] PATH_INFO: `/v3/projects/d2e1ae67fada4bd68398e3b997f7d40e/users/1204737db5754fbf995c3c5c6d71e5bb/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:22.249473 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c9e797-28f4-4fbb-ab7f-5ab645054e68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2e1ae67fada4bd68398e3b997f7d40e, user_id=1204737db5754fbf995c3c5c6d71e5bb, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:22.254979 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c9e797-28f4-4fbb-ab7f-5ab645054e68 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:22.280414 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1239/2469] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:36:22 2022] PUT /identity/v3/projects/d2e1ae67fada4bd68398e3b997f7d40e/users/1204737db5754fbf995c3c5c6d71e5bb/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:36:22.288516 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5097342e-77ac-46b8-b039-a2ec9f186656 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:22.289295 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5097342e-77ac-46b8-b039-a2ec9f186656 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:22.289668 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5097342e-77ac-46b8-b039-a2ec9f186656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:22.315264 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-5097342e-77ac-46b8-b039-a2ec9f186656 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:36:22.317325 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-5097342e-77ac-46b8-b039-a2ec9f186656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:22.453591 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1231/2470] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:36:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:36:22.466302 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c9e797-28f4-4fbb-ab7f-5ab645054e68 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:22.468931 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-f5c9e797-28f4-4fbb-ab7f-5ab645054e68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:22.589042 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c9e797-28f4-4fbb-ab7f-5ab645054e68 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:22.593927 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9ae047-1dcf-4db5-8628-aa1a171c8b75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:22.594891 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ae047-1dcf-4db5-8628-aa1a171c8b75 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:22.595174 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ae047-1dcf-4db5-8628-aa1a171c8b75 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:22.595451 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ae047-1dcf-4db5-8628-aa1a171c8b75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:22.618577 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9ae047-1dcf-4db5-8628-aa1a171c8b75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:22.620957 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9ae047-1dcf-4db5-8628-aa1a171c8b75 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:22.645550 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1240/2471] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:36:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:36:24.163343 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b73cf-1184-48ff-96a0-cd66adeab119 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:24.164836 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b73cf-1184-48ff-96a0-cd66adeab119 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:24.164836 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b73cf-1184-48ff-96a0-cd66adeab119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:24.185025 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:24.216372 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-509b73cf-1184-48ff-96a0-cd66adeab119 None None] MFA Rules not processed for user `1204737db5754fbf995c3c5c6d71e5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:36:24.218580 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-509b73cf-1184-48ff-96a0-cd66adeab119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:24.352147 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1232/2472] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:36:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:36:24.356275 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9ae047-1dcf-4db5-8628-aa1a171c8b75 service neutron] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:24.377861 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9ae047-1dcf-4db5-8628-aa1a171c8b75 service neutron] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:24.389064 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa762a-e8c2-4ac3-9fdb-7374f32da4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:24.391174 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa762a-e8c2-4ac3-9fdb-7374f32da4bd admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:24.391635 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa762a-e8c2-4ac3-9fdb-7374f32da4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:24.392117 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa762a-e8c2-4ac3-9fdb-7374f32da4bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:24.393263 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fa762a-e8c2-4ac3-9fdb-7374f32da4bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:24.398211 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fa762a-e8c2-4ac3-9fdb-7374f32da4bd admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:24.479149 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1241/2473] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:36:24 2022] POST /identity/v3/projects => generated 371 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:36:24.480916 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b73cf-1184-48ff-96a0-cd66adeab119 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:24.499225 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b73cf-1184-48ff-96a0-cd66adeab119 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:24.633970 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0896b95-6c0b-48ae-946e-e77c98bdd93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:24.634341 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0896b95-6c0b-48ae-946e-e77c98bdd93d admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:24.635541 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0896b95-6c0b-48ae-946e-e77c98bdd93d admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:24.635541 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0896b95-6c0b-48ae-946e-e77c98bdd93d admin admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:24.636760 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0896b95-6c0b-48ae-946e-e77c98bdd93d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:24.641031 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0896b95-6c0b-48ae-946e-e77c98bdd93d admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:24.694904 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1233/2474] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:36:24 2022] POST /identity/v3/users => generated 292 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:36:24.700700 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa762a-e8c2-4ac3-9fdb-7374f32da4bd admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:24.714511 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa762a-e8c2-4ac3-9fdb-7374f32da4bd admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:24.735474 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6f3998-1d61-48ca-aabb-b1334c188279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:24.738049 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f3998-1d61-48ca-aabb-b1334c188279 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:24.742014 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f3998-1d61-48ca-aabb-b1334c188279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:24.742014 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f3998-1d61-48ca-aabb-b1334c188279 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:24.744222 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6f3998-1d61-48ca-aabb-b1334c188279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:24.748452 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6f3998-1d61-48ca-aabb-b1334c188279 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:24.775768 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1242/2475] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:36:24 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:36:24.782584 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0896b95-6c0b-48ae-946e-e77c98bdd93d admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:24.807371 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0896b95-6c0b-48ae-946e-e77c98bdd93d admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:24.821284 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3517ea-688c-4162-af7e-24ee414847fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:24.832092 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3517ea-688c-4162-af7e-24ee414847fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:24.833155 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3517ea-688c-4162-af7e-24ee414847fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:24.838080 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3517ea-688c-4162-af7e-24ee414847fa admin admin] PATH_INFO: `/v3/projects/2307cda5292f4140acec7bba25d74a6a/users/c9392ee83139484c945289c02712719e/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:24.883575 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3517ea-688c-4162-af7e-24ee414847fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=2307cda5292f4140acec7bba25d74a6a, user_id=c9392ee83139484c945289c02712719e, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:24.887286 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3517ea-688c-4162-af7e-24ee414847fa admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:24.914767 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1234/2476] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:36:24 2022] PUT /identity/v3/projects/2307cda5292f4140acec7bba25d74a6a/users/c9392ee83139484c945289c02712719e/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:36:24.941212 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6f3998-1d61-48ca-aabb-b1334c188279 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:24.957849 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6f3998-1d61-48ca-aabb-b1334c188279 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:25.051281 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e71fd-8297-42d2-b483-0670103a1839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:25.052099 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e71fd-8297-42d2-b483-0670103a1839 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:25.052538 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e71fd-8297-42d2-b483-0670103a1839 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:25.052840 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e71fd-8297-42d2-b483-0670103a1839 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:25.053722 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586e71fd-8297-42d2-b483-0670103a1839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:25.055638 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586e71fd-8297-42d2-b483-0670103a1839 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:25.068572 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1243/2477] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:36:24 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:36:25.073813 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3517ea-688c-4162-af7e-24ee414847fa admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:25.086371 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3517ea-688c-4162-af7e-24ee414847fa admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:25.091414 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab239e5-be87-4d9b-b185-2afc5459b570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:25.092133 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab239e5-be87-4d9b-b185-2afc5459b570 admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:25.092457 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab239e5-be87-4d9b-b185-2afc5459b570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:25.092757 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab239e5-be87-4d9b-b185-2afc5459b570 admin admin] PATH_INFO: `/v3/projects/2307cda5292f4140acec7bba25d74a6a/users/c9392ee83139484c945289c02712719e/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:25.094899 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab239e5-be87-4d9b-b185-2afc5459b570 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2307cda5292f4140acec7bba25d74a6a, user_id=c9392ee83139484c945289c02712719e, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:25.098122 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab239e5-be87-4d9b-b185-2afc5459b570 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:25.116281 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1235/2478] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:36:25 2022] PUT /identity/v3/projects/2307cda5292f4140acec7bba25d74a6a/users/c9392ee83139484c945289c02712719e/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:36:26.336459 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa81767-229a-4e76-a902-971d8a1166a6 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:26.337352 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa81767-229a-4e76-a902-971d8a1166a6 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:26.337352 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa81767-229a-4e76-a902-971d8a1166a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:26.382370 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-7aa81767-229a-4e76-a902-971d8a1166a6 None None] MFA Rules not processed for user `c9392ee83139484c945289c02712719e`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:36:26.384059 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-7aa81767-229a-4e76-a902-971d8a1166a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:26.450385 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:26.551974 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1244/2479] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:36:26 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:36:26.562165 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8437e-1f1b-4f21-9cee-5e87301bad17 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:26.563100 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8437e-1f1b-4f21-9cee-5e87301bad17 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:26.563100 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8437e-1f1b-4f21-9cee-5e87301bad17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:26.597103 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-a3e8437e-1f1b-4f21-9cee-5e87301bad17 None None] MFA Rules not processed for user `1204737db5754fbf995c3c5c6d71e5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:36:26.598797 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-a3e8437e-1f1b-4f21-9cee-5e87301bad17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:26.691830 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:26.718395 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1236/2480] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:36:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:36:26.728220 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa81767-229a-4e76-a902-971d8a1166a6 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:26.730633 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-7aa81767-229a-4e76-a902-971d8a1166a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:26.873300 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa81767-229a-4e76-a902-971d8a1166a6 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:26.887401 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6bd431-f36f-4af4-851a-ac9e284c1fe5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd806295278ae4997b5c6968aa553290c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:26.888877 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6bd431-f36f-4af4-851a-ac9e284c1fe5 service nova] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:26.889438 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6bd431-f36f-4af4-851a-ac9e284c1fe5 service nova] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:26.890143 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6bd431-f36f-4af4-851a-ac9e284c1fe5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:26.907983 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6bd431-f36f-4af4-851a-ac9e284c1fe5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:26.911229 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6bd431-f36f-4af4-851a-ac9e284c1fe5 service nova] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:26.934426 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1245/2481] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:36:26 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:36:29.000793 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e8437e-1f1b-4f21-9cee-5e87301bad17 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:29.003871 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-a3e8437e-1f1b-4f21-9cee-5e87301bad17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:29.045144 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e8437e-1f1b-4f21-9cee-5e87301bad17 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:29.055789 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bdd201-9b6f-4d6d-9a74-5eb50a228595 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd806295278ae4997b5c6968aa553290c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:29.056949 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bdd201-9b6f-4d6d-9a74-5eb50a228595 service nova] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:29.057697 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bdd201-9b6f-4d6d-9a74-5eb50a228595 service nova] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:29.058424 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bdd201-9b6f-4d6d-9a74-5eb50a228595 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:29.062048 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-f5bdd201-9b6f-4d6d-9a74-5eb50a228595 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:29.094225 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bdd201-9b6f-4d6d-9a74-5eb50a228595 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:29.098052 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bdd201-9b6f-4d6d-9a74-5eb50a228595 service nova] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:29.142418 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1237/2482] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:36:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:36:29.571979 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6bd431-f36f-4af4-851a-ac9e284c1fe5 service nova] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:29.575277 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-0e6bd431-f36f-4af4-851a-ac9e284c1fe5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:29.721012 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6bd431-f36f-4af4-851a-ac9e284c1fe5 service nova] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:29.747595 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a61dd46-9d3c-44d2-bb87-3657b0e90b05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:29.752080 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a61dd46-9d3c-44d2-bb87-3657b0e90b05 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:29.752620 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a61dd46-9d3c-44d2-bb87-3657b0e90b05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:29.753076 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a61dd46-9d3c-44d2-bb87-3657b0e90b05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:29.763696 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-8a61dd46-9d3c-44d2-bb87-3657b0e90b05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:29.803765 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a61dd46-9d3c-44d2-bb87-3657b0e90b05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:29.806620 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a61dd46-9d3c-44d2-bb87-3657b0e90b05 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:29.822751 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1246/2483] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:36:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:36:30.165896 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6127e96-bfe0-4d38-9ac7-4625ced4810f None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:30.166776 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6127e96-bfe0-4d38-9ac7-4625ced4810f None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:30.166776 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6127e96-bfe0-4d38-9ac7-4625ced4810f None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:30.167868 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1238/2484] 10.222.0.91 () {54 vars in 921 bytes} [Tue Aug 30 04:36:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:36:30.178892 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0abf1f-f614-4b2c-9b86-f725f138e864 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:30.179196 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0abf1f-f614-4b2c-9b86-f725f138e864 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:30.179458 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0abf1f-f614-4b2c-9b86-f725f138e864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:30.224721 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-5f0abf1f-f614-4b2c-9b86-f725f138e864 None None] MFA Rules not processed for user `d806295278ae4997b5c6968aa553290c`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:36:30.227200 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-5f0abf1f-f614-4b2c-9b86-f725f138e864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:30.246013 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1247/2485] 10.222.0.91 () {58 vars in 1018 bytes} [Tue Aug 30 04:36:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:36:30.264991 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6127e96-bfe0-4d38-9ac7-4625ced4810f None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:30.268244 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-a6127e96-bfe0-4d38-9ac7-4625ced4810f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:30.405221 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6127e96-bfe0-4d38-9ac7-4625ced4810f None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:30.417762 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c7beb-f5ef-4d37-b235-244688ebc18d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2e1344bc54bf388e5ec025ab94c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:30.419134 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c7beb-f5ef-4d37-b235-244688ebc18d service glance] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:30.419903 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c7beb-f5ef-4d37-b235-244688ebc18d service glance] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:30.420574 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c7beb-f5ef-4d37-b235-244688ebc18d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:30.442043 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72c7beb-f5ef-4d37-b235-244688ebc18d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:30.445551 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72c7beb-f5ef-4d37-b235-244688ebc18d service glance] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:30.473184 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1239/2486] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:36:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:36:30.657676 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91228d-b267-42b4-8387-79f320539625 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:30.658570 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91228d-b267-42b4-8387-79f320539625 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:30.659010 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91228d-b267-42b4-8387-79f320539625 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:30.662629 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1248/2487] 10.222.0.91 () {54 vars in 921 bytes} [Tue Aug 30 04:36:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:36:30.674319 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b0b38-c81a-43f8-987c-dd510420c7ad None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:30.674841 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b0b38-c81a-43f8-987c-dd510420c7ad None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:30.675300 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b0b38-c81a-43f8-987c-dd510420c7ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:30.715155 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-7c3b0b38-c81a-43f8-987c-dd510420c7ad None None] MFA Rules not processed for user `1c05f49ae42b4f9583ff10b2cfce52a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:36:30.716566 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-7c3b0b38-c81a-43f8-987c-dd510420c7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:30.736314 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1240/2488] 10.222.0.91 () {58 vars in 1018 bytes} [Tue Aug 30 04:36:30 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:36:30.760815 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b91228d-b267-42b4-8387-79f320539625 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:30.796481 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b91228d-b267-42b4-8387-79f320539625 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:30.807383 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a2ceb-d9e1-4b8a-b3b7-84dd0edd6f75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:30.809513 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a2ceb-d9e1-4b8a-b3b7-84dd0edd6f75 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:30.810419 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a2ceb-d9e1-4b8a-b3b7-84dd0edd6f75 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:30.811334 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a2ceb-d9e1-4b8a-b3b7-84dd0edd6f75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:30.826989 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66a2ceb-d9e1-4b8a-b3b7-84dd0edd6f75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:30.831074 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66a2ceb-d9e1-4b8a-b3b7-84dd0edd6f75 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:30.847437 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1249/2489] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:36:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:36:31.034824 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5458e315-39f9-4ff1-9b5c-01c2cc9b2e72 None None] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:31.035632 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5458e315-39f9-4ff1-9b5c-01c2cc9b2e72 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:31.036244 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5458e315-39f9-4ff1-9b5c-01c2cc9b2e72 None None] PATH_INFO: `/` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:31.039999 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1241/2490] 10.222.0.91 () {54 vars in 921 bytes} [Tue Aug 30 04:36:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:36:31.050524 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61de35-e67d-4418-99a8-fb35ccac62d2 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:31.051647 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61de35-e67d-4418-99a8-fb35ccac62d2 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:31.051647 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61de35-e67d-4418-99a8-fb35ccac62d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:31.088903 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-cd61de35-e67d-4418-99a8-fb35ccac62d2 None None] MFA Rules not processed for user `d806295278ae4997b5c6968aa553290c`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:36:31.090254 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-cd61de35-e67d-4418-99a8-fb35ccac62d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:31.110697 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1250/2491] 10.222.0.91 () {58 vars in 1018 bytes} [Tue Aug 30 04:36:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:36:31.117149 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5458e315-39f9-4ff1-9b5c-01c2cc9b2e72 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:31.137647 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5458e315-39f9-4ff1-9b5c-01c2cc9b2e72 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:31.150694 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faf82b9-cff1-4d61-8451-5e112b4c7bc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:31.151584 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf82b9-cff1-4d61-8451-5e112b4c7bc9 service neutron] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:31.152045 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf82b9-cff1-4d61-8451-5e112b4c7bc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:31.154988 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf82b9-cff1-4d61-8451-5e112b4c7bc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:31.192968 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faf82b9-cff1-4d61-8451-5e112b4c7bc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:31.195735 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faf82b9-cff1-4d61-8451-5e112b4c7bc9 service neutron] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:31.215643 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1242/2492] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:36:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:36:35.539462 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb27cfd-dca1-4534-a239-fd0f1e0fb114 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:35.540213 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb27cfd-dca1-4534-a239-fd0f1e0fb114 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:35.540213 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb27cfd-dca1-4534-a239-fd0f1e0fb114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:35.579940 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-0bb27cfd-dca1-4534-a239-fd0f1e0fb114 None None] MFA Rules not processed for user `1bc12faf48984335a3515dcde85b5cb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:36:35.581805 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-0bb27cfd-dca1-4534-a239-fd0f1e0fb114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:35.640932 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:35.729640 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1251/2493] 10.222.0.91 () {58 vars in 1009 bytes} [Tue Aug 30 04:36:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:36:35.753163 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faf82b9-cff1-4d61-8451-5e112b4c7bc9 service neutron] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:35.757526 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-3faf82b9-cff1-4d61-8451-5e112b4c7bc9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:35.908400 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faf82b9-cff1-4d61-8451-5e112b4c7bc9 service neutron] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:35.918295 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916fd2e-33b1-4525-8ed8-29413899c512 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b50f9552124b07822ae63c1d553864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:35.919322 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916fd2e-33b1-4525-8ed8-29413899c512 service swift] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:35.919801 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916fd2e-33b1-4525-8ed8-29413899c512 service swift] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:35.920339 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916fd2e-33b1-4525-8ed8-29413899c512 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:35.936297 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1916fd2e-33b1-4525-8ed8-29413899c512 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:35.940011 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1916fd2e-33b1-4525-8ed8-29413899c512 service swift] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:35.959296 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1243/2494] 10.222.0.91 () {60 vars in 1384 bytes} [Tue Aug 30 04:36:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:36:45.380544 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb27cfd-dca1-4534-a239-fd0f1e0fb114 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:45.383110 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-0bb27cfd-dca1-4534-a239-fd0f1e0fb114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:45.498820 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb27cfd-dca1-4534-a239-fd0f1e0fb114 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:45.510473 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc3efc8-c4dd-4713-ac6c-d8505a1d7d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:45.511180 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3efc8-c4dd-4713-ac6c-d8505a1d7d4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:45.511461 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3efc8-c4dd-4713-ac6c-d8505a1d7d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:45.511766 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3efc8-c4dd-4713-ac6c-d8505a1d7d4a admin admin] PATH_INFO: `/v3/users/57da6464d4ea498bb39e8069ee786c8a` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:45.513603 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc3efc8-c4dd-4713-ac6c-d8505a1d7d4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=57da6464d4ea498bb39e8069ee786c8a)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:45.515706 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc3efc8-c4dd-4713-ac6c-d8505a1d7d4a admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:45.580196 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-9bc3efc8-c4dd-4713-ac6c-d8505a1d7d4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57da6464d4ea498bb39e8069ee786c8a'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:45.591005 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-9bc3efc8-c4dd-4713-ac6c-d8505a1d7d4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57da6464d4ea498bb39e8069ee786c8a'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:45.603858 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-9bc3efc8-c4dd-4713-ac6c-d8505a1d7d4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57da6464d4ea498bb39e8069ee786c8a'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:45.605019 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-9bc3efc8-c4dd-4713-ac6c-d8505a1d7d4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57da6464d4ea498bb39e8069ee786c8a'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:45.629143 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-9bc3efc8-c4dd-4713-ac6c-d8505a1d7d4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57da6464d4ea498bb39e8069ee786c8a'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:45.637837 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1252/2495] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:36:45 2022] DELETE /identity/v3/users/57da6464d4ea498bb39e8069ee786c8a => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:36:45.643611 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212850d-938e-4a0f-935a-51400136d71e None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:45.645529 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212850d-938e-4a0f-935a-51400136d71e None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:45.645950 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212850d-938e-4a0f-935a-51400136d71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:45.670324 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-e212850d-938e-4a0f-935a-51400136d71e None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:36:45.672966 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-e212850d-938e-4a0f-935a-51400136d71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:45.743750 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:45.760657 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1244/2496] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:36:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:36:45.771766 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc3efc8-c4dd-4713-ac6c-d8505a1d7d4a admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:45.774088 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-9bc3efc8-c4dd-4713-ac6c-d8505a1d7d4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:45.872885 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc3efc8-c4dd-4713-ac6c-d8505a1d7d4a admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:45.886016 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6921b-f77d-4c00-9662-ad2c2844e2ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:45.887879 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6921b-f77d-4c00-9662-ad2c2844e2ff service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:45.888411 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6921b-f77d-4c00-9662-ad2c2844e2ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:45.888976 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6921b-f77d-4c00-9662-ad2c2844e2ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:45.898777 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:45.905560 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f6921b-f77d-4c00-9662-ad2c2844e2ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:45.908761 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f6921b-f77d-4c00-9662-ad2c2844e2ff service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:45.931148 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1253/2497] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:36:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:36:46.457062 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e212850d-938e-4a0f-935a-51400136d71e None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:46.460991 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-e212850d-938e-4a0f-935a-51400136d71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:46.484665 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e212850d-938e-4a0f-935a-51400136d71e None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:46.491049 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2ba99-4c71-4cfb-b4db-a93402c795a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:46.492386 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2ba99-4c71-4cfb-b4db-a93402c795a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:46.492386 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2ba99-4c71-4cfb-b4db-a93402c795a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:46.493020 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2ba99-4c71-4cfb-b4db-a93402c795a1 admin admin] PATH_INFO: `/v3/projects/ad2ab634916340f6af005b2ef6edbf55` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:46.494513 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa2ba99-4c71-4cfb-b4db-a93402c795a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad2ab634916340f6af005b2ef6edbf55)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:46.497468 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa2ba99-4c71-4cfb-b4db-a93402c795a1 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:46.559546 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-5fa2ba99-4c71-4cfb-b4db-a93402c795a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad2ab634916340f6af005b2ef6edbf55', 'request_id': 'req-5fa2ba99-4c71-4cfb-b4db-a93402c795a1'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:46.573242 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-5fa2ba99-4c71-4cfb-b4db-a93402c795a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad2ab634916340f6af005b2ef6edbf55', 'request_id': 'req-5fa2ba99-4c71-4cfb-b4db-a93402c795a1'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:46.587820 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-5fa2ba99-4c71-4cfb-b4db-a93402c795a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad2ab634916340f6af005b2ef6edbf55', 'request_id': 'req-5fa2ba99-4c71-4cfb-b4db-a93402c795a1'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:46.605497 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-5fa2ba99-4c71-4cfb-b4db-a93402c795a1 admin admin] The token cache is being invalidate because project ad2ab634916340f6af005b2ef6edbf55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:36:46.605803 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-5fa2ba99-4c71-4cfb-b4db-a93402c795a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:46.606588 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-5fa2ba99-4c71-4cfb-b4db-a93402c795a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:46.608332 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1245/2498] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:36:46 2022] DELETE /identity/v3/projects/ad2ab634916340f6af005b2ef6edbf55 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:36:46.613885 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee05af-ff89-4bcd-919d-57b182a7bf2e None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:46.614539 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee05af-ff89-4bcd-919d-57b182a7bf2e None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:46.614636 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee05af-ff89-4bcd-919d-57b182a7bf2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:46.639466 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-65ee05af-ff89-4bcd-919d-57b182a7bf2e None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:36:46.641263 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-65ee05af-ff89-4bcd-919d-57b182a7bf2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:46.720322 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1254/2499] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:36:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:36:46.730638 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7477fb5-db3f-4c4b-9472-700622ae5094 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:46.731323 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7477fb5-db3f-4c4b-9472-700622ae5094 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:46.731323 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7477fb5-db3f-4c4b-9472-700622ae5094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:46.755441 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-b7477fb5-db3f-4c4b-9472-700622ae5094 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:36:46.757500 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-b7477fb5-db3f-4c4b-9472-700622ae5094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:46.765820 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1246/2500] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:36:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:36:46.770443 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee05af-ff89-4bcd-919d-57b182a7bf2e None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:46.782486 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee05af-ff89-4bcd-919d-57b182a7bf2e None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:46.788976 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d0364-cd56-4d9e-9933-30f391c6fc8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:46.790086 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d0364-cd56-4d9e-9933-30f391c6fc8b admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:46.790405 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d0364-cd56-4d9e-9933-30f391c6fc8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:46.790697 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d0364-cd56-4d9e-9933-30f391c6fc8b admin admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:46.791388 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65d0364-cd56-4d9e-9933-30f391c6fc8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:36:46.791694 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65d0364-cd56-4d9e-9933-30f391c6fc8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:46.793427 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65d0364-cd56-4d9e-9933-30f391c6fc8b admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:46.808537 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1255/2501] 10.222.0.91 () {58 vars in 1153 bytes} [Tue Aug 30 04:36:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:36:46.813897 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7477fb5-db3f-4c4b-9472-700622ae5094 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:46.829012 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7477fb5-db3f-4c4b-9472-700622ae5094 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:46.836073 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971aff83-b37d-4f86-8296-ed37a329bc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:46.836839 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971aff83-b37d-4f86-8296-ed37a329bc7e admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:46.837113 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971aff83-b37d-4f86-8296-ed37a329bc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:46.837382 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971aff83-b37d-4f86-8296-ed37a329bc7e admin admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:46.838092 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971aff83-b37d-4f86-8296-ed37a329bc7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:46.840823 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971aff83-b37d-4f86-8296-ed37a329bc7e admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:46.886307 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1247/2502] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:36:46 2022] POST /identity/v3/projects => generated 373 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:36:46.888473 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d0364-cd56-4d9e-9933-30f391c6fc8b admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:46.901258 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d0364-cd56-4d9e-9933-30f391c6fc8b admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:47.020467 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d38121-6a6d-4729-be7c-7764cc9e76e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:47.021756 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d38121-6a6d-4729-be7c-7764cc9e76e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:47.022086 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d38121-6a6d-4729-be7c-7764cc9e76e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:47.022408 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d38121-6a6d-4729-be7c-7764cc9e76e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:47.022992 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d38121-6a6d-4729-be7c-7764cc9e76e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:47.025369 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d38121-6a6d-4729-be7c-7764cc9e76e2 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:47.062746 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1256/2503] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:36:46 2022] POST /identity/v3/users => generated 287 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:36:47.070261 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971aff83-b37d-4f86-8296-ed37a329bc7e admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:47.085626 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971aff83-b37d-4f86-8296-ed37a329bc7e admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:47.092379 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf6895-e8bd-4be3-8c08-a9c126e1d5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:47.092379 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf6895-e8bd-4be3-8c08-a9c126e1d5e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:47.092379 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf6895-e8bd-4be3-8c08-a9c126e1d5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:47.093015 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf6895-e8bd-4be3-8c08-a9c126e1d5e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:47.093314 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bf6895-e8bd-4be3-8c08-a9c126e1d5e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:47.095620 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bf6895-e8bd-4be3-8c08-a9c126e1d5e4 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:47.111858 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1248/2504] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:36:47 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:36:47.117287 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d38121-6a6d-4729-be7c-7764cc9e76e2 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:47.129637 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d38121-6a6d-4729-be7c-7764cc9e76e2 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:47.137455 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd09fb90-7236-47b1-917b-bf1d99034c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:47.138140 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09fb90-7236-47b1-917b-bf1d99034c2f admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:47.138441 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09fb90-7236-47b1-917b-bf1d99034c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:47.138766 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09fb90-7236-47b1-917b-bf1d99034c2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:47.139485 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd09fb90-7236-47b1-917b-bf1d99034c2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:47.141345 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd09fb90-7236-47b1-917b-bf1d99034c2f admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:47.168999 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1257/2505] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:36:47 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:36:47.171236 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf6895-e8bd-4be3-8c08-a9c126e1d5e4 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:47.192068 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf6895-e8bd-4be3-8c08-a9c126e1d5e4 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:47.201248 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6235576b-5ce5-48a5-a622-194e6cac4efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:47.202553 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6235576b-5ce5-48a5-a622-194e6cac4efd admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:47.203022 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6235576b-5ce5-48a5-a622-194e6cac4efd admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:47.203484 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6235576b-5ce5-48a5-a622-194e6cac4efd admin admin] PATH_INFO: `/v3/projects/03f2acdbb91f40f18db8a170b5ab9858/users/851c1741fc9948c780ae0e473ce1bf3e/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:47.233868 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6235576b-5ce5-48a5-a622-194e6cac4efd admin admin] RBAC: Authorizing `identity:create_grant(project_id=03f2acdbb91f40f18db8a170b5ab9858, user_id=851c1741fc9948c780ae0e473ce1bf3e, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:47.241175 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6235576b-5ce5-48a5-a622-194e6cac4efd admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:47.271987 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1249/2506] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:36:47 2022] PUT /identity/v3/projects/03f2acdbb91f40f18db8a170b5ab9858/users/851c1741fc9948c780ae0e473ce1bf3e/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:36:47.284311 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b403a2-84c0-4983-9719-2833ee11ac2c None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:47.284744 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b403a2-84c0-4983-9719-2833ee11ac2c None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:47.285156 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b403a2-84c0-4983-9719-2833ee11ac2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:47.338223 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-c6b403a2-84c0-4983-9719-2833ee11ac2c None None] MFA Rules not processed for user `851c1741fc9948c780ae0e473ce1bf3e`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:36:47.340198 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-c6b403a2-84c0-4983-9719-2833ee11ac2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:47.410844 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:47.447702 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1258/2507] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:36:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:36:47.461813 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6235576b-5ce5-48a5-a622-194e6cac4efd admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:47.464746 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-6235576b-5ce5-48a5-a622-194e6cac4efd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:47.555471 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6235576b-5ce5-48a5-a622-194e6cac4efd admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:47.560039 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d14cadf-5f85-438a-91b8-f032eaf3314d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:47.560945 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d14cadf-5f85-438a-91b8-f032eaf3314d service cinder] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:47.561345 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d14cadf-5f85-438a-91b8-f032eaf3314d service cinder] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:47.561792 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d14cadf-5f85-438a-91b8-f032eaf3314d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:47.577486 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d14cadf-5f85-438a-91b8-f032eaf3314d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:47.580348 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d14cadf-5f85-438a-91b8-f032eaf3314d service cinder] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:47.592814 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1250/2508] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:36:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:36:50.589657 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b403a2-84c0-4983-9719-2833ee11ac2c None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:50.591215 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-c6b403a2-84c0-4983-9719-2833ee11ac2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:50.606699 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b403a2-84c0-4983-9719-2833ee11ac2c None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:50.611892 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c497661-24c5-4db1-ac7c-1179789e4e18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:50.612769 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c497661-24c5-4db1-ac7c-1179789e4e18 service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:50.613082 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c497661-24c5-4db1-ac7c-1179789e4e18 service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:50.613444 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c497661-24c5-4db1-ac7c-1179789e4e18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:50.617060 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-9c497661-24c5-4db1-ac7c-1179789e4e18 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:50.711366 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c497661-24c5-4db1-ac7c-1179789e4e18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:50.713453 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c497661-24c5-4db1-ac7c-1179789e4e18 service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:50.726343 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1259/2509] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:36:50 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:36:52.116833 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc3971-481e-448d-9e41-f6a1d0ec113b None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:52.117801 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc3971-481e-448d-9e41-f6a1d0ec113b None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:52.118082 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc3971-481e-448d-9e41-f6a1d0ec113b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:52.150654 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-7adc3971-481e-448d-9e41-f6a1d0ec113b None None] MFA Rules not processed for user `1bc12faf48984335a3515dcde85b5cb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:36:52.152076 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-7adc3971-481e-448d-9e41-f6a1d0ec113b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:52.165159 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:52.243433 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1251/2510] 10.222.0.91 () {58 vars in 967 bytes} [Tue Aug 30 04:36:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:36:52.259107 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c497661-24c5-4db1-ac7c-1179789e4e18 service cinder] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:52.260896 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-9c497661-24c5-4db1-ac7c-1179789e4e18 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:52.391121 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c497661-24c5-4db1-ac7c-1179789e4e18 service cinder] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:52.399052 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff5b892-9a25-4be2-87bb-728f88041aae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b50f9552124b07822ae63c1d553864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:52.399779 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5b892-9a25-4be2-87bb-728f88041aae service swift] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:52.400081 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5b892-9a25-4be2-87bb-728f88041aae service swift] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:52.400358 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5b892-9a25-4be2-87bb-728f88041aae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:52.410004 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff5b892-9a25-4be2-87bb-728f88041aae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:52.412242 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff5b892-9a25-4be2-87bb-728f88041aae service swift] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:52.423047 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1260/2511] 10.222.0.91 () {60 vars in 1384 bytes} [Tue Aug 30 04:36:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:36:59.719257 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adc3971-481e-448d-9e41-f6a1d0ec113b None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:59.818945 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adc3971-481e-448d-9e41-f6a1d0ec113b None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:59.825501 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada3ed97-d808-45be-86ae-d750a1d64eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:59.826166 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3ed97-d808-45be-86ae-d750a1d64eb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:59.826466 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3ed97-d808-45be-86ae-d750a1d64eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:59.826773 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3ed97-d808-45be-86ae-d750a1d64eb5 admin admin] PATH_INFO: `/v3/users/851c1741fc9948c780ae0e473ce1bf3e` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:59.828188 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada3ed97-d808-45be-86ae-d750a1d64eb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=851c1741fc9948c780ae0e473ce1bf3e)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:59.830187 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada3ed97-d808-45be-86ae-d750a1d64eb5 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:59.894190 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-ada3ed97-d808-45be-86ae-d750a1d64eb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '851c1741fc9948c780ae0e473ce1bf3e'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:59.896129 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-ada3ed97-d808-45be-86ae-d750a1d64eb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '851c1741fc9948c780ae0e473ce1bf3e'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:59.900437 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-ada3ed97-d808-45be-86ae-d750a1d64eb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '851c1741fc9948c780ae0e473ce1bf3e'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:59.911487 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-ada3ed97-d808-45be-86ae-d750a1d64eb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '851c1741fc9948c780ae0e473ce1bf3e'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:59.929251 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-ada3ed97-d808-45be-86ae-d750a1d64eb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '851c1741fc9948c780ae0e473ce1bf3e'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:59.948946 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1252/2512] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:36:59 2022] DELETE /identity/v3/users/851c1741fc9948c780ae0e473ce1bf3e => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:36:59.958559 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb5ad3d-0a73-40e5-9ded-6f3f12f44e59 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:59.958559 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb5ad3d-0a73-40e5-9ded-6f3f12f44e59 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:59.958559 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb5ad3d-0a73-40e5-9ded-6f3f12f44e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:59.992660 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-4cb5ad3d-0a73-40e5-9ded-6f3f12f44e59 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:36:59.994848 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-4cb5ad3d-0a73-40e5-9ded-6f3f12f44e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:00.106815 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1261/2513] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:36:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:37:00.124149 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada3ed97-d808-45be-86ae-d750a1d64eb5 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:00.127614 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-ada3ed97-d808-45be-86ae-d750a1d64eb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:00.215652 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:00.244943 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada3ed97-d808-45be-86ae-d750a1d64eb5 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:00.249582 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c50191-2bf4-4f9b-94ee-c6ce6403c057 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:00.250411 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c50191-2bf4-4f9b-94ee-c6ce6403c057 service neutron] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:00.250712 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c50191-2bf4-4f9b-94ee-c6ce6403c057 service neutron] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:00.250982 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c50191-2bf4-4f9b-94ee-c6ce6403c057 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:00.262818 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c50191-2bf4-4f9b-94ee-c6ce6403c057 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:00.264355 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c50191-2bf4-4f9b-94ee-c6ce6403c057 service neutron] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:00.276644 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1253/2514] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:37:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:37:00.659110 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb5ad3d-0a73-40e5-9ded-6f3f12f44e59 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:00.661820 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-4cb5ad3d-0a73-40e5-9ded-6f3f12f44e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:00.683896 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb5ad3d-0a73-40e5-9ded-6f3f12f44e59 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:00.692020 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334c0b12-c9dc-4cca-89f9-c4c0b03f95ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:00.693052 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c0b12-c9dc-4cca-89f9-c4c0b03f95ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:00.693672 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c0b12-c9dc-4cca-89f9-c4c0b03f95ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:00.694044 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c0b12-c9dc-4cca-89f9-c4c0b03f95ac admin admin] PATH_INFO: `/v3/projects/03f2acdbb91f40f18db8a170b5ab9858` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:00.696273 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334c0b12-c9dc-4cca-89f9-c4c0b03f95ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=03f2acdbb91f40f18db8a170b5ab9858)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:00.700046 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334c0b12-c9dc-4cca-89f9-c4c0b03f95ac admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:00.716284 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:00.777433 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-334c0b12-c9dc-4cca-89f9-c4c0b03f95ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03f2acdbb91f40f18db8a170b5ab9858', 'request_id': 'req-334c0b12-c9dc-4cca-89f9-c4c0b03f95ac'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:00.784225 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-334c0b12-c9dc-4cca-89f9-c4c0b03f95ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03f2acdbb91f40f18db8a170b5ab9858', 'request_id': 'req-334c0b12-c9dc-4cca-89f9-c4c0b03f95ac'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:00.790658 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-334c0b12-c9dc-4cca-89f9-c4c0b03f95ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03f2acdbb91f40f18db8a170b5ab9858', 'request_id': 'req-334c0b12-c9dc-4cca-89f9-c4c0b03f95ac'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:00.805665 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-334c0b12-c9dc-4cca-89f9-c4c0b03f95ac admin admin] The token cache is being invalidate because project 03f2acdbb91f40f18db8a170b5ab9858 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:37:00.805935 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-334c0b12-c9dc-4cca-89f9-c4c0b03f95ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:00.806590 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-334c0b12-c9dc-4cca-89f9-c4c0b03f95ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:00.808246 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1262/2515] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:37:00 2022] DELETE /identity/v3/projects/03f2acdbb91f40f18db8a170b5ab9858 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:37:00.813537 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccfdbd7-b3a2-4422-b9f4-38344618cdb4 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:00.814133 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccfdbd7-b3a2-4422-b9f4-38344618cdb4 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:00.814133 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccfdbd7-b3a2-4422-b9f4-38344618cdb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:00.838442 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-4ccfdbd7-b3a2-4422-b9f4-38344618cdb4 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:37:00.839754 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-4ccfdbd7-b3a2-4422-b9f4-38344618cdb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:00.920362 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1254/2516] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:37:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:37:00.936126 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd54e6-32c4-48d3-a47a-7128c6452f58 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:00.936622 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd54e6-32c4-48d3-a47a-7128c6452f58 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:00.937101 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd54e6-32c4-48d3-a47a-7128c6452f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:00.970661 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-03cd54e6-32c4-48d3-a47a-7128c6452f58 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:37:00.973020 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-03cd54e6-32c4-48d3-a47a-7128c6452f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:00.986877 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1263/2517] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:37:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:37:00.992213 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccfdbd7-b3a2-4422-b9f4-38344618cdb4 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:01.004190 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccfdbd7-b3a2-4422-b9f4-38344618cdb4 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:01.010981 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf306a-014e-4de6-a316-7b07bd32d657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:01.011720 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf306a-014e-4de6-a316-7b07bd32d657 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:01.012156 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf306a-014e-4de6-a316-7b07bd32d657 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:01.012539 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf306a-014e-4de6-a316-7b07bd32d657 admin admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:01.013332 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf306a-014e-4de6-a316-7b07bd32d657 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:37:01.013679 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf306a-014e-4de6-a316-7b07bd32d657 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:01.015539 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf306a-014e-4de6-a316-7b07bd32d657 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:01.031088 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1255/2518] 10.222.0.91 () {58 vars in 1153 bytes} [Tue Aug 30 04:37:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:37:01.036499 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cd54e6-32c4-48d3-a47a-7128c6452f58 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:01.048536 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cd54e6-32c4-48d3-a47a-7128c6452f58 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:01.055949 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07f1e1b-dbcb-4e0d-a8a3-e2681f2f9b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:01.056544 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f1e1b-dbcb-4e0d-a8a3-e2681f2f9b7f admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:01.056828 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f1e1b-dbcb-4e0d-a8a3-e2681f2f9b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:01.057104 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f1e1b-dbcb-4e0d-a8a3-e2681f2f9b7f admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:01.057771 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07f1e1b-dbcb-4e0d-a8a3-e2681f2f9b7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:01.059856 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07f1e1b-dbcb-4e0d-a8a3-e2681f2f9b7f admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:01.095847 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1264/2519] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:37:01 2022] POST /identity/v3/projects => generated 399 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:37:01.101112 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf306a-014e-4de6-a316-7b07bd32d657 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:01.112809 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf306a-014e-4de6-a316-7b07bd32d657 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:01.202188 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621588e8-b39f-4327-ba17-7fd54704d13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:01.203084 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621588e8-b39f-4327-ba17-7fd54704d13c admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:01.203499 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621588e8-b39f-4327-ba17-7fd54704d13c admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:01.203943 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621588e8-b39f-4327-ba17-7fd54704d13c admin admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:01.204736 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621588e8-b39f-4327-ba17-7fd54704d13c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:01.206904 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621588e8-b39f-4327-ba17-7fd54704d13c admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:01.237239 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1256/2520] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:37:01 2022] POST /identity/v3/users => generated 300 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:37:01.245424 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07f1e1b-dbcb-4e0d-a8a3-e2681f2f9b7f admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:01.258146 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07f1e1b-dbcb-4e0d-a8a3-e2681f2f9b7f admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:01.264500 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b20188-d343-4262-bb4a-6180bd9f3a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:01.265142 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b20188-d343-4262-bb4a-6180bd9f3a5e admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:01.265415 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b20188-d343-4262-bb4a-6180bd9f3a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:01.265686 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b20188-d343-4262-bb4a-6180bd9f3a5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:01.266349 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b20188-d343-4262-bb4a-6180bd9f3a5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:01.268033 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b20188-d343-4262-bb4a-6180bd9f3a5e admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:01.282602 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1265/2521] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:37:01 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:37:01.287744 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621588e8-b39f-4327-ba17-7fd54704d13c admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:01.304974 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621588e8-b39f-4327-ba17-7fd54704d13c admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:01.312410 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8922bee7-dd29-4308-ba39-4351afc439d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:01.313305 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922bee7-dd29-4308-ba39-4351afc439d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:01.313742 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922bee7-dd29-4308-ba39-4351afc439d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:01.314175 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922bee7-dd29-4308-ba39-4351afc439d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:01.315268 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8922bee7-dd29-4308-ba39-4351afc439d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:01.318153 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8922bee7-dd29-4308-ba39-4351afc439d2 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:01.337991 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1257/2522] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:37:01 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:37:01.343356 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b20188-d343-4262-bb4a-6180bd9f3a5e admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:01.358945 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b20188-d343-4262-bb4a-6180bd9f3a5e admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:01.367013 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2dad9-b053-4487-aff5-4fa9a2040cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:01.367859 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2dad9-b053-4487-aff5-4fa9a2040cc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:01.368416 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2dad9-b053-4487-aff5-4fa9a2040cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:01.368868 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2dad9-b053-4487-aff5-4fa9a2040cc0 admin admin] PATH_INFO: `/v3/projects/5608e710f3504bc4a5e42bf19f6b8bc8/users/879c20e5cf8245c096c4b2f5b59f7395/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:01.392684 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d2dad9-b053-4487-aff5-4fa9a2040cc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5608e710f3504bc4a5e42bf19f6b8bc8, user_id=879c20e5cf8245c096c4b2f5b59f7395, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:01.398413 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d2dad9-b053-4487-aff5-4fa9a2040cc0 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:01.426106 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1266/2523] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:37:01 2022] PUT /identity/v3/projects/5608e710f3504bc4a5e42bf19f6b8bc8/users/879c20e5cf8245c096c4b2f5b59f7395/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:37:01.447819 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e249a1-ab29-40d8-9711-38a0699317ac None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:01.448353 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e249a1-ab29-40d8-9711-38a0699317ac None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:01.448765 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e249a1-ab29-40d8-9711-38a0699317ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:01.492860 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-d2e249a1-ab29-40d8-9711-38a0699317ac None None] MFA Rules not processed for user `879c20e5cf8245c096c4b2f5b59f7395`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:37:01.494938 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-d2e249a1-ab29-40d8-9711-38a0699317ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:01.571054 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:01.630636 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1258/2524] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:37:01 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:37:01.646195 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2dad9-b053-4487-aff5-4fa9a2040cc0 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:01.648927 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-67d2dad9-b053-4487-aff5-4fa9a2040cc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:01.760579 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2dad9-b053-4487-aff5-4fa9a2040cc0 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:01.772735 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb6c83-9ba0-4722-ad2f-00e766a1c5a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:01.773376 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb6c83-9ba0-4722-ad2f-00e766a1c5a1 service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:01.773652 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb6c83-9ba0-4722-ad2f-00e766a1c5a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:01.773923 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb6c83-9ba0-4722-ad2f-00e766a1c5a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:01.784245 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb6c83-9ba0-4722-ad2f-00e766a1c5a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:01.785805 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb6c83-9ba0-4722-ad2f-00e766a1c5a1 service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:01.797080 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1267/2525] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:37:01 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:37:07.058173 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e249a1-ab29-40d8-9711-38a0699317ac None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:07.147602 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e249a1-ab29-40d8-9711-38a0699317ac None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:07.157473 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56175470-6896-4563-b8b3-b17768706ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:07.158596 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56175470-6896-4563-b8b3-b17768706ec4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:07.159172 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56175470-6896-4563-b8b3-b17768706ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:07.159550 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56175470-6896-4563-b8b3-b17768706ec4 admin admin] PATH_INFO: `/v3/users/879c20e5cf8245c096c4b2f5b59f7395` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:07.162099 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56175470-6896-4563-b8b3-b17768706ec4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=879c20e5cf8245c096c4b2f5b59f7395)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:07.170678 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56175470-6896-4563-b8b3-b17768706ec4 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:07.274837 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-56175470-6896-4563-b8b3-b17768706ec4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '879c20e5cf8245c096c4b2f5b59f7395'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:07.275544 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-56175470-6896-4563-b8b3-b17768706ec4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '879c20e5cf8245c096c4b2f5b59f7395'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:07.276188 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-56175470-6896-4563-b8b3-b17768706ec4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '879c20e5cf8245c096c4b2f5b59f7395'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:07.285795 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-56175470-6896-4563-b8b3-b17768706ec4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '879c20e5cf8245c096c4b2f5b59f7395'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:07.303599 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-56175470-6896-4563-b8b3-b17768706ec4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '879c20e5cf8245c096c4b2f5b59f7395'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:07.327217 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1259/2526] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:37:07 2022] DELETE /identity/v3/users/879c20e5cf8245c096c4b2f5b59f7395 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:37:07.332457 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac0726-6304-4f82-aec8-4423d780876c None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:07.333104 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac0726-6304-4f82-aec8-4423d780876c None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:07.333104 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac0726-6304-4f82-aec8-4423d780876c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:07.354115 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-94ac0726-6304-4f82-aec8-4423d780876c None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:37:07.355500 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-94ac0726-6304-4f82-aec8-4423d780876c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:07.398558 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:07.453519 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1268/2527] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:37:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:37:07.464982 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56175470-6896-4563-b8b3-b17768706ec4 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:07.466512 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-56175470-6896-4563-b8b3-b17768706ec4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:07.564517 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56175470-6896-4563-b8b3-b17768706ec4 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:07.570593 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e16f1-3560-4053-9478-e471cc54090e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:07.571626 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e16f1-3560-4053-9478-e471cc54090e service neutron] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:07.572145 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e16f1-3560-4053-9478-e471cc54090e service neutron] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:07.572653 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e16f1-3560-4053-9478-e471cc54090e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:07.590288 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7e16f1-3560-4053-9478-e471cc54090e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:07.592212 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7e16f1-3560-4053-9478-e471cc54090e service neutron] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:07.599887 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:07.608193 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1260/2528] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:37:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:37:08.027666 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac0726-6304-4f82-aec8-4423d780876c None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:08.030156 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-94ac0726-6304-4f82-aec8-4423d780876c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:08.053657 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac0726-6304-4f82-aec8-4423d780876c None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:08.062949 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b771d-a7cf-401b-991f-69ca5ef53cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:08.065378 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b771d-a7cf-401b-991f-69ca5ef53cc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:08.065378 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b771d-a7cf-401b-991f-69ca5ef53cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:08.068154 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b771d-a7cf-401b-991f-69ca5ef53cc0 admin admin] PATH_INFO: `/v3/projects/5608e710f3504bc4a5e42bf19f6b8bc8` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:08.070350 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046b771d-a7cf-401b-991f-69ca5ef53cc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5608e710f3504bc4a5e42bf19f6b8bc8)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:08.072894 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046b771d-a7cf-401b-991f-69ca5ef53cc0 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:08.150563 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-046b771d-a7cf-401b-991f-69ca5ef53cc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5608e710f3504bc4a5e42bf19f6b8bc8', 'request_id': 'req-046b771d-a7cf-401b-991f-69ca5ef53cc0'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:08.158178 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-046b771d-a7cf-401b-991f-69ca5ef53cc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5608e710f3504bc4a5e42bf19f6b8bc8', 'request_id': 'req-046b771d-a7cf-401b-991f-69ca5ef53cc0'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:08.166157 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-046b771d-a7cf-401b-991f-69ca5ef53cc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5608e710f3504bc4a5e42bf19f6b8bc8', 'request_id': 'req-046b771d-a7cf-401b-991f-69ca5ef53cc0'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:08.185013 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-046b771d-a7cf-401b-991f-69ca5ef53cc0 admin admin] The token cache is being invalidate because project 5608e710f3504bc4a5e42bf19f6b8bc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:37:08.185666 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-046b771d-a7cf-401b-991f-69ca5ef53cc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:08.186758 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-046b771d-a7cf-401b-991f-69ca5ef53cc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:08.188815 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1269/2529] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:37:08 2022] DELETE /identity/v3/projects/5608e710f3504bc4a5e42bf19f6b8bc8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:37:13.239174 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e16f1-3560-4053-9478-e471cc54090e service neutron] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:13.242262 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-9c7e16f1-3560-4053-9478-e471cc54090e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:13.274245 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e16f1-3560-4053-9478-e471cc54090e service neutron] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:13.389792 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dbb102-ee9c-4297-978a-5a5b61d92f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:13.390531 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbb102-ee9c-4297-978a-5a5b61d92f55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:13.390815 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbb102-ee9c-4297-978a-5a5b61d92f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:13.391215 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbb102-ee9c-4297-978a-5a5b61d92f55 admin admin] PATH_INFO: `/v3/users/1204737db5754fbf995c3c5c6d71e5bb` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:13.392725 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dbb102-ee9c-4297-978a-5a5b61d92f55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1204737db5754fbf995c3c5c6d71e5bb)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:13.394750 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dbb102-ee9c-4297-978a-5a5b61d92f55 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:13.456789 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-10dbb102-ee9c-4297-978a-5a5b61d92f55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1204737db5754fbf995c3c5c6d71e5bb'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:13.457504 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-10dbb102-ee9c-4297-978a-5a5b61d92f55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1204737db5754fbf995c3c5c6d71e5bb'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:13.458148 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-10dbb102-ee9c-4297-978a-5a5b61d92f55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1204737db5754fbf995c3c5c6d71e5bb'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:13.470371 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-10dbb102-ee9c-4297-978a-5a5b61d92f55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1204737db5754fbf995c3c5c6d71e5bb'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:13.491400 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-10dbb102-ee9c-4297-978a-5a5b61d92f55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1204737db5754fbf995c3c5c6d71e5bb'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:13.508644 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1261/2530] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:37:13 2022] DELETE /identity/v3/users/1204737db5754fbf995c3c5c6d71e5bb => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:37:13.876958 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b771d-a7cf-401b-991f-69ca5ef53cc0 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:13.878711 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-046b771d-a7cf-401b-991f-69ca5ef53cc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:13.927148 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b771d-a7cf-401b-991f-69ca5ef53cc0 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:14.080520 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7942b-4735-4423-9fd6-01aeb567199e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:14.081600 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7942b-4735-4423-9fd6-01aeb567199e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:14.082036 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7942b-4735-4423-9fd6-01aeb567199e admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:14.082468 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7942b-4735-4423-9fd6-01aeb567199e admin admin] PATH_INFO: `/v3/projects/d2e1ae67fada4bd68398e3b997f7d40e` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:14.084657 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7942b-4735-4423-9fd6-01aeb567199e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2e1ae67fada4bd68398e3b997f7d40e)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:14.089588 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7942b-4735-4423-9fd6-01aeb567199e admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:14.187341 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-fad7942b-4735-4423-9fd6-01aeb567199e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2e1ae67fada4bd68398e3b997f7d40e', 'request_id': 'req-fad7942b-4735-4423-9fd6-01aeb567199e'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:14.197304 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-fad7942b-4735-4423-9fd6-01aeb567199e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2e1ae67fada4bd68398e3b997f7d40e', 'request_id': 'req-fad7942b-4735-4423-9fd6-01aeb567199e'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:14.207057 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:14.209442 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-fad7942b-4735-4423-9fd6-01aeb567199e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2e1ae67fada4bd68398e3b997f7d40e', 'request_id': 'req-fad7942b-4735-4423-9fd6-01aeb567199e'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:14.236376 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-fad7942b-4735-4423-9fd6-01aeb567199e admin admin] The token cache is being invalidate because project d2e1ae67fada4bd68398e3b997f7d40e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:37:14.236896 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-fad7942b-4735-4423-9fd6-01aeb567199e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:14.238045 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-fad7942b-4735-4423-9fd6-01aeb567199e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:14.240988 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1270/2531] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:37:13 2022] DELETE /identity/v3/projects/d2e1ae67fada4bd68398e3b997f7d40e => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:37:14.246635 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dbb102-ee9c-4297-978a-5a5b61d92f55 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:14.248674 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-10dbb102-ee9c-4297-978a-5a5b61d92f55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:14.265005 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dbb102-ee9c-4297-978a-5a5b61d92f55 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:14.345409 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eebfed6-fb06-4405-9419-152ce20d2f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:14.346110 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eebfed6-fb06-4405-9419-152ce20d2f2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:14.346650 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eebfed6-fb06-4405-9419-152ce20d2f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:14.346926 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eebfed6-fb06-4405-9419-152ce20d2f2e admin admin] PATH_INFO: `/v3/users/c9392ee83139484c945289c02712719e` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:14.348598 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eebfed6-fb06-4405-9419-152ce20d2f2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9392ee83139484c945289c02712719e)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:14.351766 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eebfed6-fb06-4405-9419-152ce20d2f2e admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:14.396198 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:14.432977 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-4eebfed6-fb06-4405-9419-152ce20d2f2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9392ee83139484c945289c02712719e'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:14.434581 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-4eebfed6-fb06-4405-9419-152ce20d2f2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9392ee83139484c945289c02712719e'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:14.436110 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-4eebfed6-fb06-4405-9419-152ce20d2f2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9392ee83139484c945289c02712719e'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:14.450187 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-4eebfed6-fb06-4405-9419-152ce20d2f2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9392ee83139484c945289c02712719e'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:14.466723 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-4eebfed6-fb06-4405-9419-152ce20d2f2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9392ee83139484c945289c02712719e'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:14.481426 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1262/2532] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:37:14 2022] DELETE /identity/v3/users/c9392ee83139484c945289c02712719e => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:37:14.828227 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7942b-4735-4423-9fd6-01aeb567199e admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:14.830570 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-fad7942b-4735-4423-9fd6-01aeb567199e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:14.854872 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7942b-4735-4423-9fd6-01aeb567199e admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:14.981975 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa84d997-4a54-4eff-8650-5c4c8e81933d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:14.984628 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84d997-4a54-4eff-8650-5c4c8e81933d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:14.985614 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84d997-4a54-4eff-8650-5c4c8e81933d admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:14.986120 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84d997-4a54-4eff-8650-5c4c8e81933d admin admin] PATH_INFO: `/v3/projects/2307cda5292f4140acec7bba25d74a6a` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:14.988195 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa84d997-4a54-4eff-8650-5c4c8e81933d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2307cda5292f4140acec7bba25d74a6a)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:14.991550 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa84d997-4a54-4eff-8650-5c4c8e81933d admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:15.079242 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-aa84d997-4a54-4eff-8650-5c4c8e81933d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2307cda5292f4140acec7bba25d74a6a', 'request_id': 'req-aa84d997-4a54-4eff-8650-5c4c8e81933d'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:15.088489 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-aa84d997-4a54-4eff-8650-5c4c8e81933d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2307cda5292f4140acec7bba25d74a6a', 'request_id': 'req-aa84d997-4a54-4eff-8650-5c4c8e81933d'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:15.106025 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-aa84d997-4a54-4eff-8650-5c4c8e81933d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2307cda5292f4140acec7bba25d74a6a', 'request_id': 'req-aa84d997-4a54-4eff-8650-5c4c8e81933d'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:15.130224 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-aa84d997-4a54-4eff-8650-5c4c8e81933d admin admin] The token cache is being invalidate because project 2307cda5292f4140acec7bba25d74a6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:37:15.130775 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-aa84d997-4a54-4eff-8650-5c4c8e81933d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:15.131779 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-aa84d997-4a54-4eff-8650-5c4c8e81933d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:15.133872 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1271/2533] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:37:14 2022] DELETE /identity/v3/projects/2307cda5292f4140acec7bba25d74a6a => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:37:15.138814 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44e165-78f6-4f0c-b431-dc27fe22970a None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:15.139409 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44e165-78f6-4f0c-b431-dc27fe22970a None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:15.139847 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44e165-78f6-4f0c-b431-dc27fe22970a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:15.180543 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-fe44e165-78f6-4f0c-b431-dc27fe22970a None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:37:15.183173 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-fe44e165-78f6-4f0c-b431-dc27fe22970a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:15.312397 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1263/2534] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:37:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:37:15.321093 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08060858-ba10-4846-aae1-46727a9d9421 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:15.321820 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08060858-ba10-4846-aae1-46727a9d9421 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:15.322233 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08060858-ba10-4846-aae1-46727a9d9421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:15.355134 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-08060858-ba10-4846-aae1-46727a9d9421 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:37:15.358712 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-08060858-ba10-4846-aae1-46727a9d9421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:15.375699 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1272/2535] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:37:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:37:15.380945 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe44e165-78f6-4f0c-b431-dc27fe22970a None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:15.399654 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe44e165-78f6-4f0c-b431-dc27fe22970a None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:15.408603 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414999c7-8a85-4f62-a893-16517bc0f268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:15.409345 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414999c7-8a85-4f62-a893-16517bc0f268 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:15.409626 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414999c7-8a85-4f62-a893-16517bc0f268 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:15.409893 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414999c7-8a85-4f62-a893-16517bc0f268 admin admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:15.410569 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414999c7-8a85-4f62-a893-16517bc0f268 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:37:15.410866 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414999c7-8a85-4f62-a893-16517bc0f268 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:15.413443 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414999c7-8a85-4f62-a893-16517bc0f268 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:15.452273 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1264/2536] 10.222.0.91 () {58 vars in 1153 bytes} [Tue Aug 30 04:37:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:37:15.459554 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08060858-ba10-4846-aae1-46727a9d9421 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:15.483309 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08060858-ba10-4846-aae1-46727a9d9421 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:15.507602 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed5758a-066b-46c1-b5ab-d64d61215712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:15.509510 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5758a-066b-46c1-b5ab-d64d61215712 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:15.510437 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5758a-066b-46c1-b5ab-d64d61215712 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:15.511426 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5758a-066b-46c1-b5ab-d64d61215712 admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:15.513313 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed5758a-066b-46c1-b5ab-d64d61215712 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:15.517484 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed5758a-066b-46c1-b5ab-d64d61215712 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:15.586702 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1273/2537] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:37:15 2022] POST /identity/v3/projects => generated 385 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:37:15.593442 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414999c7-8a85-4f62-a893-16517bc0f268 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:15.615250 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414999c7-8a85-4f62-a893-16517bc0f268 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:15.792519 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43facc8-055e-49ea-b6c7-82e4e2476b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:15.793167 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43facc8-055e-49ea-b6c7-82e4e2476b7a admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:15.793531 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43facc8-055e-49ea-b6c7-82e4e2476b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:15.793814 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43facc8-055e-49ea-b6c7-82e4e2476b7a admin admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:15.794485 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43facc8-055e-49ea-b6c7-82e4e2476b7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:15.796625 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43facc8-055e-49ea-b6c7-82e4e2476b7a admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:15.827964 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1265/2538] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:37:15 2022] POST /identity/v3/users => generated 293 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:37:15.831457 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed5758a-066b-46c1-b5ab-d64d61215712 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:15.852780 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed5758a-066b-46c1-b5ab-d64d61215712 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:15.859256 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de7d53-7902-4c36-a44f-ebb0e435753f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:15.860108 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de7d53-7902-4c36-a44f-ebb0e435753f admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:15.860463 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de7d53-7902-4c36-a44f-ebb0e435753f admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:15.860751 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de7d53-7902-4c36-a44f-ebb0e435753f admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:15.861873 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6de7d53-7902-4c36-a44f-ebb0e435753f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:15.864327 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6de7d53-7902-4c36-a44f-ebb0e435753f admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:15.886570 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1274/2539] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:37:15.888186 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43facc8-055e-49ea-b6c7-82e4e2476b7a admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:15.902954 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43facc8-055e-49ea-b6c7-82e4e2476b7a admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:15.913948 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb4a00f-dfce-43ca-91d0-1bf9d8f3d314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:15.915304 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4a00f-dfce-43ca-91d0-1bf9d8f3d314 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:15.915800 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4a00f-dfce-43ca-91d0-1bf9d8f3d314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:15.916361 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4a00f-dfce-43ca-91d0-1bf9d8f3d314 admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:15.917553 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb4a00f-dfce-43ca-91d0-1bf9d8f3d314 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:15.921141 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb4a00f-dfce-43ca-91d0-1bf9d8f3d314 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:15.946280 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1266/2540] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:37:15.953766 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de7d53-7902-4c36-a44f-ebb0e435753f admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:15.970137 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de7d53-7902-4c36-a44f-ebb0e435753f admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:15.975719 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982aa5ef-97e2-4f44-8d0d-ddbddafdb473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:15.976471 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982aa5ef-97e2-4f44-8d0d-ddbddafdb473 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:15.976754 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982aa5ef-97e2-4f44-8d0d-ddbddafdb473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:15.977038 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982aa5ef-97e2-4f44-8d0d-ddbddafdb473 admin admin] PATH_INFO: `/v3/projects/7c4dddf37fcf4da19cfed86932e8383a/users/b809a4d572c342269f691cce6c473431/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:16.012695 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982aa5ef-97e2-4f44-8d0d-ddbddafdb473 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c4dddf37fcf4da19cfed86932e8383a, user_id=b809a4d572c342269f691cce6c473431, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:16.015317 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982aa5ef-97e2-4f44-8d0d-ddbddafdb473 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:16.033531 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1275/2541] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:37:15 2022] PUT /identity/v3/projects/7c4dddf37fcf4da19cfed86932e8383a/users/b809a4d572c342269f691cce6c473431/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:37:16.046061 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9264b08-2216-4e12-8bd0-d338e026281b None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:16.046400 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9264b08-2216-4e12-8bd0-d338e026281b None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:16.046745 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9264b08-2216-4e12-8bd0-d338e026281b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:16.057432 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:16.094307 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-f9264b08-2216-4e12-8bd0-d338e026281b None None] MFA Rules not processed for user `b809a4d572c342269f691cce6c473431`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:37:16.095552 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-f9264b08-2216-4e12-8bd0-d338e026281b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:16.212270 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1267/2542] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:37:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:37:16.217100 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982aa5ef-97e2-4f44-8d0d-ddbddafdb473 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:16.242810 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:16.298880 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982aa5ef-97e2-4f44-8d0d-ddbddafdb473 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:16.304156 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f93994-9f88-46bd-91fe-44c945d24af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:16.304846 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f93994-9f88-46bd-91fe-44c945d24af8 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:16.305142 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f93994-9f88-46bd-91fe-44c945d24af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:16.305433 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f93994-9f88-46bd-91fe-44c945d24af8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:16.306149 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f93994-9f88-46bd-91fe-44c945d24af8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:16.308183 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f93994-9f88-46bd-91fe-44c945d24af8 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:16.337583 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1276/2543] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:37:16 2022] POST /identity/v3/projects => generated 385 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:37:16.342042 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9264b08-2216-4e12-8bd0-d338e026281b None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:16.354008 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9264b08-2216-4e12-8bd0-d338e026281b None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:16.419151 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2929a6f-d785-418c-8a72-0d1f8fc7ecc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:16.419836 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2929a6f-d785-418c-8a72-0d1f8fc7ecc6 admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:16.420169 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2929a6f-d785-418c-8a72-0d1f8fc7ecc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:16.420495 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2929a6f-d785-418c-8a72-0d1f8fc7ecc6 admin admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:16.421257 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2929a6f-d785-418c-8a72-0d1f8fc7ecc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:16.423672 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2929a6f-d785-418c-8a72-0d1f8fc7ecc6 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:16.455997 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1268/2544] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:37:16 2022] POST /identity/v3/users => generated 299 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:37:16.461326 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f93994-9f88-46bd-91fe-44c945d24af8 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:16.480576 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f93994-9f88-46bd-91fe-44c945d24af8 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:16.486647 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e7fc6-bec2-444f-adc4-d1ff4bd7b7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:16.487423 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e7fc6-bec2-444f-adc4-d1ff4bd7b7da admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:16.487739 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e7fc6-bec2-444f-adc4-d1ff4bd7b7da admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:16.488099 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e7fc6-bec2-444f-adc4-d1ff4bd7b7da admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:16.488799 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5e7fc6-bec2-444f-adc4-d1ff4bd7b7da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:16.490465 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5e7fc6-bec2-444f-adc4-d1ff4bd7b7da admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:16.502389 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1277/2545] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:37:16.507528 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2929a6f-d785-418c-8a72-0d1f8fc7ecc6 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:16.520688 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2929a6f-d785-418c-8a72-0d1f8fc7ecc6 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:16.529022 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca721681-b046-4a09-8bf9-bf6ac4a1c848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:16.530086 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca721681-b046-4a09-8bf9-bf6ac4a1c848 admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:16.530546 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca721681-b046-4a09-8bf9-bf6ac4a1c848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:16.531016 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca721681-b046-4a09-8bf9-bf6ac4a1c848 admin admin] PATH_INFO: `/v3/projects/02298996a68f4c5f80a8de2686fd092e/users/717132a1633d47b7bdd5c722696ba63f/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:16.557337 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca721681-b046-4a09-8bf9-bf6ac4a1c848 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02298996a68f4c5f80a8de2686fd092e, user_id=717132a1633d47b7bdd5c722696ba63f, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:16.562108 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca721681-b046-4a09-8bf9-bf6ac4a1c848 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:16.579424 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1269/2546] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:37:16 2022] PUT /identity/v3/projects/02298996a68f4c5f80a8de2686fd092e/users/717132a1633d47b7bdd5c722696ba63f/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:37:16.584881 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e7fc6-bec2-444f-adc4-d1ff4bd7b7da admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:16.601743 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e7fc6-bec2-444f-adc4-d1ff4bd7b7da admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:16.680245 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d918c-bc54-463f-b1e1-e074f933d293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:16.681517 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d918c-bc54-463f-b1e1-e074f933d293 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:16.682291 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d918c-bc54-463f-b1e1-e074f933d293 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:16.682753 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d918c-bc54-463f-b1e1-e074f933d293 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:16.683830 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81d918c-bc54-463f-b1e1-e074f933d293 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:16.686876 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81d918c-bc54-463f-b1e1-e074f933d293 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:16.707181 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1278/2547] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:37:16.712061 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca721681-b046-4a09-8bf9-bf6ac4a1c848 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:16.724672 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca721681-b046-4a09-8bf9-bf6ac4a1c848 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:16.730366 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d8f93-c2ff-4733-9688-8d954b5a70af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:16.731042 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d8f93-c2ff-4733-9688-8d954b5a70af admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:16.731309 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d8f93-c2ff-4733-9688-8d954b5a70af admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:16.731594 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d8f93-c2ff-4733-9688-8d954b5a70af admin admin] PATH_INFO: `/v3/projects/02298996a68f4c5f80a8de2686fd092e/users/717132a1633d47b7bdd5c722696ba63f/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:16.733779 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618d8f93-c2ff-4733-9688-8d954b5a70af admin admin] RBAC: Authorizing `identity:create_grant(project_id=02298996a68f4c5f80a8de2686fd092e, user_id=717132a1633d47b7bdd5c722696ba63f, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:16.736532 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618d8f93-c2ff-4733-9688-8d954b5a70af admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:16.756758 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1270/2548] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:37:16 2022] PUT /identity/v3/projects/02298996a68f4c5f80a8de2686fd092e/users/717132a1633d47b7bdd5c722696ba63f/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:37:16.769022 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6d970-6b89-4193-a197-a9aca552c78d None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:16.769304 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6d970-6b89-4193-a197-a9aca552c78d None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:16.769565 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6d970-6b89-4193-a197-a9aca552c78d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:16.802537 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-20d6d970-6b89-4193-a197-a9aca552c78d None None] MFA Rules not processed for user `717132a1633d47b7bdd5c722696ba63f`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:37:16.803881 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-20d6d970-6b89-4193-a197-a9aca552c78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:16.887594 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1279/2549] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:37:16 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:37:16.899555 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d8f93-c2ff-4733-9688-8d954b5a70af admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:16.901418 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-618d8f93-c2ff-4733-9688-8d954b5a70af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:16.963156 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:16.971517 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d8f93-c2ff-4733-9688-8d954b5a70af admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:16.976775 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb762c-1757-4c50-a3cb-46a20dbfbf1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:16.977084 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb762c-1757-4c50-a3cb-46a20dbfbf1b service cinder] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:16.977301 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb762c-1757-4c50-a3cb-46a20dbfbf1b service cinder] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:16.977564 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb762c-1757-4c50-a3cb-46a20dbfbf1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:17.051062 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccb762c-1757-4c50-a3cb-46a20dbfbf1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:17.052581 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccb762c-1757-4c50-a3cb-46a20dbfbf1b service cinder] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:17.062913 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1271/2550] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:37:16 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:37:19.023561 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d6d970-6b89-4193-a197-a9aca552c78d None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:19.025147 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-20d6d970-6b89-4193-a197-a9aca552c78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:19.042598 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:19.154323 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d6d970-6b89-4193-a197-a9aca552c78d None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:19.166008 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8038e9-7379-4737-90bb-b31488a58975 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:19.166822 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8038e9-7379-4737-90bb-b31488a58975 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:19.167226 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8038e9-7379-4737-90bb-b31488a58975 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:19.167671 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8038e9-7379-4737-90bb-b31488a58975 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:19.169978 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-ba8038e9-7379-4737-90bb-b31488a58975 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:19.260765 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8038e9-7379-4737-90bb-b31488a58975 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:19.263120 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8038e9-7379-4737-90bb-b31488a58975 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:19.274455 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1280/2551] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:37:19 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:37:20.040889 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb762c-1757-4c50-a3cb-46a20dbfbf1b service cinder] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:20.043309 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-bccb762c-1757-4c50-a3cb-46a20dbfbf1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:20.066595 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb762c-1757-4c50-a3cb-46a20dbfbf1b service cinder] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:20.073439 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ad2fe-a815-416a-af96-163cbca35e05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:20.074298 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ad2fe-a815-416a-af96-163cbca35e05 service neutron] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:20.074649 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ad2fe-a815-416a-af96-163cbca35e05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:20.074993 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ad2fe-a815-416a-af96-163cbca35e05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:20.077600 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-0a8ad2fe-a815-416a-af96-163cbca35e05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:20.183591 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8ad2fe-a815-416a-af96-163cbca35e05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:20.186492 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8ad2fe-a815-416a-af96-163cbca35e05 service neutron] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:20.215324 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1272/2552] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:37:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:37:22.037458 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8038e9-7379-4737-90bb-b31488a58975 service neutron] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:22.052835 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8038e9-7379-4737-90bb-b31488a58975 service neutron] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:22.057231 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda7534f-7037-4df9-8507-c5a4e534a10b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:22.057871 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda7534f-7037-4df9-8507-c5a4e534a10b service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:22.058152 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda7534f-7037-4df9-8507-c5a4e534a10b service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:22.058423 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda7534f-7037-4df9-8507-c5a4e534a10b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:22.076578 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda7534f-7037-4df9-8507-c5a4e534a10b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:22.081671 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda7534f-7037-4df9-8507-c5a4e534a10b service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:22.102008 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1281/2553] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:37:22 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:37:24.208523 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ad2fe-a815-416a-af96-163cbca35e05 service neutron] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:24.212306 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-0a8ad2fe-a815-416a-af96-163cbca35e05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:24.425979 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ad2fe-a815-416a-af96-163cbca35e05 service neutron] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:24.432922 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabe1d29-6a7c-404d-98f1-3b6fffdc1bc8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47a092fbe1334f7e9ae4ba9bdb5e9f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:24.433655 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe1d29-6a7c-404d-98f1-3b6fffdc1bc8 service placement] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:24.433995 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe1d29-6a7c-404d-98f1-3b6fffdc1bc8 service placement] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:24.434378 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe1d29-6a7c-404d-98f1-3b6fffdc1bc8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:24.436489 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-fabe1d29-6a7c-404d-98f1-3b6fffdc1bc8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:24.451515 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabe1d29-6a7c-404d-98f1-3b6fffdc1bc8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:24.453352 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabe1d29-6a7c-404d-98f1-3b6fffdc1bc8 service placement] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:24.466917 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1273/2554] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:37:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:37:25.801081 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda7534f-7037-4df9-8507-c5a4e534a10b service cinder] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:25.804206 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-fda7534f-7037-4df9-8507-c5a4e534a10b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:25.821701 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda7534f-7037-4df9-8507-c5a4e534a10b service cinder] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:25.827339 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb6932-c541-477e-aac9-ca157a86b2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:25.828060 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb6932-c541-477e-aac9-ca157a86b2fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:25.828400 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb6932-c541-477e-aac9-ca157a86b2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:25.828689 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb6932-c541-477e-aac9-ca157a86b2fc admin admin] PATH_INFO: `/v3/users/5adb079fad6c41aca6a619a71a3b7c3a` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:25.830108 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfb6932-c541-477e-aac9-ca157a86b2fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=5adb079fad6c41aca6a619a71a3b7c3a)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:25.835328 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfb6932-c541-477e-aac9-ca157a86b2fc admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:25.902840 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-0bfb6932-c541-477e-aac9-ca157a86b2fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5adb079fad6c41aca6a619a71a3b7c3a'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:25.911767 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-0bfb6932-c541-477e-aac9-ca157a86b2fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5adb079fad6c41aca6a619a71a3b7c3a'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:25.923256 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-0bfb6932-c541-477e-aac9-ca157a86b2fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5adb079fad6c41aca6a619a71a3b7c3a'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:25.924178 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-0bfb6932-c541-477e-aac9-ca157a86b2fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5adb079fad6c41aca6a619a71a3b7c3a'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:25.940038 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-0bfb6932-c541-477e-aac9-ca157a86b2fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5adb079fad6c41aca6a619a71a3b7c3a'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:25.948152 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1282/2555] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:37:25 2022] DELETE /identity/v3/users/5adb079fad6c41aca6a619a71a3b7c3a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:37:26.176692 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabe1d29-6a7c-404d-98f1-3b6fffdc1bc8 service placement] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:26.186105 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:26.195544 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabe1d29-6a7c-404d-98f1-3b6fffdc1bc8 service placement] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:26.298834 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a20a39-fe08-499f-afdb-513f60172c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:26.300025 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a20a39-fe08-499f-afdb-513f60172c5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:26.302863 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a20a39-fe08-499f-afdb-513f60172c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:26.302863 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a20a39-fe08-499f-afdb-513f60172c5f admin admin] PATH_INFO: `/v3/projects/ec24ad0a529d4df7a32b62a1558fa7a8` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:26.306072 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a20a39-fe08-499f-afdb-513f60172c5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec24ad0a529d4df7a32b62a1558fa7a8)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:26.308341 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a20a39-fe08-499f-afdb-513f60172c5f admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:26.399814 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-a0a20a39-fe08-499f-afdb-513f60172c5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'request_id': 'req-a0a20a39-fe08-499f-afdb-513f60172c5f'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:26.412417 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-a0a20a39-fe08-499f-afdb-513f60172c5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'request_id': 'req-a0a20a39-fe08-499f-afdb-513f60172c5f'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:26.426513 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-a0a20a39-fe08-499f-afdb-513f60172c5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec24ad0a529d4df7a32b62a1558fa7a8', 'request_id': 'req-a0a20a39-fe08-499f-afdb-513f60172c5f'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:26.449604 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-a0a20a39-fe08-499f-afdb-513f60172c5f admin admin] The token cache is being invalidate because project ec24ad0a529d4df7a32b62a1558fa7a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:37:26.450160 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-a0a20a39-fe08-499f-afdb-513f60172c5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:26.451285 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-a0a20a39-fe08-499f-afdb-513f60172c5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:26.454713 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1274/2556] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:37:26 2022] DELETE /identity/v3/projects/ec24ad0a529d4df7a32b62a1558fa7a8 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:37:26.461336 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf24f8-0837-436c-8058-4ff476f97e47 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:26.461886 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf24f8-0837-436c-8058-4ff476f97e47 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:26.462266 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf24f8-0837-436c-8058-4ff476f97e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:26.490231 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-f3bf24f8-0837-436c-8058-4ff476f97e47 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:37:26.491973 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-f3bf24f8-0837-436c-8058-4ff476f97e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:26.528237 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:26.610670 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1283/2557] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:37:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:37:26.625095 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96982f3-9ea2-4696-a1ab-4d3831ded243 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:26.625980 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96982f3-9ea2-4696-a1ab-4d3831ded243 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:26.626470 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96982f3-9ea2-4696-a1ab-4d3831ded243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:26.640438 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bf24f8-0837-436c-8058-4ff476f97e47 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:26.644316 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-f3bf24f8-0837-436c-8058-4ff476f97e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:26.668032 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-d96982f3-9ea2-4696-a1ab-4d3831ded243 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:37:26.670171 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-d96982f3-9ea2-4696-a1ab-4d3831ded243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:26.688141 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1275/2558] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:37:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:37:26.694828 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96982f3-9ea2-4696-a1ab-4d3831ded243 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:26.709762 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96982f3-9ea2-4696-a1ab-4d3831ded243 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:26.716534 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ed3c2-17ac-4bf0-b3fa-7506c844a9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:26.717381 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ed3c2-17ac-4bf0-b3fa-7506c844a9ec admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:26.717746 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ed3c2-17ac-4bf0-b3fa-7506c844a9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:26.718258 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ed3c2-17ac-4bf0-b3fa-7506c844a9ec admin admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:26.719267 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8ed3c2-17ac-4bf0-b3fa-7506c844a9ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:37:26.719592 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8ed3c2-17ac-4bf0-b3fa-7506c844a9ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:26.721534 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8ed3c2-17ac-4bf0-b3fa-7506c844a9ec admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:26.742385 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1276/2559] 10.222.0.91 () {58 vars in 1153 bytes} [Tue Aug 30 04:37:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:37:26.754755 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ed3c2-17ac-4bf0-b3fa-7506c844a9ec admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:26.769688 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bf24f8-0837-436c-8058-4ff476f97e47 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:26.774804 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ed3c2-17ac-4bf0-b3fa-7506c844a9ec admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:26.777018 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf3edf-c690-48a2-aba4-8de445963905 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:26.778061 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf3edf-c690-48a2-aba4-8de445963905 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:26.778535 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf3edf-c690-48a2-aba4-8de445963905 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:26.779018 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf3edf-c690-48a2-aba4-8de445963905 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:26.782844 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-8abf3edf-c690-48a2-aba4-8de445963905 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:26.784394 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f728361-0db6-4d8c-a69a-f392bcc6e5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:26.785364 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f728361-0db6-4d8c-a69a-f392bcc6e5c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:26.785539 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f728361-0db6-4d8c-a69a-f392bcc6e5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:26.785844 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f728361-0db6-4d8c-a69a-f392bcc6e5c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:26.786630 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f728361-0db6-4d8c-a69a-f392bcc6e5c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:26.791633 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f728361-0db6-4d8c-a69a-f392bcc6e5c8 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:26.811007 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abf3edf-c690-48a2-aba4-8de445963905 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:26.813968 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abf3edf-c690-48a2-aba4-8de445963905 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:26.830501 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1277/2560] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:37:26 2022] POST /identity/v3/projects => generated 403 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:37:26.836646 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1284/2561] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:37:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:37:26.841592 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f728361-0db6-4d8c-a69a-f392bcc6e5c8 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:26.924596 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:26.944382 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f728361-0db6-4d8c-a69a-f392bcc6e5c8 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:26.953069 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ff062-bcf0-4386-82fc-c4df233e4bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:26.953832 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ff062-bcf0-4386-82fc-c4df233e4bf4 admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:26.954237 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ff062-bcf0-4386-82fc-c4df233e4bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:26.954818 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ff062-bcf0-4386-82fc-c4df233e4bf4 admin admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:26.955803 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2ff062-bcf0-4386-82fc-c4df233e4bf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:26.959474 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2ff062-bcf0-4386-82fc-c4df233e4bf4 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:26.995241 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1278/2562] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:37:26 2022] POST /identity/v3/users => generated 302 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:37:26.999420 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf3edf-c690-48a2-aba4-8de445963905 service neutron] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:27.010783 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf3edf-c690-48a2-aba4-8de445963905 service neutron] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:27.016905 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf26cfe-43de-4505-a3d4-921e5f29e11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:27.017715 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf26cfe-43de-4505-a3d4-921e5f29e11f admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:27.017994 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf26cfe-43de-4505-a3d4-921e5f29e11f admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:27.018270 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf26cfe-43de-4505-a3d4-921e5f29e11f admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:27.018966 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf26cfe-43de-4505-a3d4-921e5f29e11f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:27.020795 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf26cfe-43de-4505-a3d4-921e5f29e11f admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:27.034906 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1285/2563] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:37:27.037511 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ff062-bcf0-4386-82fc-c4df233e4bf4 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:27.049789 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ff062-bcf0-4386-82fc-c4df233e4bf4 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:27.058820 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe07922-4ffb-4d49-9fe8-070e5cf81b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:27.060001 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe07922-4ffb-4d49-9fe8-070e5cf81b4d admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:27.060427 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe07922-4ffb-4d49-9fe8-070e5cf81b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:27.060710 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe07922-4ffb-4d49-9fe8-070e5cf81b4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:27.061389 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe07922-4ffb-4d49-9fe8-070e5cf81b4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:27.063479 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe07922-4ffb-4d49-9fe8-070e5cf81b4d admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:27.077543 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1279/2564] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:37:27 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:37:27.084386 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf26cfe-43de-4505-a3d4-921e5f29e11f admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:27.100910 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf26cfe-43de-4505-a3d4-921e5f29e11f admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:27.106763 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef7b6f9-6b12-414e-9efc-bb8e9c3c9791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:27.107728 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef7b6f9-6b12-414e-9efc-bb8e9c3c9791 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:27.108153 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef7b6f9-6b12-414e-9efc-bb8e9c3c9791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:27.108523 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef7b6f9-6b12-414e-9efc-bb8e9c3c9791 admin admin] PATH_INFO: `/v3/projects/c6936c9400104c758d3f7e93ce7e7745/users/7dc222e17ad34071b9f1e28ad146eb22/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:27.135390 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef7b6f9-6b12-414e-9efc-bb8e9c3c9791 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6936c9400104c758d3f7e93ce7e7745, user_id=7dc222e17ad34071b9f1e28ad146eb22, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:27.142375 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef7b6f9-6b12-414e-9efc-bb8e9c3c9791 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:27.163634 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1286/2565] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:37:27 2022] PUT /identity/v3/projects/c6936c9400104c758d3f7e93ce7e7745/users/7dc222e17ad34071b9f1e28ad146eb22/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:37:27.183257 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d5a7c3-17e6-47fa-b1e1-6d989831d919 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:27.183939 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d5a7c3-17e6-47fa-b1e1-6d989831d919 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:27.184269 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d5a7c3-17e6-47fa-b1e1-6d989831d919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:27.237569 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-96d5a7c3-17e6-47fa-b1e1-6d989831d919 None None] MFA Rules not processed for user `7dc222e17ad34071b9f1e28ad146eb22`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:37:27.239595 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-96d5a7c3-17e6-47fa-b1e1-6d989831d919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:27.336670 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1280/2566] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:37:27 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:37:27.341915 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef7b6f9-6b12-414e-9efc-bb8e9c3c9791 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:27.445436 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef7b6f9-6b12-414e-9efc-bb8e9c3c9791 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:27.453891 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b5e244-6a5c-44a6-8b06-d0101fb883c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:27.454707 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5e244-6a5c-44a6-8b06-d0101fb883c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:27.455182 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5e244-6a5c-44a6-8b06-d0101fb883c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:27.455655 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5e244-6a5c-44a6-8b06-d0101fb883c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:27.456924 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b5e244-6a5c-44a6-8b06-d0101fb883c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:27.460255 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b5e244-6a5c-44a6-8b06-d0101fb883c3 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:27.510965 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1287/2567] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:37:27 2022] POST /identity/v3/projects => generated 405 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:37:27.515613 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d5a7c3-17e6-47fa-b1e1-6d989831d919 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:27.529875 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d5a7c3-17e6-47fa-b1e1-6d989831d919 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:27.627870 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d181d7-994f-49b8-8291-e0741e7ac6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:27.628741 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d181d7-994f-49b8-8291-e0741e7ac6a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:27.629139 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d181d7-994f-49b8-8291-e0741e7ac6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:27.629510 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d181d7-994f-49b8-8291-e0741e7ac6a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:27.630263 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d181d7-994f-49b8-8291-e0741e7ac6a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:27.633604 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d181d7-994f-49b8-8291-e0741e7ac6a5 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:27.667747 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1281/2568] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:37:27 2022] POST /identity/v3/users => generated 309 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:37:27.674552 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b5e244-6a5c-44a6-8b06-d0101fb883c3 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:27.695235 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b5e244-6a5c-44a6-8b06-d0101fb883c3 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:27.703213 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7095fb7-5146-4366-9082-e3c9ccdc3b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:27.704939 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7095fb7-5146-4366-9082-e3c9ccdc3b1d admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:27.705408 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7095fb7-5146-4366-9082-e3c9ccdc3b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:27.705989 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7095fb7-5146-4366-9082-e3c9ccdc3b1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:27.707204 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7095fb7-5146-4366-9082-e3c9ccdc3b1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:27.710386 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7095fb7-5146-4366-9082-e3c9ccdc3b1d admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:27.734243 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1288/2569] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:37:27 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:37:27.736221 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d181d7-994f-49b8-8291-e0741e7ac6a5 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:27.755114 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d181d7-994f-49b8-8291-e0741e7ac6a5 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:27.763402 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da462c3a-4fb0-446e-92d4-967b4561fb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:27.764623 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da462c3a-4fb0-446e-92d4-967b4561fb8d admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:27.765108 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da462c3a-4fb0-446e-92d4-967b4561fb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:27.765588 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da462c3a-4fb0-446e-92d4-967b4561fb8d admin admin] PATH_INFO: `/v3/projects/8142e53dba514e679ad6e1032cd9291f/users/1cefe5813561411d8216267d419326a5/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:27.792641 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da462c3a-4fb0-446e-92d4-967b4561fb8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8142e53dba514e679ad6e1032cd9291f, user_id=1cefe5813561411d8216267d419326a5, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:27.798319 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da462c3a-4fb0-446e-92d4-967b4561fb8d admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:27.824696 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1282/2570] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:37:27 2022] PUT /identity/v3/projects/8142e53dba514e679ad6e1032cd9291f/users/1cefe5813561411d8216267d419326a5/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:37:27.830744 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7095fb7-5146-4366-9082-e3c9ccdc3b1d admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:27.843391 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7095fb7-5146-4366-9082-e3c9ccdc3b1d admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:27.848677 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:27.891489 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da462c3a-4fb0-446e-92d4-967b4561fb8d admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:27.894217 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-da462c3a-4fb0-446e-92d4-967b4561fb8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:27.954311 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:27.956363 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4871408-5939-4657-a0e4-065f8ac3765e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:27.957439 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4871408-5939-4657-a0e4-065f8ac3765e admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:27.957911 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4871408-5939-4657-a0e4-065f8ac3765e admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:27.958373 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4871408-5939-4657-a0e4-065f8ac3765e admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:27.959850 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4871408-5939-4657-a0e4-065f8ac3765e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:27.962955 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4871408-5939-4657-a0e4-065f8ac3765e admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:27.983960 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1289/2571] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:37:27 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:37:27.988880 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4871408-5939-4657-a0e4-065f8ac3765e admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:28.011353 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4871408-5939-4657-a0e4-065f8ac3765e admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:28.020669 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be7bde8-2e46-43ef-ba50-56f22c97369a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:28.022572 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7bde8-2e46-43ef-ba50-56f22c97369a admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:28.023209 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7bde8-2e46-43ef-ba50-56f22c97369a admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:28.023780 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7bde8-2e46-43ef-ba50-56f22c97369a admin admin] PATH_INFO: `/v3/projects/8142e53dba514e679ad6e1032cd9291f/users/1cefe5813561411d8216267d419326a5/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:28.027831 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be7bde8-2e46-43ef-ba50-56f22c97369a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8142e53dba514e679ad6e1032cd9291f, user_id=1cefe5813561411d8216267d419326a5, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:28.030347 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da462c3a-4fb0-446e-92d4-967b4561fb8d admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:28.033075 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be7bde8-2e46-43ef-ba50-56f22c97369a admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:28.038821 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07baa20-c685-4e69-a420-800ec21da73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:28.040274 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07baa20-c685-4e69-a420-800ec21da73e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:28.040762 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07baa20-c685-4e69-a420-800ec21da73e admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:28.041294 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07baa20-c685-4e69-a420-800ec21da73e admin admin] PATH_INFO: `/v3/users/b809a4d572c342269f691cce6c473431` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:28.043453 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07baa20-c685-4e69-a420-800ec21da73e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b809a4d572c342269f691cce6c473431)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:28.048783 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07baa20-c685-4e69-a420-800ec21da73e admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:28.063196 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1290/2572] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:37:27 2022] PUT /identity/v3/projects/8142e53dba514e679ad6e1032cd9291f/users/1cefe5813561411d8216267d419326a5/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:37:28.085792 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4a5cc-282a-4180-a1d8-c9fe75a7c9fb None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:28.086405 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4a5cc-282a-4180-a1d8-c9fe75a7c9fb None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:28.086917 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4a5cc-282a-4180-a1d8-c9fe75a7c9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:28.157786 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-d07baa20-c685-4e69-a420-800ec21da73e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b809a4d572c342269f691cce6c473431'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:28.157786 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-d07baa20-c685-4e69-a420-800ec21da73e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b809a4d572c342269f691cce6c473431'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:28.158365 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-d07baa20-c685-4e69-a420-800ec21da73e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b809a4d572c342269f691cce6c473431'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:28.168256 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-6ef4a5cc-282a-4180-a1d8-c9fe75a7c9fb None None] MFA Rules not processed for user `1cefe5813561411d8216267d419326a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:37:28.173028 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-6ef4a5cc-282a-4180-a1d8-c9fe75a7c9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:28.177178 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-d07baa20-c685-4e69-a420-800ec21da73e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b809a4d572c342269f691cce6c473431'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:28.199566 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-d07baa20-c685-4e69-a420-800ec21da73e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b809a4d572c342269f691cce6c473431'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:28.220423 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1283/2573] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:37:27 2022] DELETE /identity/v3/users/b809a4d572c342269f691cce6c473431 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:37:28.222704 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c410d5-14e3-4cb0-8733-9c419423ba5f None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:28.223199 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c410d5-14e3-4cb0-8733-9c419423ba5f None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:28.223691 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c410d5-14e3-4cb0-8733-9c419423ba5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:28.265054 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-a5c410d5-14e3-4cb0-8733-9c419423ba5f None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:37:28.265054 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-a5c410d5-14e3-4cb0-8733-9c419423ba5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:28.387734 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1291/2574] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:37:28 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:37:28.413893 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef4a5cc-282a-4180-a1d8-c9fe75a7c9fb None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:28.416814 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-6ef4a5cc-282a-4180-a1d8-c9fe75a7c9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:28.436436 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1284/2575] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:37:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:37:28.454119 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c410d5-14e3-4cb0-8733-9c419423ba5f None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:28.461839 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-a5c410d5-14e3-4cb0-8733-9c419423ba5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:28.583147 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef4a5cc-282a-4180-a1d8-c9fe75a7c9fb None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:28.659179 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:28.673292 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:28.677326 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c410d5-14e3-4cb0-8733-9c419423ba5f None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:28.694861 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ec6d6e-da23-46e0-847b-42593a61685c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:28.700293 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec6d6e-da23-46e0-847b-42593a61685c service neutron] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:28.701486 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec6d6e-da23-46e0-847b-42593a61685c service neutron] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:28.701677 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec6d6e-da23-46e0-847b-42593a61685c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:28.718855 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ec6d6e-da23-46e0-847b-42593a61685c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:28.720466 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ec6d6e-da23-46e0-847b-42593a61685c service neutron] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:28.735477 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ccd0b-931b-4fba-a8f7-2c5f0a453c14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:28.736366 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1285/2576] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:37:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:37:28.749284 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ccd0b-931b-4fba-a8f7-2c5f0a453c14 service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:28.749989 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ccd0b-931b-4fba-a8f7-2c5f0a453c14 service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:28.750572 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ccd0b-931b-4fba-a8f7-2c5f0a453c14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:28.896060 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ccd0b-931b-4fba-a8f7-2c5f0a453c14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:28.898526 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ccd0b-931b-4fba-a8f7-2c5f0a453c14 service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:28.913404 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1292/2577] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:37:28 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:37:29.121336 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ec6d6e-da23-46e0-847b-42593a61685c service neutron] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:29.123784 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-99ec6d6e-da23-46e0-847b-42593a61685c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:29.152300 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ec6d6e-da23-46e0-847b-42593a61685c service neutron] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:29.163342 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408d37e6-1207-4ecc-a845-b546bde5f726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:29.166207 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d37e6-1207-4ecc-a845-b546bde5f726 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:29.166681 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d37e6-1207-4ecc-a845-b546bde5f726 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:29.167163 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d37e6-1207-4ecc-a845-b546bde5f726 admin admin] PATH_INFO: `/v3/users/7dc222e17ad34071b9f1e28ad146eb22` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:29.169466 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408d37e6-1207-4ecc-a845-b546bde5f726 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dc222e17ad34071b9f1e28ad146eb22)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:29.174874 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408d37e6-1207-4ecc-a845-b546bde5f726 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:29.292383 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-408d37e6-1207-4ecc-a845-b546bde5f726 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dc222e17ad34071b9f1e28ad146eb22'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:29.294411 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-408d37e6-1207-4ecc-a845-b546bde5f726 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dc222e17ad34071b9f1e28ad146eb22'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:29.295308 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-408d37e6-1207-4ecc-a845-b546bde5f726 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dc222e17ad34071b9f1e28ad146eb22'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:29.314435 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-408d37e6-1207-4ecc-a845-b546bde5f726 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dc222e17ad34071b9f1e28ad146eb22'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:29.352361 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-408d37e6-1207-4ecc-a845-b546bde5f726 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dc222e17ad34071b9f1e28ad146eb22'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:29.378743 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1286/2578] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:37:29 2022] DELETE /identity/v3/users/7dc222e17ad34071b9f1e28ad146eb22 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:37:29.388386 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78289b8b-a550-4fb9-a376-3bdeb4783e21 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:29.389074 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78289b8b-a550-4fb9-a376-3bdeb4783e21 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:29.389620 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78289b8b-a550-4fb9-a376-3bdeb4783e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:29.423980 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408d37e6-1207-4ecc-a845-b546bde5f726 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:29.425629 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-408d37e6-1207-4ecc-a845-b546bde5f726 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:29.441024 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-78289b8b-a550-4fb9-a376-3bdeb4783e21 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:37:29.442905 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-78289b8b-a550-4fb9-a376-3bdeb4783e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:29.578789 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408d37e6-1207-4ecc-a845-b546bde5f726 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:29.580004 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1293/2579] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:37:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:37:29.585065 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793dddcd-1727-405a-8f03-f95a9bfa1f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:29.585780 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793dddcd-1727-405a-8f03-f95a9bfa1f3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:29.586374 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793dddcd-1727-405a-8f03-f95a9bfa1f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:29.586587 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793dddcd-1727-405a-8f03-f95a9bfa1f3a admin admin] PATH_INFO: `/v3/projects/7c4dddf37fcf4da19cfed86932e8383a` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:29.588660 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793dddcd-1727-405a-8f03-f95a9bfa1f3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c4dddf37fcf4da19cfed86932e8383a)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:29.589639 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78289b8b-a550-4fb9-a376-3bdeb4783e21 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:29.592370 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-78289b8b-a550-4fb9-a376-3bdeb4783e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:29.592723 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793dddcd-1727-405a-8f03-f95a9bfa1f3a admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:29.693630 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-793dddcd-1727-405a-8f03-f95a9bfa1f3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c4dddf37fcf4da19cfed86932e8383a', 'request_id': 'req-793dddcd-1727-405a-8f03-f95a9bfa1f3a'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:29.703791 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-793dddcd-1727-405a-8f03-f95a9bfa1f3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c4dddf37fcf4da19cfed86932e8383a', 'request_id': 'req-793dddcd-1727-405a-8f03-f95a9bfa1f3a'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:29.721493 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-793dddcd-1727-405a-8f03-f95a9bfa1f3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c4dddf37fcf4da19cfed86932e8383a', 'request_id': 'req-793dddcd-1727-405a-8f03-f95a9bfa1f3a'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:29.724708 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:29.737824 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78289b8b-a550-4fb9-a376-3bdeb4783e21 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:29.743462 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-793dddcd-1727-405a-8f03-f95a9bfa1f3a admin admin] The token cache is being invalidate because project 7c4dddf37fcf4da19cfed86932e8383a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:37:29.744041 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-793dddcd-1727-405a-8f03-f95a9bfa1f3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:29.745593 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-793dddcd-1727-405a-8f03-f95a9bfa1f3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:29.751645 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1287/2580] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:37:29 2022] DELETE /identity/v3/projects/7c4dddf37fcf4da19cfed86932e8383a => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:37:29.753340 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793dddcd-1727-405a-8f03-f95a9bfa1f3a admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:29.755850 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-793dddcd-1727-405a-8f03-f95a9bfa1f3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:29.829044 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:29.868569 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4eb605-d540-40af-8a4f-6847ad64eece service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:29.870142 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4eb605-d540-40af-8a4f-6847ad64eece service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:29.871026 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4eb605-d540-40af-8a4f-6847ad64eece service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:29.871976 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4eb605-d540-40af-8a4f-6847ad64eece service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:29.876322 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-6f4eb605-d540-40af-8a4f-6847ad64eece service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:29.908343 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793dddcd-1727-405a-8f03-f95a9bfa1f3a admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:29.915256 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf3a207-9655-4478-a46b-65486de4473b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:29.916560 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3a207-9655-4478-a46b-65486de4473b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:29.916560 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3a207-9655-4478-a46b-65486de4473b admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:29.916877 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3a207-9655-4478-a46b-65486de4473b admin admin] PATH_INFO: `/v3/users/717132a1633d47b7bdd5c722696ba63f` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:29.918177 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf3a207-9655-4478-a46b-65486de4473b admin admin] RBAC: Authorizing `identity:delete_user(user_id=717132a1633d47b7bdd5c722696ba63f)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:29.920320 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf3a207-9655-4478-a46b-65486de4473b admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:30.012051 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4eb605-d540-40af-8a4f-6847ad64eece service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:30.013733 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4eb605-d540-40af-8a4f-6847ad64eece service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:30.015611 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-cbf3a207-9655-4478-a46b-65486de4473b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '717132a1633d47b7bdd5c722696ba63f'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:30.017201 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-cbf3a207-9655-4478-a46b-65486de4473b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '717132a1633d47b7bdd5c722696ba63f'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:30.019119 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-cbf3a207-9655-4478-a46b-65486de4473b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '717132a1633d47b7bdd5c722696ba63f'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:30.031499 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1294/2581] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:37:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:37:30.033030 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-cbf3a207-9655-4478-a46b-65486de4473b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '717132a1633d47b7bdd5c722696ba63f'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:30.049881 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-cbf3a207-9655-4478-a46b-65486de4473b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '717132a1633d47b7bdd5c722696ba63f'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:30.066390 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1288/2582] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:37:29 2022] DELETE /identity/v3/users/717132a1633d47b7bdd5c722696ba63f => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:37:30.727612 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4eb605-d540-40af-8a4f-6847ad64eece service neutron] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:30.744419 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf3a207-9655-4478-a46b-65486de4473b admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:30.746129 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-cbf3a207-9655-4478-a46b-65486de4473b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:30.749439 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4eb605-d540-40af-8a4f-6847ad64eece service neutron] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:30.880346 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf3a207-9655-4478-a46b-65486de4473b admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:30.891083 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d5ce3-7358-4d0e-8ee7-9d71c7fae324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:30.892114 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d5ce3-7358-4d0e-8ee7-9d71c7fae324 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:30.892568 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d5ce3-7358-4d0e-8ee7-9d71c7fae324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:30.892973 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d5ce3-7358-4d0e-8ee7-9d71c7fae324 admin admin] PATH_INFO: `/v3/projects/c6936c9400104c758d3f7e93ce7e7745` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:30.894913 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4d5ce3-7358-4d0e-8ee7-9d71c7fae324 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6936c9400104c758d3f7e93ce7e7745)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:30.897790 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c063dde-5617-47f3-91b4-f263f5926500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:30.899074 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c063dde-5617-47f3-91b4-f263f5926500 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:30.899312 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4d5ce3-7358-4d0e-8ee7-9d71c7fae324 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:30.900024 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c063dde-5617-47f3-91b4-f263f5926500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:30.901247 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c063dde-5617-47f3-91b4-f263f5926500 admin admin] PATH_INFO: `/v3/projects/02298996a68f4c5f80a8de2686fd092e` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:30.903404 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c063dde-5617-47f3-91b4-f263f5926500 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02298996a68f4c5f80a8de2686fd092e)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:30.907728 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c063dde-5617-47f3-91b4-f263f5926500 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:30.931686 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:31.016812 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-3d4d5ce3-7358-4d0e-8ee7-9d71c7fae324 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6936c9400104c758d3f7e93ce7e7745', 'request_id': 'req-3d4d5ce3-7358-4d0e-8ee7-9d71c7fae324'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:31.038562 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-3d4d5ce3-7358-4d0e-8ee7-9d71c7fae324 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6936c9400104c758d3f7e93ce7e7745', 'request_id': 'req-3d4d5ce3-7358-4d0e-8ee7-9d71c7fae324'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:31.041200 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-1c063dde-5617-47f3-91b4-f263f5926500 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02298996a68f4c5f80a8de2686fd092e', 'request_id': 'req-1c063dde-5617-47f3-91b4-f263f5926500'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:31.055637 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-1c063dde-5617-47f3-91b4-f263f5926500 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02298996a68f4c5f80a8de2686fd092e', 'request_id': 'req-1c063dde-5617-47f3-91b4-f263f5926500'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:31.056431 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-3d4d5ce3-7358-4d0e-8ee7-9d71c7fae324 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6936c9400104c758d3f7e93ce7e7745', 'request_id': 'req-3d4d5ce3-7358-4d0e-8ee7-9d71c7fae324'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:31.074718 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-1c063dde-5617-47f3-91b4-f263f5926500 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02298996a68f4c5f80a8de2686fd092e', 'request_id': 'req-1c063dde-5617-47f3-91b4-f263f5926500'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:31.081215 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-3d4d5ce3-7358-4d0e-8ee7-9d71c7fae324 admin admin] The token cache is being invalidate because project c6936c9400104c758d3f7e93ce7e7745 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:37:31.081512 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-3d4d5ce3-7358-4d0e-8ee7-9d71c7fae324 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:31.083042 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-3d4d5ce3-7358-4d0e-8ee7-9d71c7fae324 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:31.087243 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1289/2583] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:37:30 2022] DELETE /identity/v3/projects/c6936c9400104c758d3f7e93ce7e7745 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:37:31.092128 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d5ce3-7358-4d0e-8ee7-9d71c7fae324 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:31.096998 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-3d4d5ce3-7358-4d0e-8ee7-9d71c7fae324 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:31.117347 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-1c063dde-5617-47f3-91b4-f263f5926500 admin admin] The token cache is being invalidate because project 02298996a68f4c5f80a8de2686fd092e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:37:31.117935 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-1c063dde-5617-47f3-91b4-f263f5926500 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:31.119303 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-1c063dde-5617-47f3-91b4-f263f5926500 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:31.128090 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1295/2584] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:37:30 2022] DELETE /identity/v3/projects/02298996a68f4c5f80a8de2686fd092e => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:37:31.136459 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0d833-3cbf-46ee-a2a4-9fc1b590619e None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:31.136880 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0d833-3cbf-46ee-a2a4-9fc1b590619e None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:31.138612 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0d833-3cbf-46ee-a2a4-9fc1b590619e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:31.181977 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-32e0d833-3cbf-46ee-a2a4-9fc1b590619e None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:37:31.183477 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-32e0d833-3cbf-46ee-a2a4-9fc1b590619e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:31.204216 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:31.261882 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d5ce3-7358-4d0e-8ee7-9d71c7fae324 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:31.278173 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1296/2585] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:37:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:37:31.286760 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f35785-0985-4ff7-a3f3-ea41ab8bfd2f None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:31.287046 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f35785-0985-4ff7-a3f3-ea41ab8bfd2f None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:31.287470 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f35785-0985-4ff7-a3f3-ea41ab8bfd2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:31.314258 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-17f35785-0985-4ff7-a3f3-ea41ab8bfd2f None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:37:31.316640 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-17f35785-0985-4ff7-a3f3-ea41ab8bfd2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:31.332763 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1297/2586] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:37:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:37:31.339872 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f35785-0985-4ff7-a3f3-ea41ab8bfd2f None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:31.355100 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f35785-0985-4ff7-a3f3-ea41ab8bfd2f None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:31.361630 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c948f41-9da4-4e4f-9746-738c7fa54bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:31.362547 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c948f41-9da4-4e4f-9746-738c7fa54bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:31.362945 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c948f41-9da4-4e4f-9746-738c7fa54bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:31.363410 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c948f41-9da4-4e4f-9746-738c7fa54bc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:31.364327 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c948f41-9da4-4e4f-9746-738c7fa54bc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:37:31.364911 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c948f41-9da4-4e4f-9746-738c7fa54bc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:31.367506 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c948f41-9da4-4e4f-9746-738c7fa54bc9 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:31.387612 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1298/2587] 10.222.0.91 () {58 vars in 1153 bytes} [Tue Aug 30 04:37:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:37:31.392550 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c948f41-9da4-4e4f-9746-738c7fa54bc9 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:31.402112 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f328d70-cc15-48ae-bd61-e8cb2d535108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:31.403565 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f328d70-cc15-48ae-bd61-e8cb2d535108 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:31.404159 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f328d70-cc15-48ae-bd61-e8cb2d535108 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:31.404696 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f328d70-cc15-48ae-bd61-e8cb2d535108 admin admin] PATH_INFO: `/v3/users/1cefe5813561411d8216267d419326a5` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:31.407336 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c948f41-9da4-4e4f-9746-738c7fa54bc9 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:31.407598 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f328d70-cc15-48ae-bd61-e8cb2d535108 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cefe5813561411d8216267d419326a5)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:31.413400 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f328d70-cc15-48ae-bd61-e8cb2d535108 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:31.418302 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd1f01-ac62-4560-8d88-8fab9e2bd55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:31.419833 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd1f01-ac62-4560-8d88-8fab9e2bd55b admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:31.419833 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd1f01-ac62-4560-8d88-8fab9e2bd55b admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:31.419833 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd1f01-ac62-4560-8d88-8fab9e2bd55b admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:31.420515 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bd1f01-ac62-4560-8d88-8fab9e2bd55b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:31.423440 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bd1f01-ac62-4560-8d88-8fab9e2bd55b admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:31.471518 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1299/2588] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:37:31 2022] POST /identity/v3/projects => generated 375 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:37:31.478063 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd1f01-ac62-4560-8d88-8fab9e2bd55b admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:31.570811 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-8f328d70-cc15-48ae-bd61-e8cb2d535108 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cefe5813561411d8216267d419326a5'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:31.573678 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-8f328d70-cc15-48ae-bd61-e8cb2d535108 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cefe5813561411d8216267d419326a5'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:31.575047 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-8f328d70-cc15-48ae-bd61-e8cb2d535108 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cefe5813561411d8216267d419326a5'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:31.581985 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:31.603193 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-8f328d70-cc15-48ae-bd61-e8cb2d535108 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cefe5813561411d8216267d419326a5'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:31.645871 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-8f328d70-cc15-48ae-bd61-e8cb2d535108 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cefe5813561411d8216267d419326a5'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:31.666644 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd1f01-ac62-4560-8d88-8fab9e2bd55b admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:31.681240 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7759346-5453-4b2b-9efa-2b855acfd564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:31.682969 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7759346-5453-4b2b-9efa-2b855acfd564 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:31.683454 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7759346-5453-4b2b-9efa-2b855acfd564 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:31.683980 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7759346-5453-4b2b-9efa-2b855acfd564 admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:31.685721 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7759346-5453-4b2b-9efa-2b855acfd564 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:31.689109 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7759346-5453-4b2b-9efa-2b855acfd564 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:31.697100 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1290/2589] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:37:31 2022] DELETE /identity/v3/users/1cefe5813561411d8216267d419326a5 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:37:31.739469 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1300/2590] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:37:31 2022] POST /identity/v3/users => generated 288 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:37:31.747759 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f328d70-cc15-48ae-bd61-e8cb2d535108 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:31.761513 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-8f328d70-cc15-48ae-bd61-e8cb2d535108 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:31.922153 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f328d70-cc15-48ae-bd61-e8cb2d535108 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:31.928048 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dde00a2-6496-4834-a05d-7f0564054773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:31.929304 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde00a2-6496-4834-a05d-7f0564054773 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:31.929762 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde00a2-6496-4834-a05d-7f0564054773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:31.930214 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde00a2-6496-4834-a05d-7f0564054773 admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:31.931639 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dde00a2-6496-4834-a05d-7f0564054773 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:31.933680 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dde00a2-6496-4834-a05d-7f0564054773 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:31.954538 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1291/2591] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:37:31.955887 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7759346-5453-4b2b-9efa-2b855acfd564 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:31.981318 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7759346-5453-4b2b-9efa-2b855acfd564 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:31.996554 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d3ca8-4fc9-454f-96dc-4ec70cc11cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:31.997671 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d3ca8-4fc9-454f-96dc-4ec70cc11cbc admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:31.998150 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d3ca8-4fc9-454f-96dc-4ec70cc11cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:31.998625 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d3ca8-4fc9-454f-96dc-4ec70cc11cbc admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:31.999864 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97d3ca8-4fc9-454f-96dc-4ec70cc11cbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:32.005992 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97d3ca8-4fc9-454f-96dc-4ec70cc11cbc admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:32.029832 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1301/2592] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:37:32.034719 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dde00a2-6496-4834-a05d-7f0564054773 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:32.054516 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dde00a2-6496-4834-a05d-7f0564054773 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:32.061115 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5682c56-4186-4959-9fe0-8a4d15671cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:32.062300 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5682c56-4186-4959-9fe0-8a4d15671cee admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:32.062300 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5682c56-4186-4959-9fe0-8a4d15671cee admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:32.062617 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5682c56-4186-4959-9fe0-8a4d15671cee admin admin] PATH_INFO: `/v3/projects/3300182b12024a28a53466ade381204c/users/f7f5a1cb35994f4f93b385f363d72219/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:32.086136 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5682c56-4186-4959-9fe0-8a4d15671cee admin admin] RBAC: Authorizing `identity:create_grant(project_id=3300182b12024a28a53466ade381204c, user_id=f7f5a1cb35994f4f93b385f363d72219, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:32.089299 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5682c56-4186-4959-9fe0-8a4d15671cee admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:32.132035 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1292/2593] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:37:32 2022] PUT /identity/v3/projects/3300182b12024a28a53466ade381204c/users/f7f5a1cb35994f4f93b385f363d72219/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:37:32.160248 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834814d6-a506-4240-9890-a6423efa7587 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:32.160816 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834814d6-a506-4240-9890-a6423efa7587 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:32.161306 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834814d6-a506-4240-9890-a6423efa7587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:32.260967 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-834814d6-a506-4240-9890-a6423efa7587 None None] MFA Rules not processed for user `f7f5a1cb35994f4f93b385f363d72219`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:37:32.262306 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-834814d6-a506-4240-9890-a6423efa7587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:32.343755 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:32.422441 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1302/2594] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:37:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:37:32.428918 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5682c56-4186-4959-9fe0-8a4d15671cee admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:32.474775 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834814d6-a506-4240-9890-a6423efa7587 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:32.480390 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-834814d6-a506-4240-9890-a6423efa7587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:32.643793 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5682c56-4186-4959-9fe0-8a4d15671cee admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:32.647353 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834814d6-a506-4240-9890-a6423efa7587 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:32.656807 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2529908c-a3e6-49de-91f8-e73599ef1164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:32.659791 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529908c-a3e6-49de-91f8-e73599ef1164 admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:32.660263 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529908c-a3e6-49de-91f8-e73599ef1164 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:32.660700 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529908c-a3e6-49de-91f8-e73599ef1164 admin admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:32.662505 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2529908c-a3e6-49de-91f8-e73599ef1164 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:32.666237 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dc4b3b-be62-457e-8864-228dbb7f1567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:32.667350 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc4b3b-be62-457e-8864-228dbb7f1567 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:32.667829 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc4b3b-be62-457e-8864-228dbb7f1567 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:32.668549 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc4b3b-be62-457e-8864-228dbb7f1567 admin admin] PATH_INFO: `/v3/projects/8142e53dba514e679ad6e1032cd9291f` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:32.670858 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2529908c-a3e6-49de-91f8-e73599ef1164 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:32.673557 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dc4b3b-be62-457e-8864-228dbb7f1567 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8142e53dba514e679ad6e1032cd9291f)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:32.679716 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dc4b3b-be62-457e-8864-228dbb7f1567 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:32.748197 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1293/2595] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:37:32 2022] POST /identity/v3/projects => generated 375 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:37:32.749489 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2529908c-a3e6-49de-91f8-e73599ef1164 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:32.801008 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:32.812621 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-77dc4b3b-be62-457e-8864-228dbb7f1567 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8142e53dba514e679ad6e1032cd9291f', 'request_id': 'req-77dc4b3b-be62-457e-8864-228dbb7f1567'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:32.834048 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-77dc4b3b-be62-457e-8864-228dbb7f1567 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8142e53dba514e679ad6e1032cd9291f', 'request_id': 'req-77dc4b3b-be62-457e-8864-228dbb7f1567'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:32.847575 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-77dc4b3b-be62-457e-8864-228dbb7f1567 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8142e53dba514e679ad6e1032cd9291f', 'request_id': 'req-77dc4b3b-be62-457e-8864-228dbb7f1567'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:32.857957 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2529908c-a3e6-49de-91f8-e73599ef1164 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:32.888290 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-77dc4b3b-be62-457e-8864-228dbb7f1567 admin admin] The token cache is being invalidate because project 8142e53dba514e679ad6e1032cd9291f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:37:32.890389 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-77dc4b3b-be62-457e-8864-228dbb7f1567 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:32.891674 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-77dc4b3b-be62-457e-8864-228dbb7f1567 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:32.895751 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1303/2596] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:37:32 2022] DELETE /identity/v3/projects/8142e53dba514e679ad6e1032cd9291f => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:37:32.902193 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5b960-8cbb-42e7-87ae-d8ee7dd4c3cb None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:32.902866 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5b960-8cbb-42e7-87ae-d8ee7dd4c3cb None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:32.904915 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5b960-8cbb-42e7-87ae-d8ee7dd4c3cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:32.949822 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-fbe5b960-8cbb-42e7-87ae-d8ee7dd4c3cb None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:37:32.951633 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-fbe5b960-8cbb-42e7-87ae-d8ee7dd4c3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:33.000703 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e25f39-e037-4006-a50c-b49a837f13ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:33.002409 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e25f39-e037-4006-a50c-b49a837f13ba admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:33.002952 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e25f39-e037-4006-a50c-b49a837f13ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:33.003547 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e25f39-e037-4006-a50c-b49a837f13ba admin admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:33.006438 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e25f39-e037-4006-a50c-b49a837f13ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:33.012064 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e25f39-e037-4006-a50c-b49a837f13ba admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:33.082653 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1294/2597] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:37:32 2022] POST /identity/v3/users => generated 288 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:37:33.085906 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e25f39-e037-4006-a50c-b49a837f13ba admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:33.089806 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-70e25f39-e037-4006-a50c-b49a837f13ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:33.123467 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e25f39-e037-4006-a50c-b49a837f13ba admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:33.133895 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b465aa-82a7-4bbf-a7a3-9f68323ee438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:33.135038 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b465aa-82a7-4bbf-a7a3-9f68323ee438 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:33.135541 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b465aa-82a7-4bbf-a7a3-9f68323ee438 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:33.136265 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b465aa-82a7-4bbf-a7a3-9f68323ee438 admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:33.136875 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1304/2598] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:37:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:37:33.137506 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b465aa-82a7-4bbf-a7a3-9f68323ee438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:33.141860 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b465aa-82a7-4bbf-a7a3-9f68323ee438 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:33.146200 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728919b-9de0-4d2e-bf0e-0a4a17393639 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:33.147130 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728919b-9de0-4d2e-bf0e-0a4a17393639 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:33.147980 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728919b-9de0-4d2e-bf0e-0a4a17393639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:33.175778 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1295/2599] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:37:33.186402 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b465aa-82a7-4bbf-a7a3-9f68323ee438 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:33.205756 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-b728919b-9de0-4d2e-bf0e-0a4a17393639 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:37:33.209931 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-b728919b-9de0-4d2e-bf0e-0a4a17393639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:33.238363 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b465aa-82a7-4bbf-a7a3-9f68323ee438 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:33.261742 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea3e69-cc67-4119-bc77-d35b0672c7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:33.262836 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea3e69-cc67-4119-bc77-d35b0672c7ce admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:33.263382 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea3e69-cc67-4119-bc77-d35b0672c7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:33.264374 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea3e69-cc67-4119-bc77-d35b0672c7ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:33.265696 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cea3e69-cc67-4119-bc77-d35b0672c7ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:33.274055 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cea3e69-cc67-4119-bc77-d35b0672c7ce admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:33.288388 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1305/2600] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:37:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:37:33.305784 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b728919b-9de0-4d2e-bf0e-0a4a17393639 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:33.318686 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1296/2601] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:37:33.329694 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea3e69-cc67-4119-bc77-d35b0672c7ce admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:33.341136 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b728919b-9de0-4d2e-bf0e-0a4a17393639 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:33.346598 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a145ca-49f9-4bd6-8d35-fe95b99021c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:33.347238 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a145ca-49f9-4bd6-8d35-fe95b99021c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:33.347686 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a145ca-49f9-4bd6-8d35-fe95b99021c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:33.348191 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a145ca-49f9-4bd6-8d35-fe95b99021c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:33.348833 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a145ca-49f9-4bd6-8d35-fe95b99021c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:37:33.349558 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a145ca-49f9-4bd6-8d35-fe95b99021c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:33.352184 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a145ca-49f9-4bd6-8d35-fe95b99021c9 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:33.354407 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:33.369465 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea3e69-cc67-4119-bc77-d35b0672c7ce admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:33.379879 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f629e33-3a61-4bf3-9f3c-1d733cb9d020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:33.381742 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1306/2602] 10.222.0.91 () {58 vars in 1153 bytes} [Tue Aug 30 04:37:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:37:33.382757 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a145ca-49f9-4bd6-8d35-fe95b99021c9 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:33.382909 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f629e33-3a61-4bf3-9f3c-1d733cb9d020 admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:33.383179 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f629e33-3a61-4bf3-9f3c-1d733cb9d020 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:33.384213 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f629e33-3a61-4bf3-9f3c-1d733cb9d020 admin admin] PATH_INFO: `/v3/projects/d10848b0b4e14b9799dd51fc42344140/users/26ee1760c56549a7ba2905357638a59b/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:33.414663 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f629e33-3a61-4bf3-9f3c-1d733cb9d020 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d10848b0b4e14b9799dd51fc42344140, user_id=26ee1760c56549a7ba2905357638a59b, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:33.420037 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f629e33-3a61-4bf3-9f3c-1d733cb9d020 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:33.430172 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a145ca-49f9-4bd6-8d35-fe95b99021c9 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:33.446096 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e48a55-3bca-4e18-9ae6-22d707e27275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:33.448312 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e48a55-3bca-4e18-9ae6-22d707e27275 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:33.449215 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e48a55-3bca-4e18-9ae6-22d707e27275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:33.449854 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e48a55-3bca-4e18-9ae6-22d707e27275 admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:33.450942 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e48a55-3bca-4e18-9ae6-22d707e27275 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:33.464052 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1297/2603] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:37:33 2022] PUT /identity/v3/projects/d10848b0b4e14b9799dd51fc42344140/users/26ee1760c56549a7ba2905357638a59b/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:37:33.467478 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e48a55-3bca-4e18-9ae6-22d707e27275 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:33.469760 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162fb87-9326-4233-b46a-a50193e5ab92 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:33.471788 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162fb87-9326-4233-b46a-a50193e5ab92 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:33.471885 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162fb87-9326-4233-b46a-a50193e5ab92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:33.524699 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1307/2604] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:37:33 2022] POST /identity/v3/projects => generated 357 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:37:33.530413 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e48a55-3bca-4e18-9ae6-22d707e27275 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:33.597299 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-4162fb87-9326-4233-b46a-a50193e5ab92 None None] MFA Rules not processed for user `26ee1760c56549a7ba2905357638a59b`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:37:33.602947 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-4162fb87-9326-4233-b46a-a50193e5ab92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:33.744502 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e48a55-3bca-4e18-9ae6-22d707e27275 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:33.767281 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0416e32-4aa3-4951-bc2a-d53df46129f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:33.774347 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0416e32-4aa3-4951-bc2a-d53df46129f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:33.774749 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0416e32-4aa3-4951-bc2a-d53df46129f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:33.775498 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0416e32-4aa3-4951-bc2a-d53df46129f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:33.793520 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0416e32-4aa3-4951-bc2a-d53df46129f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:33.795690 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0416e32-4aa3-4951-bc2a-d53df46129f1 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:33.896725 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1308/2605] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:37:33 2022] POST /identity/v3/users => generated 279 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:37:33.901255 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0416e32-4aa3-4951-bc2a-d53df46129f1 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:33.921569 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0416e32-4aa3-4951-bc2a-d53df46129f1 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:33.943159 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2008b9df-966c-4a5b-9118-ddbefcffce89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:33.944274 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008b9df-966c-4a5b-9118-ddbefcffce89 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:33.944803 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008b9df-966c-4a5b-9118-ddbefcffce89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:33.945130 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008b9df-966c-4a5b-9118-ddbefcffce89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:33.945848 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2008b9df-966c-4a5b-9118-ddbefcffce89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:33.947524 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2008b9df-966c-4a5b-9118-ddbefcffce89 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:33.950995 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1298/2606] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:37:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 481 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:37:33.956092 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4162fb87-9326-4233-b46a-a50193e5ab92 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:33.967004 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:33.988985 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4162fb87-9326-4233-b46a-a50193e5ab92 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:33.992057 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1309/2607] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:37:33.995391 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2008b9df-966c-4a5b-9118-ddbefcffce89 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:34.008953 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2008b9df-966c-4a5b-9118-ddbefcffce89 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:34.013146 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd347a-94f4-489b-8627-4da32464113d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:34.014350 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd347a-94f4-489b-8627-4da32464113d admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:34.015247 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd347a-94f4-489b-8627-4da32464113d admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:34.015772 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0978f2-1e79-4323-a877-1c6c0fbb078e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:34.015965 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd347a-94f4-489b-8627-4da32464113d admin admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:34.018168 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0978f2-1e79-4323-a877-1c6c0fbb078e admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:34.020394 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0978f2-1e79-4323-a877-1c6c0fbb078e admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:34.023103 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fd347a-94f4-489b-8627-4da32464113d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:34.024222 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0978f2-1e79-4323-a877-1c6c0fbb078e admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:34.030644 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0978f2-1e79-4323-a877-1c6c0fbb078e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:34.033711 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fd347a-94f4-489b-8627-4da32464113d admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:34.038036 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0978f2-1e79-4323-a877-1c6c0fbb078e admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:34.081512 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1310/2608] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:37:34.084998 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0978f2-1e79-4323-a877-1c6c0fbb078e admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:34.123431 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0978f2-1e79-4323-a877-1c6c0fbb078e admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:34.131955 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13eb018-5b99-4259-8359-119ce0a9eca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:34.132776 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13eb018-5b99-4259-8359-119ce0a9eca3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:34.133156 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13eb018-5b99-4259-8359-119ce0a9eca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:34.133408 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13eb018-5b99-4259-8359-119ce0a9eca3 admin admin] PATH_INFO: `/v3/projects/51571af25ec64fa0b196dbe22596abdd/users/226f3fbd514e4946bbc99a3b315a671f/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:34.180649 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1299/2609] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:37:33 2022] POST /identity/v3/projects => generated 377 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:37:34.185016 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd347a-94f4-489b-8627-4da32464113d admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:34.215794 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13eb018-5b99-4259-8359-119ce0a9eca3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51571af25ec64fa0b196dbe22596abdd, user_id=226f3fbd514e4946bbc99a3b315a671f, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:34.232574 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13eb018-5b99-4259-8359-119ce0a9eca3 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:34.270802 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1311/2610] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:37:34 2022] PUT /identity/v3/projects/51571af25ec64fa0b196dbe22596abdd/users/226f3fbd514e4946bbc99a3b315a671f/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:37:34.296909 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa174327-a9d1-4c9b-9218-b19292e1fdf8 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:34.297591 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa174327-a9d1-4c9b-9218-b19292e1fdf8 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:34.298144 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa174327-a9d1-4c9b-9218-b19292e1fdf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:34.368655 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-aa174327-a9d1-4c9b-9218-b19292e1fdf8 None None] MFA Rules not processed for user `226f3fbd514e4946bbc99a3b315a671f`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:37:34.372584 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-aa174327-a9d1-4c9b-9218-b19292e1fdf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:34.382120 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd347a-94f4-489b-8627-4da32464113d admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:34.492769 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a84ff00-df42-4a36-ae29-c3edea5b921e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:34.493674 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a84ff00-df42-4a36-ae29-c3edea5b921e admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:34.494048 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a84ff00-df42-4a36-ae29-c3edea5b921e admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:34.494476 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a84ff00-df42-4a36-ae29-c3edea5b921e admin admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:34.495398 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a84ff00-df42-4a36-ae29-c3edea5b921e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:34.497540 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a84ff00-df42-4a36-ae29-c3edea5b921e admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:34.537548 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1300/2611] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:37:34 2022] POST /identity/v3/users => generated 295 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:37:34.547062 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a84ff00-df42-4a36-ae29-c3edea5b921e admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:34.550571 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1312/2612] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:37:34 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:37:34.556732 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa174327-a9d1-4c9b-9218-b19292e1fdf8 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:34.569988 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a84ff00-df42-4a36-ae29-c3edea5b921e admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:34.585933 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdd3d3a-4033-4372-8530-a81c85ed2cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:34.586750 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd3d3a-4033-4372-8530-a81c85ed2cc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:34.586750 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd3d3a-4033-4372-8530-a81c85ed2cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:34.586957 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd3d3a-4033-4372-8530-a81c85ed2cc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:34.587612 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdd3d3a-4033-4372-8530-a81c85ed2cc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:34.589484 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdd3d3a-4033-4372-8530-a81c85ed2cc1 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:34.600184 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa174327-a9d1-4c9b-9218-b19292e1fdf8 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:34.606812 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1301/2613] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:37:34 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:37:34.614144 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdd3d3a-4033-4372-8530-a81c85ed2cc1 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:34.618707 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff756d-aac3-4366-9cca-62e581f32d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:34.619423 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff756d-aac3-4366-9cca-62e581f32d90 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:34.624210 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff756d-aac3-4366-9cca-62e581f32d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:34.624683 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff756d-aac3-4366-9cca-62e581f32d90 admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:34.625472 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ff756d-aac3-4366-9cca-62e581f32d90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:34.627852 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ff756d-aac3-4366-9cca-62e581f32d90 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:34.636362 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdd3d3a-4033-4372-8530-a81c85ed2cc1 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:34.643144 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aec5cb4-fc1e-4cd1-ba59-dc07794a2e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:34.643299 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:34.644222 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec5cb4-fc1e-4cd1-ba59-dc07794a2e87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:34.644544 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec5cb4-fc1e-4cd1-ba59-dc07794a2e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:34.644832 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec5cb4-fc1e-4cd1-ba59-dc07794a2e87 admin admin] PATH_INFO: `/v3/projects/b98b10958807485db031722e31cbb12f/users/5e26bfe0ef0f447cb6811465ab822c01/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:34.668776 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aec5cb4-fc1e-4cd1-ba59-dc07794a2e87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b98b10958807485db031722e31cbb12f, user_id=5e26bfe0ef0f447cb6811465ab822c01, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:34.672672 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aec5cb4-fc1e-4cd1-ba59-dc07794a2e87 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:34.679803 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1313/2614] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:37:34 2022] POST /identity/v3/projects => generated 355 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:37:34.689216 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff756d-aac3-4366-9cca-62e581f32d90 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:34.714561 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1302/2615] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:37:34 2022] PUT /identity/v3/projects/b98b10958807485db031722e31cbb12f/users/5e26bfe0ef0f447cb6811465ab822c01/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:37:34.716338 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aec5cb4-fc1e-4cd1-ba59-dc07794a2e87 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:34.775535 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff756d-aac3-4366-9cca-62e581f32d90 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:34.804695 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:34.845101 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aec5cb4-fc1e-4cd1-ba59-dc07794a2e87 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:34.851483 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa0eb9-f8a3-4a77-9f8e-f6183eaae64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:34.852177 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa0eb9-f8a3-4a77-9f8e-f6183eaae64a admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:34.852466 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa0eb9-f8a3-4a77-9f8e-f6183eaae64a admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:34.852723 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa0eb9-f8a3-4a77-9f8e-f6183eaae64a admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:34.853397 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aa0eb9-f8a3-4a77-9f8e-f6183eaae64a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:34.855263 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aa0eb9-f8a3-4a77-9f8e-f6183eaae64a admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:34.860205 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0a8d1-13db-4e3c-88de-dafe82a744df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:34.861169 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0a8d1-13db-4e3c-88de-dafe82a744df admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:34.861650 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0a8d1-13db-4e3c-88de-dafe82a744df admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:34.865215 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0a8d1-13db-4e3c-88de-dafe82a744df admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:34.866404 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae0a8d1-13db-4e3c-88de-dafe82a744df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:34.871899 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae0a8d1-13db-4e3c-88de-dafe82a744df admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:34.883800 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1303/2616] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:37:34 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:37:34.890887 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa0eb9-f8a3-4a77-9f8e-f6183eaae64a admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:34.908101 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1314/2617] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:37:34 2022] POST /identity/v3/users => generated 284 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:37:34.910055 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa0eb9-f8a3-4a77-9f8e-f6183eaae64a admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:34.916313 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0a8d1-13db-4e3c-88de-dafe82a744df admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:34.918353 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511a4314-9a92-4ae1-8e96-ed3e3a503ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:34.919171 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a4314-9a92-4ae1-8e96-ed3e3a503ce6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:34.919552 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a4314-9a92-4ae1-8e96-ed3e3a503ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:34.919968 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a4314-9a92-4ae1-8e96-ed3e3a503ce6 admin admin] PATH_INFO: `/v3/projects/b98b10958807485db031722e31cbb12f/users/5e26bfe0ef0f447cb6811465ab822c01/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:34.922617 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511a4314-9a92-4ae1-8e96-ed3e3a503ce6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b98b10958807485db031722e31cbb12f, user_id=5e26bfe0ef0f447cb6811465ab822c01, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:34.927751 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511a4314-9a92-4ae1-8e96-ed3e3a503ce6 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:34.937916 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0a8d1-13db-4e3c-88de-dafe82a744df admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:34.979414 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1304/2618] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:37:34 2022] PUT /identity/v3/projects/b98b10958807485db031722e31cbb12f/users/5e26bfe0ef0f447cb6811465ab822c01/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:37:34.986258 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af946c-8989-4022-b3e9-15af9504ea00 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:34.986740 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af946c-8989-4022-b3e9-15af9504ea00 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:34.987221 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af946c-8989-4022-b3e9-15af9504ea00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:35.052525 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-08af946c-8989-4022-b3e9-15af9504ea00 None None] MFA Rules not processed for user `5e26bfe0ef0f447cb6811465ab822c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:37:35.054052 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-08af946c-8989-4022-b3e9-15af9504ea00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:35.117944 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083bc877-7d73-48f6-85af-9929c8d5d7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:35.119437 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083bc877-7d73-48f6-85af-9929c8d5d7bd admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:35.119725 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083bc877-7d73-48f6-85af-9929c8d5d7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:35.120022 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083bc877-7d73-48f6-85af-9929c8d5d7bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:35.121618 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083bc877-7d73-48f6-85af-9929c8d5d7bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:35.124822 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083bc877-7d73-48f6-85af-9929c8d5d7bd admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:35.170305 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1315/2619] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:37:34 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:37:35.171994 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083bc877-7d73-48f6-85af-9929c8d5d7bd admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:35.198231 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083bc877-7d73-48f6-85af-9929c8d5d7bd admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:35.205841 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1305/2620] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:37:34 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:37:35.218183 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db6152-8597-468f-8f96-3c1aa628ef47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:35.219325 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db6152-8597-468f-8f96-3c1aa628ef47 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:35.220599 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db6152-8597-468f-8f96-3c1aa628ef47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:35.221107 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db6152-8597-468f-8f96-3c1aa628ef47 admin admin] PATH_INFO: `/v3/projects/945f4eaf67e24f39a86fbe5d0ac0c260/users/b94bb7d8fb8a432b931384baaf8c42dc/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:35.223339 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08af946c-8989-4022-b3e9-15af9504ea00 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:35.225916 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-08af946c-8989-4022-b3e9-15af9504ea00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:35.285327 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14db6152-8597-468f-8f96-3c1aa628ef47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=945f4eaf67e24f39a86fbe5d0ac0c260, user_id=b94bb7d8fb8a432b931384baaf8c42dc, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:35.296480 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14db6152-8597-468f-8f96-3c1aa628ef47 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:35.301740 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:35.352397 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1316/2621] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:37:35 2022] PUT /identity/v3/projects/945f4eaf67e24f39a86fbe5d0ac0c260/users/b94bb7d8fb8a432b931384baaf8c42dc/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:37:35.352659 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08af946c-8989-4022-b3e9-15af9504ea00 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:35.357295 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db6152-8597-468f-8f96-3c1aa628ef47 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:35.469873 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e2f08-c8fe-4951-a10b-725d189567f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:35.470523 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e2f08-c8fe-4951-a10b-725d189567f2 service cinder] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:35.470845 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e2f08-c8fe-4951-a10b-725d189567f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:35.471086 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e2f08-c8fe-4951-a10b-725d189567f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:35.480669 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-b94e2f08-c8fe-4951-a10b-725d189567f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:35.542141 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:35.576222 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db6152-8597-468f-8f96-3c1aa628ef47 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:35.585596 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab12e7d-b8e2-46b2-bcfa-2fc696630fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:35.586855 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab12e7d-b8e2-46b2-bcfa-2fc696630fb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:35.587609 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab12e7d-b8e2-46b2-bcfa-2fc696630fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:35.588391 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab12e7d-b8e2-46b2-bcfa-2fc696630fb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:35.589950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab12e7d-b8e2-46b2-bcfa-2fc696630fb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:35.593819 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab12e7d-b8e2-46b2-bcfa-2fc696630fb1 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:35.606996 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e2f08-c8fe-4951-a10b-725d189567f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:35.608751 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e2f08-c8fe-4951-a10b-725d189567f2 service cinder] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:35.610733 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1317/2622] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:37:35 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:37:35.616624 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab12e7d-b8e2-46b2-bcfa-2fc696630fb1 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:35.630265 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab12e7d-b8e2-46b2-bcfa-2fc696630fb1 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:35.637750 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c47db-1a83-4c05-8ded-b199d9eb28db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:35.639367 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c47db-1a83-4c05-8ded-b199d9eb28db admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:35.639756 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c47db-1a83-4c05-8ded-b199d9eb28db admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:35.640171 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c47db-1a83-4c05-8ded-b199d9eb28db admin admin] PATH_INFO: `/v3/projects/945f4eaf67e24f39a86fbe5d0ac0c260/users/b94bb7d8fb8a432b931384baaf8c42dc/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:35.642891 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5c47db-1a83-4c05-8ded-b199d9eb28db admin admin] RBAC: Authorizing `identity:create_grant(project_id=945f4eaf67e24f39a86fbe5d0ac0c260, user_id=b94bb7d8fb8a432b931384baaf8c42dc, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:35.646314 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5c47db-1a83-4c05-8ded-b199d9eb28db admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:35.652026 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1306/2623] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:37:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:37:35.660470 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1318/2624] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:37:35 2022] PUT /identity/v3/projects/945f4eaf67e24f39a86fbe5d0ac0c260/users/b94bb7d8fb8a432b931384baaf8c42dc/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:37:35.679006 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369af57-6649-4b8b-b790-41883fc7ccee None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:35.679006 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369af57-6649-4b8b-b790-41883fc7ccee None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:35.679006 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369af57-6649-4b8b-b790-41883fc7ccee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:35.748426 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-4369af57-6649-4b8b-b790-41883fc7ccee None None] MFA Rules not processed for user `b94bb7d8fb8a432b931384baaf8c42dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:37:35.749838 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-4369af57-6649-4b8b-b790-41883fc7ccee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:35.891775 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1307/2625] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:37:35 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:37:35.909655 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c47db-1a83-4c05-8ded-b199d9eb28db admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:35.915530 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-7b5c47db-1a83-4c05-8ded-b199d9eb28db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:36.035573 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c47db-1a83-4c05-8ded-b199d9eb28db admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:36.047094 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf5056-fc37-4e61-b81c-6ecba0ff21ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:36.047442 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf5056-fc37-4e61-b81c-6ecba0ff21ae service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:36.047625 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf5056-fc37-4e61-b81c-6ecba0ff21ae service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:36.047805 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf5056-fc37-4e61-b81c-6ecba0ff21ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:36.064867 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febf5056-fc37-4e61-b81c-6ecba0ff21ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:36.074753 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febf5056-fc37-4e61-b81c-6ecba0ff21ae service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:36.103934 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1319/2626] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:37:35 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:37:36.332093 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4369af57-6649-4b8b-b790-41883fc7ccee None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:36.353870 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4369af57-6649-4b8b-b790-41883fc7ccee None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:36.358153 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b62aed-dbeb-4d48-bd43-3172b2cf8e8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:36.358801 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b62aed-dbeb-4d48-bd43-3172b2cf8e8e service cinder] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:36.359162 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b62aed-dbeb-4d48-bd43-3172b2cf8e8e service cinder] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:36.359349 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b62aed-dbeb-4d48-bd43-3172b2cf8e8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:36.437929 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b62aed-dbeb-4d48-bd43-3172b2cf8e8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:36.439642 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b62aed-dbeb-4d48-bd43-3172b2cf8e8e service cinder] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:36.451965 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1308/2627] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:37:36 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:37:37.900798 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf5056-fc37-4e61-b81c-6ecba0ff21ae service cinder] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:37.935785 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf5056-fc37-4e61-b81c-6ecba0ff21ae service cinder] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:37.957943 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c502b5-e3c7-4ba2-8ce1-2e08b317269e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:37.958992 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c502b5-e3c7-4ba2-8ce1-2e08b317269e service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:37.959413 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c502b5-e3c7-4ba2-8ce1-2e08b317269e service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:37.959871 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c502b5-e3c7-4ba2-8ce1-2e08b317269e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:38.052472 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c502b5-e3c7-4ba2-8ce1-2e08b317269e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:38.054007 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c502b5-e3c7-4ba2-8ce1-2e08b317269e service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:38.065122 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1320/2628] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:37:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:37:39.111069 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b62aed-dbeb-4d48-bd43-3172b2cf8e8e service cinder] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:39.124319 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c502b5-e3c7-4ba2-8ce1-2e08b317269e service cinder] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:39.129219 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-68c502b5-e3c7-4ba2-8ce1-2e08b317269e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:39.130669 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b62aed-dbeb-4d48-bd43-3172b2cf8e8e service cinder] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:39.141732 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb08678-57d9-425a-9da5-04c7202585fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:39.153615 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb08678-57d9-425a-9da5-04c7202585fc service cinder] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:39.154116 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb08678-57d9-425a-9da5-04c7202585fc service cinder] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:39.155178 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb08678-57d9-425a-9da5-04c7202585fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:39.190781 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:39.287249 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c502b5-e3c7-4ba2-8ce1-2e08b317269e service cinder] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:39.299563 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8057f9a-87e5-483e-bf8c-14638b8806ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:39.300665 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8057f9a-87e5-483e-bf8c-14638b8806ff service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:39.301278 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8057f9a-87e5-483e-bf8c-14638b8806ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:39.301685 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8057f9a-87e5-483e-bf8c-14638b8806ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:39.306162 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-a8057f9a-87e5-483e-bf8c-14638b8806ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:39.337740 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:39.381660 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb08678-57d9-425a-9da5-04c7202585fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:39.388495 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb08678-57d9-425a-9da5-04c7202585fc service cinder] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:39.420886 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1309/2629] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:37:39 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:37:39.483591 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8057f9a-87e5-483e-bf8c-14638b8806ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:39.486779 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8057f9a-87e5-483e-bf8c-14638b8806ff service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:39.538217 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1321/2630] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:37:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:37:39.935677 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb08678-57d9-425a-9da5-04c7202585fc service cinder] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:39.937321 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-1fb08678-57d9-425a-9da5-04c7202585fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:39.972509 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb08678-57d9-425a-9da5-04c7202585fc service cinder] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:39.985322 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa7ead5-b2d6-4f00-a43d-93dc69174bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:39.985886 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7ead5-b2d6-4f00-a43d-93dc69174bf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:39.986171 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7ead5-b2d6-4f00-a43d-93dc69174bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:39.986449 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7ead5-b2d6-4f00-a43d-93dc69174bf0 admin admin] PATH_INFO: `/v3/users/563dbe8a50e34840b6d5b2f9ff65e29a` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:39.990642 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa7ead5-b2d6-4f00-a43d-93dc69174bf0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=563dbe8a50e34840b6d5b2f9ff65e29a)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:39.994676 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa7ead5-b2d6-4f00-a43d-93dc69174bf0 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:40.103213 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-bfa7ead5-b2d6-4f00-a43d-93dc69174bf0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '563dbe8a50e34840b6d5b2f9ff65e29a'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:40.104060 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-bfa7ead5-b2d6-4f00-a43d-93dc69174bf0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '563dbe8a50e34840b6d5b2f9ff65e29a'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:40.104852 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-bfa7ead5-b2d6-4f00-a43d-93dc69174bf0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '563dbe8a50e34840b6d5b2f9ff65e29a'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:40.118137 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-bfa7ead5-b2d6-4f00-a43d-93dc69174bf0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '563dbe8a50e34840b6d5b2f9ff65e29a'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:40.137992 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-bfa7ead5-b2d6-4f00-a43d-93dc69174bf0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '563dbe8a50e34840b6d5b2f9ff65e29a'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:40.187781 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1310/2631] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:37:39 2022] DELETE /identity/v3/users/563dbe8a50e34840b6d5b2f9ff65e29a => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:37:40.440038 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8057f9a-87e5-483e-bf8c-14638b8806ff service neutron] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:40.464508 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8057f9a-87e5-483e-bf8c-14638b8806ff service neutron] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:40.570043 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22642c67-3e70-4803-9b56-02fdacb38a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:40.570852 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22642c67-3e70-4803-9b56-02fdacb38a6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:40.571240 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22642c67-3e70-4803-9b56-02fdacb38a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:40.571641 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22642c67-3e70-4803-9b56-02fdacb38a6d admin admin] PATH_INFO: `/v3/projects/a89458e4a02d40e4abfd8457f31cc0a4` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:40.573095 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22642c67-3e70-4803-9b56-02fdacb38a6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a89458e4a02d40e4abfd8457f31cc0a4)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:40.575205 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22642c67-3e70-4803-9b56-02fdacb38a6d admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:40.665551 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-22642c67-3e70-4803-9b56-02fdacb38a6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a89458e4a02d40e4abfd8457f31cc0a4', 'request_id': 'req-22642c67-3e70-4803-9b56-02fdacb38a6d'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:40.674736 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-22642c67-3e70-4803-9b56-02fdacb38a6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a89458e4a02d40e4abfd8457f31cc0a4', 'request_id': 'req-22642c67-3e70-4803-9b56-02fdacb38a6d'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:40.685573 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-22642c67-3e70-4803-9b56-02fdacb38a6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a89458e4a02d40e4abfd8457f31cc0a4', 'request_id': 'req-22642c67-3e70-4803-9b56-02fdacb38a6d'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:40.698140 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:40.707096 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-22642c67-3e70-4803-9b56-02fdacb38a6d admin admin] The token cache is being invalidate because project a89458e4a02d40e4abfd8457f31cc0a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:37:40.707943 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-22642c67-3e70-4803-9b56-02fdacb38a6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:40.709415 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-22642c67-3e70-4803-9b56-02fdacb38a6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:40.712484 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1322/2632] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:37:40 2022] DELETE /identity/v3/projects/a89458e4a02d40e4abfd8457f31cc0a4 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:37:40.718090 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa7ead5-b2d6-4f00-a43d-93dc69174bf0 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:40.719782 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-bfa7ead5-b2d6-4f00-a43d-93dc69174bf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:40.742857 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa7ead5-b2d6-4f00-a43d-93dc69174bf0 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:40.856384 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb49fa2-3869-4009-888e-6b60966e87e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:40.858213 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb49fa2-3869-4009-888e-6b60966e87e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:40.859205 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb49fa2-3869-4009-888e-6b60966e87e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:40.859964 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb49fa2-3869-4009-888e-6b60966e87e4 admin admin] PATH_INFO: `/v3/users/c174d0fabdfe4ae39f8f0ef6be258d5b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:40.862644 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb49fa2-3869-4009-888e-6b60966e87e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c174d0fabdfe4ae39f8f0ef6be258d5b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:40.867254 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb49fa2-3869-4009-888e-6b60966e87e4 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:40.966567 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-cdb49fa2-3869-4009-888e-6b60966e87e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c174d0fabdfe4ae39f8f0ef6be258d5b'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:40.967897 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-cdb49fa2-3869-4009-888e-6b60966e87e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c174d0fabdfe4ae39f8f0ef6be258d5b'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:40.969442 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-cdb49fa2-3869-4009-888e-6b60966e87e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c174d0fabdfe4ae39f8f0ef6be258d5b'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:40.995720 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-cdb49fa2-3869-4009-888e-6b60966e87e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c174d0fabdfe4ae39f8f0ef6be258d5b'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:40.998713 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:41.044560 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-cdb49fa2-3869-4009-888e-6b60966e87e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c174d0fabdfe4ae39f8f0ef6be258d5b'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:41.085427 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1311/2633] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:37:40 2022] DELETE /identity/v3/users/c174d0fabdfe4ae39f8f0ef6be258d5b => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:37:41.487415 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22642c67-3e70-4803-9b56-02fdacb38a6d admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:41.490137 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-22642c67-3e70-4803-9b56-02fdacb38a6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:41.532881 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22642c67-3e70-4803-9b56-02fdacb38a6d admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:41.643523 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6bd189-9296-4f84-9ab7-fcb7ecb8725f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:41.644560 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6bd189-9296-4f84-9ab7-fcb7ecb8725f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:41.644886 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6bd189-9296-4f84-9ab7-fcb7ecb8725f admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:41.645170 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6bd189-9296-4f84-9ab7-fcb7ecb8725f admin admin] PATH_INFO: `/v3/projects/e657afcad0214c4d8403a0b81dde2e95` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:41.647829 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6bd189-9296-4f84-9ab7-fcb7ecb8725f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e657afcad0214c4d8403a0b81dde2e95)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:41.652302 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6bd189-9296-4f84-9ab7-fcb7ecb8725f admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:41.758502 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-ce6bd189-9296-4f84-9ab7-fcb7ecb8725f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e657afcad0214c4d8403a0b81dde2e95', 'request_id': 'req-ce6bd189-9296-4f84-9ab7-fcb7ecb8725f'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:41.768876 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-ce6bd189-9296-4f84-9ab7-fcb7ecb8725f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e657afcad0214c4d8403a0b81dde2e95', 'request_id': 'req-ce6bd189-9296-4f84-9ab7-fcb7ecb8725f'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:41.784254 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-ce6bd189-9296-4f84-9ab7-fcb7ecb8725f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e657afcad0214c4d8403a0b81dde2e95', 'request_id': 'req-ce6bd189-9296-4f84-9ab7-fcb7ecb8725f'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:41.809445 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-ce6bd189-9296-4f84-9ab7-fcb7ecb8725f admin admin] The token cache is being invalidate because project e657afcad0214c4d8403a0b81dde2e95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:37:41.809780 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-ce6bd189-9296-4f84-9ab7-fcb7ecb8725f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:41.810731 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-ce6bd189-9296-4f84-9ab7-fcb7ecb8725f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:41.817846 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1323/2634] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:37:41 2022] DELETE /identity/v3/projects/e657afcad0214c4d8403a0b81dde2e95 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:37:44.229087 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb49fa2-3869-4009-888e-6b60966e87e4 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:44.231456 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-cdb49fa2-3869-4009-888e-6b60966e87e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:44.256459 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb49fa2-3869-4009-888e-6b60966e87e4 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:44.360725 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3993a6-f86e-4083-9737-6a60e4e43dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:44.361502 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3993a6-f86e-4083-9737-6a60e4e43dce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:44.362368 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3993a6-f86e-4083-9737-6a60e4e43dce admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:44.362368 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3993a6-f86e-4083-9737-6a60e4e43dce admin admin] PATH_INFO: `/v3/users/f7f5a1cb35994f4f93b385f363d72219` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:44.363871 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3993a6-f86e-4083-9737-6a60e4e43dce admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7f5a1cb35994f4f93b385f363d72219)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:44.366348 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3993a6-f86e-4083-9737-6a60e4e43dce admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:44.454777 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-ff3993a6-f86e-4083-9737-6a60e4e43dce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7f5a1cb35994f4f93b385f363d72219'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:44.456528 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-ff3993a6-f86e-4083-9737-6a60e4e43dce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7f5a1cb35994f4f93b385f363d72219'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:44.457040 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-ff3993a6-f86e-4083-9737-6a60e4e43dce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7f5a1cb35994f4f93b385f363d72219'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:44.469446 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-ff3993a6-f86e-4083-9737-6a60e4e43dce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7f5a1cb35994f4f93b385f363d72219'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:44.494431 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-ff3993a6-f86e-4083-9737-6a60e4e43dce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7f5a1cb35994f4f93b385f363d72219'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:44.534561 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1312/2635] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:37:44 2022] DELETE /identity/v3/users/f7f5a1cb35994f4f93b385f363d72219 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:37:44.542373 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673a6be-abfc-4e01-8c4b-2395b0639f19 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:44.543118 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673a6be-abfc-4e01-8c4b-2395b0639f19 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:44.543395 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673a6be-abfc-4e01-8c4b-2395b0639f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:44.635850 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-9673a6be-abfc-4e01-8c4b-2395b0639f19 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:37:44.638543 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-9673a6be-abfc-4e01-8c4b-2395b0639f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:44.775584 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1324/2636] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:37:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:37:44.797424 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3993a6-f86e-4083-9737-6a60e4e43dce admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:44.801297 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-ff3993a6-f86e-4083-9737-6a60e4e43dce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:45.015225 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3993a6-f86e-4083-9737-6a60e4e43dce admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:45.028690 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72863149-9a2d-4376-be69-739e9d3d77eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:45.029814 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72863149-9a2d-4376-be69-739e9d3d77eb service neutron] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:45.030305 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72863149-9a2d-4376-be69-739e9d3d77eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:45.030981 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72863149-9a2d-4376-be69-739e9d3d77eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:45.058985 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:45.066456 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72863149-9a2d-4376-be69-739e9d3d77eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:45.070738 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72863149-9a2d-4376-be69-739e9d3d77eb service neutron] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:45.125717 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1313/2637] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:37:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:37:45.569933 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9673a6be-abfc-4e01-8c4b-2395b0639f19 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:45.572593 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-9673a6be-abfc-4e01-8c4b-2395b0639f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:45.611350 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9673a6be-abfc-4e01-8c4b-2395b0639f19 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:45.651323 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ea79f7-4a17-4c43-b3bd-6628bd0b90e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:45.661587 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea79f7-4a17-4c43-b3bd-6628bd0b90e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:45.663596 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea79f7-4a17-4c43-b3bd-6628bd0b90e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:45.665284 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea79f7-4a17-4c43-b3bd-6628bd0b90e7 admin admin] PATH_INFO: `/v3/projects/3300182b12024a28a53466ade381204c` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:45.668973 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ea79f7-4a17-4c43-b3bd-6628bd0b90e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3300182b12024a28a53466ade381204c)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:45.673296 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ea79f7-4a17-4c43-b3bd-6628bd0b90e7 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:45.728401 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72863149-9a2d-4376-be69-739e9d3d77eb service neutron] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:45.733049 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-72863149-9a2d-4376-be69-739e9d3d77eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:45.771172 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72863149-9a2d-4376-be69-739e9d3d77eb service neutron] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:45.773364 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:45.801209 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f806f8d1-2046-4cde-8226-bba8fdbbe562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:45.802444 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806f8d1-2046-4cde-8226-bba8fdbbe562 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:45.803216 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806f8d1-2046-4cde-8226-bba8fdbbe562 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:45.803812 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806f8d1-2046-4cde-8226-bba8fdbbe562 admin admin] PATH_INFO: `/v3/users/91067603d9c549278cdc2d97b54cca88` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:45.806361 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f806f8d1-2046-4cde-8226-bba8fdbbe562 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91067603d9c549278cdc2d97b54cca88)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:45.810869 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f806f8d1-2046-4cde-8226-bba8fdbbe562 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:45.837062 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-22ea79f7-4a17-4c43-b3bd-6628bd0b90e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3300182b12024a28a53466ade381204c', 'request_id': 'req-22ea79f7-4a17-4c43-b3bd-6628bd0b90e7'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:45.851386 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-22ea79f7-4a17-4c43-b3bd-6628bd0b90e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3300182b12024a28a53466ade381204c', 'request_id': 'req-22ea79f7-4a17-4c43-b3bd-6628bd0b90e7'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:45.860468 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-22ea79f7-4a17-4c43-b3bd-6628bd0b90e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3300182b12024a28a53466ade381204c', 'request_id': 'req-22ea79f7-4a17-4c43-b3bd-6628bd0b90e7'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:45.883459 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-22ea79f7-4a17-4c43-b3bd-6628bd0b90e7 admin admin] The token cache is being invalidate because project 3300182b12024a28a53466ade381204c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:37:45.884112 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-22ea79f7-4a17-4c43-b3bd-6628bd0b90e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:45.884791 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-22ea79f7-4a17-4c43-b3bd-6628bd0b90e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:45.886713 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1325/2638] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:37:45 2022] DELETE /identity/v3/projects/3300182b12024a28a53466ade381204c => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:37:45.887545 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-f806f8d1-2046-4cde-8226-bba8fdbbe562 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91067603d9c549278cdc2d97b54cca88'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:45.888385 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-f806f8d1-2046-4cde-8226-bba8fdbbe562 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91067603d9c549278cdc2d97b54cca88'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:45.889000 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-f806f8d1-2046-4cde-8226-bba8fdbbe562 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91067603d9c549278cdc2d97b54cca88'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:45.892453 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ea79f7-4a17-4c43-b3bd-6628bd0b90e7 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:45.894025 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-22ea79f7-4a17-4c43-b3bd-6628bd0b90e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:45.901363 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-f806f8d1-2046-4cde-8226-bba8fdbbe562 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91067603d9c549278cdc2d97b54cca88'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:45.920523 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-f806f8d1-2046-4cde-8226-bba8fdbbe562 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91067603d9c549278cdc2d97b54cca88'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:45.942902 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1314/2639] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:37:45 2022] DELETE /identity/v3/users/91067603d9c549278cdc2d97b54cca88 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:37:46.006575 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ea79f7-4a17-4c43-b3bd-6628bd0b90e7 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:46.111732 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d523063-155d-4e4a-b966-eaf03f5feaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:46.112569 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d523063-155d-4e4a-b966-eaf03f5feaaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:46.112902 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d523063-155d-4e4a-b966-eaf03f5feaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:46.113350 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d523063-155d-4e4a-b966-eaf03f5feaaa admin admin] PATH_INFO: `/v3/users/26ee1760c56549a7ba2905357638a59b` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:46.115044 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d523063-155d-4e4a-b966-eaf03f5feaaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=26ee1760c56549a7ba2905357638a59b)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:46.117695 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d523063-155d-4e4a-b966-eaf03f5feaaa admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:46.200189 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f806f8d1-2046-4cde-8226-bba8fdbbe562 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:46.202652 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-f806f8d1-2046-4cde-8226-bba8fdbbe562 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:46.215047 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-2d523063-155d-4e4a-b966-eaf03f5feaaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26ee1760c56549a7ba2905357638a59b'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:46.229950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-2d523063-155d-4e4a-b966-eaf03f5feaaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26ee1760c56549a7ba2905357638a59b'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:46.231343 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f806f8d1-2046-4cde-8226-bba8fdbbe562 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:46.236842 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdcdd42-caa5-4932-9eed-d2265453b668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:46.237177 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:46.237944 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdcdd42-caa5-4932-9eed-d2265453b668 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:46.238294 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdcdd42-caa5-4932-9eed-d2265453b668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:46.238649 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdcdd42-caa5-4932-9eed-d2265453b668 admin admin] PATH_INFO: `/v3/projects/cf24ec2c8bd74974932690a583961691` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:46.240572 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdcdd42-caa5-4932-9eed-d2265453b668 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf24ec2c8bd74974932690a583961691)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:46.243070 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdcdd42-caa5-4932-9eed-d2265453b668 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:46.246766 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-2d523063-155d-4e4a-b966-eaf03f5feaaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26ee1760c56549a7ba2905357638a59b'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:46.249168 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-2d523063-155d-4e4a-b966-eaf03f5feaaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26ee1760c56549a7ba2905357638a59b'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:46.278036 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-2d523063-155d-4e4a-b966-eaf03f5feaaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26ee1760c56549a7ba2905357638a59b'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:46.290349 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1326/2640] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:37:45 2022] DELETE /identity/v3/users/26ee1760c56549a7ba2905357638a59b => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:37:46.320295 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-dbdcdd42-caa5-4932-9eed-d2265453b668 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf24ec2c8bd74974932690a583961691', 'request_id': 'req-dbdcdd42-caa5-4932-9eed-d2265453b668'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:46.333339 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-dbdcdd42-caa5-4932-9eed-d2265453b668 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf24ec2c8bd74974932690a583961691', 'request_id': 'req-dbdcdd42-caa5-4932-9eed-d2265453b668'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:46.353199 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-dbdcdd42-caa5-4932-9eed-d2265453b668 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf24ec2c8bd74974932690a583961691', 'request_id': 'req-dbdcdd42-caa5-4932-9eed-d2265453b668'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:46.370420 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-dbdcdd42-caa5-4932-9eed-d2265453b668 admin admin] The token cache is being invalidate because project cf24ec2c8bd74974932690a583961691 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:37:46.370721 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-dbdcdd42-caa5-4932-9eed-d2265453b668 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:46.371448 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-dbdcdd42-caa5-4932-9eed-d2265453b668 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:46.373322 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1315/2641] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:37:46 2022] DELETE /identity/v3/projects/cf24ec2c8bd74974932690a583961691 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:37:46.381140 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763cb2cb-3f4d-4c68-9d90-e8b4e0c31dd8 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:46.381871 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763cb2cb-3f4d-4c68-9d90-e8b4e0c31dd8 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:46.382334 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763cb2cb-3f4d-4c68-9d90-e8b4e0c31dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:46.422660 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-763cb2cb-3f4d-4c68-9d90-e8b4e0c31dd8 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:37:46.425006 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-763cb2cb-3f4d-4c68-9d90-e8b4e0c31dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:46.544576 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1327/2642] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:37:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:37:46.561219 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eabe49a-31da-4382-add6-ecaaa719269d None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:46.561494 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eabe49a-31da-4382-add6-ecaaa719269d None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:46.561757 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eabe49a-31da-4382-add6-ecaaa719269d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:46.584717 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-9eabe49a-31da-4382-add6-ecaaa719269d None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:37:46.585884 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-9eabe49a-31da-4382-add6-ecaaa719269d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:46.595635 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1316/2643] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:37:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:37:46.602185 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763cb2cb-3f4d-4c68-9d90-e8b4e0c31dd8 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:46.614435 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763cb2cb-3f4d-4c68-9d90-e8b4e0c31dd8 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:46.620629 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c6fd3-8a2e-4d5e-b532-37391f34c0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:46.621302 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c6fd3-8a2e-4d5e-b532-37391f34c0b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:46.622030 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c6fd3-8a2e-4d5e-b532-37391f34c0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:46.622322 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c6fd3-8a2e-4d5e-b532-37391f34c0b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:46.623122 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36c6fd3-8a2e-4d5e-b532-37391f34c0b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:37:46.623428 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36c6fd3-8a2e-4d5e-b532-37391f34c0b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:46.625209 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36c6fd3-8a2e-4d5e-b532-37391f34c0b4 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:46.639555 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1328/2644] 10.222.0.91 () {58 vars in 1153 bytes} [Tue Aug 30 04:37:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:37:46.647808 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eabe49a-31da-4382-add6-ecaaa719269d None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:46.665657 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eabe49a-31da-4382-add6-ecaaa719269d None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:46.673977 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ed142f-8cf6-45b0-a15c-bb323ba43f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:46.674824 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed142f-8cf6-45b0-a15c-bb323ba43f5d admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:46.675232 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed142f-8cf6-45b0-a15c-bb323ba43f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:46.675596 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed142f-8cf6-45b0-a15c-bb323ba43f5d admin admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:46.677095 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ed142f-8cf6-45b0-a15c-bb323ba43f5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:46.680796 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ed142f-8cf6-45b0-a15c-bb323ba43f5d admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:46.723110 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c6fd3-8a2e-4d5e-b532-37391f34c0b4 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:46.725581 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-b36c6fd3-8a2e-4d5e-b532-37391f34c0b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:46.735418 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1317/2645] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:37:46 2022] POST /identity/v3/projects => generated 371 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:37:46.740444 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ed142f-8cf6-45b0-a15c-bb323ba43f5d admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:46.744291 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c6fd3-8a2e-4d5e-b532-37391f34c0b4 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:46.803786 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:46.841366 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a528b-616a-4d11-a97a-6108e5408b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:46.842031 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a528b-616a-4d11-a97a-6108e5408b58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:46.842313 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a528b-616a-4d11-a97a-6108e5408b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:46.842742 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a528b-616a-4d11-a97a-6108e5408b58 admin admin] PATH_INFO: `/v3/projects/d10848b0b4e14b9799dd51fc42344140` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:46.844211 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7a528b-616a-4d11-a97a-6108e5408b58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d10848b0b4e14b9799dd51fc42344140)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:46.846337 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7a528b-616a-4d11-a97a-6108e5408b58 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:46.888923 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ed142f-8cf6-45b0-a15c-bb323ba43f5d admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:46.897416 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6d87d3-86fe-4376-b295-27648c80eb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:46.898471 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d87d3-86fe-4376-b295-27648c80eb96 admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:46.898782 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d87d3-86fe-4376-b295-27648c80eb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:46.899503 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d87d3-86fe-4376-b295-27648c80eb96 admin admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:46.900636 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6d87d3-86fe-4376-b295-27648c80eb96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:46.902858 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6d87d3-86fe-4376-b295-27648c80eb96 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:46.927069 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-6d7a528b-616a-4d11-a97a-6108e5408b58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd10848b0b4e14b9799dd51fc42344140', 'request_id': 'req-6d7a528b-616a-4d11-a97a-6108e5408b58'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:46.939524 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1318/2646] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:37:46 2022] POST /identity/v3/users => generated 286 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:37:46.945242 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-6d7a528b-616a-4d11-a97a-6108e5408b58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd10848b0b4e14b9799dd51fc42344140', 'request_id': 'req-6d7a528b-616a-4d11-a97a-6108e5408b58'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:46.946147 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6d87d3-86fe-4376-b295-27648c80eb96 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:46.956327 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-6d7a528b-616a-4d11-a97a-6108e5408b58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd10848b0b4e14b9799dd51fc42344140', 'request_id': 'req-6d7a528b-616a-4d11-a97a-6108e5408b58'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:46.960086 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6d87d3-86fe-4376-b295-27648c80eb96 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:46.964749 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:46.990800 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-6d7a528b-616a-4d11-a97a-6108e5408b58 admin admin] The token cache is being invalidate because project d10848b0b4e14b9799dd51fc42344140 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:37:46.991946 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-6d7a528b-616a-4d11-a97a-6108e5408b58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:46.993478 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-6d7a528b-616a-4d11-a97a-6108e5408b58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:46.997088 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1329/2647] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:37:46 2022] DELETE /identity/v3/projects/d10848b0b4e14b9799dd51fc42344140 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:37:47.005509 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a528b-616a-4d11-a97a-6108e5408b58 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:47.008582 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-6d7a528b-616a-4d11-a97a-6108e5408b58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:47.065616 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f40faa-3026-4960-927a-ac1fb8f9e778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:47.066776 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f40faa-3026-4960-927a-ac1fb8f9e778 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:47.067961 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f40faa-3026-4960-927a-ac1fb8f9e778 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:47.068220 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f40faa-3026-4960-927a-ac1fb8f9e778 admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:47.069509 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f40faa-3026-4960-927a-ac1fb8f9e778 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:47.071729 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f40faa-3026-4960-927a-ac1fb8f9e778 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:47.089834 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1319/2648] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:37:47.090857 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f40faa-3026-4960-927a-ac1fb8f9e778 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:47.093417 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-89f40faa-3026-4960-927a-ac1fb8f9e778 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:47.113391 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a528b-616a-4d11-a97a-6108e5408b58 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:47.117489 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f40faa-3026-4960-927a-ac1fb8f9e778 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:47.123042 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc743183-0b8c-4dbf-aab8-22caa59226a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:47.124188 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc743183-0b8c-4dbf-aab8-22caa59226a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:47.124646 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc743183-0b8c-4dbf-aab8-22caa59226a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:47.125089 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc743183-0b8c-4dbf-aab8-22caa59226a6 admin admin] PATH_INFO: `/v3/users/5e26bfe0ef0f447cb6811465ab822c01` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:47.126028 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd262e30-0464-42da-8b4d-55e3f6c722c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:47.126710 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd262e30-0464-42da-8b4d-55e3f6c722c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:47.127104 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd262e30-0464-42da-8b4d-55e3f6c722c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:47.127320 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc743183-0b8c-4dbf-aab8-22caa59226a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e26bfe0ef0f447cb6811465ab822c01)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:47.127574 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd262e30-0464-42da-8b4d-55e3f6c722c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:47.128346 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd262e30-0464-42da-8b4d-55e3f6c722c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:47.131188 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc743183-0b8c-4dbf-aab8-22caa59226a6 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:47.131390 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd262e30-0464-42da-8b4d-55e3f6c722c1 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:47.147525 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1320/2649] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:37:47 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:37:47.152666 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd262e30-0464-42da-8b4d-55e3f6c722c1 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:47.170457 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd262e30-0464-42da-8b4d-55e3f6c722c1 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:47.178716 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d84757-ab87-4d49-b4d2-1c0973ec1fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:47.180773 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d84757-ab87-4d49-b4d2-1c0973ec1fe3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:47.181394 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d84757-ab87-4d49-b4d2-1c0973ec1fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:47.182098 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d84757-ab87-4d49-b4d2-1c0973ec1fe3 admin admin] PATH_INFO: `/v3/projects/2babe9b811f1463db6f6a2c189e0f77f/users/9b64276525de4ecda8902713d1a710b6/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:47.216328 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d84757-ab87-4d49-b4d2-1c0973ec1fe3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2babe9b811f1463db6f6a2c189e0f77f, user_id=9b64276525de4ecda8902713d1a710b6, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:47.222911 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-dc743183-0b8c-4dbf-aab8-22caa59226a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e26bfe0ef0f447cb6811465ab822c01'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:47.223146 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d84757-ab87-4d49-b4d2-1c0973ec1fe3 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:47.241129 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-dc743183-0b8c-4dbf-aab8-22caa59226a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e26bfe0ef0f447cb6811465ab822c01'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:47.261926 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1321/2650] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:37:47 2022] PUT /identity/v3/projects/2babe9b811f1463db6f6a2c189e0f77f/users/9b64276525de4ecda8902713d1a710b6/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:37:47.265912 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-dc743183-0b8c-4dbf-aab8-22caa59226a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e26bfe0ef0f447cb6811465ab822c01'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:47.266839 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-dc743183-0b8c-4dbf-aab8-22caa59226a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e26bfe0ef0f447cb6811465ab822c01'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:47.275470 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce3994-ca36-416d-ad5c-6017364c1fa4 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:47.275807 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce3994-ca36-416d-ad5c-6017364c1fa4 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:47.276062 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce3994-ca36-416d-ad5c-6017364c1fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:47.302675 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-dc743183-0b8c-4dbf-aab8-22caa59226a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e26bfe0ef0f447cb6811465ab822c01'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:47.310865 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-efce3994-ca36-416d-ad5c-6017364c1fa4 None None] MFA Rules not processed for user `9b64276525de4ecda8902713d1a710b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:37:47.312180 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-efce3994-ca36-416d-ad5c-6017364c1fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:47.327572 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1330/2651] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:37:47 2022] DELETE /identity/v3/users/5e26bfe0ef0f447cb6811465ab822c01 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:37:47.472308 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:47.480026 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1322/2652] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:37:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:37:47.494116 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc743183-0b8c-4dbf-aab8-22caa59226a6 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:47.496975 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-dc743183-0b8c-4dbf-aab8-22caa59226a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:47.639686 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:47.696301 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc743183-0b8c-4dbf-aab8-22caa59226a6 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:47.706578 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d237f-6a75-427d-b4f1-75992d2f4e6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd806295278ae4997b5c6968aa553290c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:47.707482 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d237f-6a75-427d-b4f1-75992d2f4e6b service nova] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:47.708139 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d237f-6a75-427d-b4f1-75992d2f4e6b service nova] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:47.709080 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d237f-6a75-427d-b4f1-75992d2f4e6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:47.830739 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741d237f-6a75-427d-b4f1-75992d2f4e6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:47.834161 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741d237f-6a75-427d-b4f1-75992d2f4e6b service nova] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:47.853310 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1331/2653] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:37:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:37:47.859437 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efce3994-ca36-416d-ad5c-6017364c1fa4 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:47.862954 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-efce3994-ca36-416d-ad5c-6017364c1fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:47.969988 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efce3994-ca36-416d-ad5c-6017364c1fa4 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:48.060294 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505b2584-af52-4a72-a072-9885764fb8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:48.061300 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b2584-af52-4a72-a072-9885764fb8d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:48.061747 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b2584-af52-4a72-a072-9885764fb8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:48.062242 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b2584-af52-4a72-a072-9885764fb8d6 admin admin] PATH_INFO: `/v3/projects/b98b10958807485db031722e31cbb12f` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:48.063985 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505b2584-af52-4a72-a072-9885764fb8d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b98b10958807485db031722e31cbb12f)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:48.067729 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505b2584-af52-4a72-a072-9885764fb8d6 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:48.157667 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-505b2584-af52-4a72-a072-9885764fb8d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b98b10958807485db031722e31cbb12f', 'request_id': 'req-505b2584-af52-4a72-a072-9885764fb8d6'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:48.175000 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-505b2584-af52-4a72-a072-9885764fb8d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b98b10958807485db031722e31cbb12f', 'request_id': 'req-505b2584-af52-4a72-a072-9885764fb8d6'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:48.186164 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-505b2584-af52-4a72-a072-9885764fb8d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b98b10958807485db031722e31cbb12f', 'request_id': 'req-505b2584-af52-4a72-a072-9885764fb8d6'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:48.205536 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-505b2584-af52-4a72-a072-9885764fb8d6 admin admin] The token cache is being invalidate because project b98b10958807485db031722e31cbb12f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:37:48.205984 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-505b2584-af52-4a72-a072-9885764fb8d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:48.206880 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-505b2584-af52-4a72-a072-9885764fb8d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:48.209129 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1323/2654] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:37:47 2022] DELETE /identity/v3/projects/b98b10958807485db031722e31cbb12f => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:37:48.215132 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c0668e-bddc-4468-b79a-c615d8c12102 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:48.215423 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c0668e-bddc-4468-b79a-c615d8c12102 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:48.215700 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c0668e-bddc-4468-b79a-c615d8c12102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:48.241004 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-c5c0668e-bddc-4468-b79a-c615d8c12102 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:37:48.242388 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-c5c0668e-bddc-4468-b79a-c615d8c12102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:48.363655 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1332/2655] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:37:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:37:48.373823 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0bcc32-ebf1-4c68-8229-8ad0e0224a57 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:48.374802 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0bcc32-ebf1-4c68-8229-8ad0e0224a57 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:48.375417 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0bcc32-ebf1-4c68-8229-8ad0e0224a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:48.415497 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-3f0bcc32-ebf1-4c68-8229-8ad0e0224a57 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:37:48.417976 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-3f0bcc32-ebf1-4c68-8229-8ad0e0224a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:48.436969 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1324/2656] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:37:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:37:48.443104 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c0668e-bddc-4468-b79a-c615d8c12102 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:48.476046 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c0668e-bddc-4468-b79a-c615d8c12102 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:48.486108 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a02e96-5031-4745-abb6-fa7e64be811b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:48.487347 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a02e96-5031-4745-abb6-fa7e64be811b admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:48.488362 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a02e96-5031-4745-abb6-fa7e64be811b admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:48.489023 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a02e96-5031-4745-abb6-fa7e64be811b admin admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:48.490933 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a02e96-5031-4745-abb6-fa7e64be811b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:37:48.491892 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a02e96-5031-4745-abb6-fa7e64be811b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:48.497848 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a02e96-5031-4745-abb6-fa7e64be811b admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:48.520055 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1333/2657] 10.222.0.91 () {58 vars in 1153 bytes} [Tue Aug 30 04:37:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:37:48.529257 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0bcc32-ebf1-4c68-8229-8ad0e0224a57 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:48.547986 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0bcc32-ebf1-4c68-8229-8ad0e0224a57 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:48.555027 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec4e913-b3b7-4695-bf78-dd1f9d098ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:48.555672 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4e913-b3b7-4695-bf78-dd1f9d098ad3 admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:48.556042 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4e913-b3b7-4695-bf78-dd1f9d098ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:48.556264 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4e913-b3b7-4695-bf78-dd1f9d098ad3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:48.556943 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec4e913-b3b7-4695-bf78-dd1f9d098ad3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:48.558987 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec4e913-b3b7-4695-bf78-dd1f9d098ad3 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:48.605162 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1325/2658] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:37:48 2022] POST /identity/v3/projects => generated 373 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:37:48.606461 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a02e96-5031-4745-abb6-fa7e64be811b admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:48.621981 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a02e96-5031-4745-abb6-fa7e64be811b admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:48.724216 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8336ad7-50c0-4a98-a396-053d66d6be69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:48.725319 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8336ad7-50c0-4a98-a396-053d66d6be69 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:48.725707 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8336ad7-50c0-4a98-a396-053d66d6be69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:48.726149 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8336ad7-50c0-4a98-a396-053d66d6be69 admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:48.727249 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8336ad7-50c0-4a98-a396-053d66d6be69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:48.730533 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8336ad7-50c0-4a98-a396-053d66d6be69 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:48.767267 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1334/2659] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:37:48 2022] POST /identity/v3/users => generated 287 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:37:48.774119 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec4e913-b3b7-4695-bf78-dd1f9d098ad3 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:48.792186 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec4e913-b3b7-4695-bf78-dd1f9d098ad3 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:48.799663 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ca873-3210-495e-900e-c9ee9e0f0fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:48.800941 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ca873-3210-495e-900e-c9ee9e0f0fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:48.801393 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ca873-3210-495e-900e-c9ee9e0f0fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:48.802135 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ca873-3210-495e-900e-c9ee9e0f0fe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:48.803256 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058ca873-3210-495e-900e-c9ee9e0f0fe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:48.807153 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058ca873-3210-495e-900e-c9ee9e0f0fe8 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:48.819829 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:48.832320 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1326/2660] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:37:48.838201 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8336ad7-50c0-4a98-a396-053d66d6be69 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:48.846668 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:48.857448 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8336ad7-50c0-4a98-a396-053d66d6be69 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:48.867120 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d8b134-b62f-4353-b654-2143b4e47ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:48.867576 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8b134-b62f-4353-b654-2143b4e47ba9 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:48.867904 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8b134-b62f-4353-b654-2143b4e47ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:48.868422 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8b134-b62f-4353-b654-2143b4e47ba9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:48.869157 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d8b134-b62f-4353-b654-2143b4e47ba9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:48.870991 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d8b134-b62f-4353-b654-2143b4e47ba9 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:48.884804 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1335/2661] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:37:48.891117 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ca873-3210-495e-900e-c9ee9e0f0fe8 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:48.904903 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ca873-3210-495e-900e-c9ee9e0f0fe8 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:48.923064 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dc86cc-f10b-4840-a9e3-f30246616655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:48.924598 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc86cc-f10b-4840-a9e3-f30246616655 admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:48.925199 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc86cc-f10b-4840-a9e3-f30246616655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:48.925780 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc86cc-f10b-4840-a9e3-f30246616655 admin admin] PATH_INFO: `/v3/projects/a1c4b71eb1c4418db40f314db4478b51/users/ea5b20f6358c471480c78566d44c573d/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:48.958710 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dc86cc-f10b-4840-a9e3-f30246616655 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1c4b71eb1c4418db40f314db4478b51, user_id=ea5b20f6358c471480c78566d44c573d, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:48.962639 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dc86cc-f10b-4840-a9e3-f30246616655 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:48.996087 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1327/2662] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:37:48 2022] PUT /identity/v3/projects/a1c4b71eb1c4418db40f314db4478b51/users/ea5b20f6358c471480c78566d44c573d/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:37:48.999988 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ec146-41c9-4086-b41c-73b297a5b796 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:48.999988 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ec146-41c9-4086-b41c-73b297a5b796 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:48.999988 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ec146-41c9-4086-b41c-73b297a5b796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:49.040688 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-a96ec146-41c9-4086-b41c-73b297a5b796 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:37:49.042975 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-a96ec146-41c9-4086-b41c-73b297a5b796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:49.156920 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1336/2663] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:37:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:37:49.170729 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dc86cc-f10b-4840-a9e3-f30246616655 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:49.172736 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-59dc86cc-f10b-4840-a9e3-f30246616655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:49.262602 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dc86cc-f10b-4840-a9e3-f30246616655 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:49.267705 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d127e-2c91-49d6-9a3f-6bb141888f3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:49.268456 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d127e-2c91-49d6-9a3f-6bb141888f3b service neutron] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:49.268782 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d127e-2c91-49d6-9a3f-6bb141888f3b service neutron] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:49.269095 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d127e-2c91-49d6-9a3f-6bb141888f3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:49.282124 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4d127e-2c91-49d6-9a3f-6bb141888f3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:49.283676 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4d127e-2c91-49d6-9a3f-6bb141888f3b service neutron] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:49.296162 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1328/2664] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:37:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:37:50.283404 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5682c8-780c-4616-b927-13229af5e7c9 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:50.284831 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5682c8-780c-4616-b927-13229af5e7c9 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:50.284831 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5682c8-780c-4616-b927-13229af5e7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:50.326391 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-6a5682c8-780c-4616-b927-13229af5e7c9 None None] MFA Rules not processed for user `ea5b20f6358c471480c78566d44c573d`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:37:50.328487 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-6a5682c8-780c-4616-b927-13229af5e7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:50.443316 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1337/2665] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:37:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:37:50.460195 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d127e-2c91-49d6-9a3f-6bb141888f3b service neutron] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:50.462662 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-1d4d127e-2c91-49d6-9a3f-6bb141888f3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:50.550521 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d127e-2c91-49d6-9a3f-6bb141888f3b service neutron] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:50.558545 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a3e205-4022-4461-b972-b326807b4cc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:50.559600 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3e205-4022-4461-b972-b326807b4cc3 service cinder] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:50.560089 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3e205-4022-4461-b972-b326807b4cc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:50.560757 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3e205-4022-4461-b972-b326807b4cc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:50.575845 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a3e205-4022-4461-b972-b326807b4cc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:50.579590 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a3e205-4022-4461-b972-b326807b4cc3 service cinder] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:50.597075 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1329/2666] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:37:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:37:51.033364 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5682c8-780c-4616-b927-13229af5e7c9 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:51.035897 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-6a5682c8-780c-4616-b927-13229af5e7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:51.066613 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5682c8-780c-4616-b927-13229af5e7c9 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:51.071379 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d41cac-f94c-492e-9ab9-aaaa32cbc753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:51.072108 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d41cac-f94c-492e-9ab9-aaaa32cbc753 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:51.072472 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d41cac-f94c-492e-9ab9-aaaa32cbc753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:51.072749 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d41cac-f94c-492e-9ab9-aaaa32cbc753 admin admin] PATH_INFO: `/v3/users/9b64276525de4ecda8902713d1a710b6` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:51.074094 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d41cac-f94c-492e-9ab9-aaaa32cbc753 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b64276525de4ecda8902713d1a710b6)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:51.076432 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d41cac-f94c-492e-9ab9-aaaa32cbc753 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:51.143138 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-c9d41cac-f94c-492e-9ab9-aaaa32cbc753 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b64276525de4ecda8902713d1a710b6'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:51.152316 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-c9d41cac-f94c-492e-9ab9-aaaa32cbc753 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b64276525de4ecda8902713d1a710b6'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:51.165565 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-c9d41cac-f94c-492e-9ab9-aaaa32cbc753 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b64276525de4ecda8902713d1a710b6'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:51.166312 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-c9d41cac-f94c-492e-9ab9-aaaa32cbc753 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b64276525de4ecda8902713d1a710b6'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:51.181422 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:51.184523 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-c9d41cac-f94c-492e-9ab9-aaaa32cbc753 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b64276525de4ecda8902713d1a710b6'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:51.197845 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1338/2667] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:37:51 2022] DELETE /identity/v3/users/9b64276525de4ecda8902713d1a710b6 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:37:51.203467 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c39f82-c0b4-431f-91f2-38a089c4ccf8 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:51.203882 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c39f82-c0b4-431f-91f2-38a089c4ccf8 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:51.204189 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c39f82-c0b4-431f-91f2-38a089c4ccf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:51.226998 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-40c39f82-c0b4-431f-91f2-38a089c4ccf8 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:37:51.228522 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-40c39f82-c0b4-431f-91f2-38a089c4ccf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:51.327286 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1330/2668] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:37:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:37:51.339790 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d41cac-f94c-492e-9ab9-aaaa32cbc753 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:51.342258 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-c9d41cac-f94c-492e-9ab9-aaaa32cbc753 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:51.437778 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d41cac-f94c-492e-9ab9-aaaa32cbc753 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:51.444518 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1df9c-4e1d-4600-a768-9ecacf105c3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:51.445543 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1df9c-4e1d-4600-a768-9ecacf105c3e service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:51.446157 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1df9c-4e1d-4600-a768-9ecacf105c3e service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:51.446590 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1df9c-4e1d-4600-a768-9ecacf105c3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:51.468907 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e1df9c-4e1d-4600-a768-9ecacf105c3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:51.470525 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e1df9c-4e1d-4600-a768-9ecacf105c3e service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:51.483893 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1339/2669] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:37:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:37:51.953947 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c39f82-c0b4-431f-91f2-38a089c4ccf8 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:51.956634 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-40c39f82-c0b4-431f-91f2-38a089c4ccf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:51.978439 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c39f82-c0b4-431f-91f2-38a089c4ccf8 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:51.986690 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e6a9b-d2e2-4dfb-9855-29baec2fa1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:51.987872 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e6a9b-d2e2-4dfb-9855-29baec2fa1b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:51.988417 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e6a9b-d2e2-4dfb-9855-29baec2fa1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:51.989474 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e6a9b-d2e2-4dfb-9855-29baec2fa1b2 admin admin] PATH_INFO: `/v3/projects/2babe9b811f1463db6f6a2c189e0f77f` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:51.991476 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9e6a9b-d2e2-4dfb-9855-29baec2fa1b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2babe9b811f1463db6f6a2c189e0f77f)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:51.995585 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9e6a9b-d2e2-4dfb-9855-29baec2fa1b2 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:52.029283 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:52.086342 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-1f9e6a9b-d2e2-4dfb-9855-29baec2fa1b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2babe9b811f1463db6f6a2c189e0f77f', 'request_id': 'req-1f9e6a9b-d2e2-4dfb-9855-29baec2fa1b2'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:52.095495 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-1f9e6a9b-d2e2-4dfb-9855-29baec2fa1b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2babe9b811f1463db6f6a2c189e0f77f', 'request_id': 'req-1f9e6a9b-d2e2-4dfb-9855-29baec2fa1b2'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:52.108360 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-1f9e6a9b-d2e2-4dfb-9855-29baec2fa1b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2babe9b811f1463db6f6a2c189e0f77f', 'request_id': 'req-1f9e6a9b-d2e2-4dfb-9855-29baec2fa1b2'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:52.126771 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-1f9e6a9b-d2e2-4dfb-9855-29baec2fa1b2 admin admin] The token cache is being invalidate because project 2babe9b811f1463db6f6a2c189e0f77f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:37:52.127234 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-1f9e6a9b-d2e2-4dfb-9855-29baec2fa1b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:52.128727 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-1f9e6a9b-d2e2-4dfb-9855-29baec2fa1b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:52.132540 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1331/2670] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:37:51 2022] DELETE /identity/v3/projects/2babe9b811f1463db6f6a2c189e0f77f => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:37:52.140319 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f4440-e712-44d1-a40d-d30f2d7bf863 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:52.140608 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f4440-e712-44d1-a40d-d30f2d7bf863 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:52.140923 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f4440-e712-44d1-a40d-d30f2d7bf863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:52.168504 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-e03f4440-e712-44d1-a40d-d30f2d7bf863 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:37:52.170251 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-e03f4440-e712-44d1-a40d-d30f2d7bf863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:52.184982 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983da5f1-7cd5-4885-a108-614aa00bd810 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:52.185500 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983da5f1-7cd5-4885-a108-614aa00bd810 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:52.186224 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983da5f1-7cd5-4885-a108-614aa00bd810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:52.222775 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-983da5f1-7cd5-4885-a108-614aa00bd810 None None] MFA Rules not processed for user `ea5b20f6358c471480c78566d44c573d`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:37:52.225312 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-983da5f1-7cd5-4885-a108-614aa00bd810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:52.266579 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1340/2671] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:37:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:37:52.279454 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31414b78-4807-4e3b-98e2-504566675b50 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:52.280099 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31414b78-4807-4e3b-98e2-504566675b50 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:52.280544 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31414b78-4807-4e3b-98e2-504566675b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:52.325741 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-31414b78-4807-4e3b-98e2-504566675b50 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:37:52.328277 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-31414b78-4807-4e3b-98e2-504566675b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:52.330768 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1332/2672] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:37:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:37:52.340053 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1341/2673] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:37:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:37:52.347298 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983da5f1-7cd5-4885-a108-614aa00bd810 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:52.365268 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983da5f1-7cd5-4885-a108-614aa00bd810 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:52.372814 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f00b9d-84e5-4c22-aee8-064159ac9f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:52.373794 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f00b9d-84e5-4c22-aee8-064159ac9f61 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:52.374266 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f00b9d-84e5-4c22-aee8-064159ac9f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:52.374789 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f00b9d-84e5-4c22-aee8-064159ac9f61 admin admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:52.376609 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f00b9d-84e5-4c22-aee8-064159ac9f61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:37:52.377122 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f00b9d-84e5-4c22-aee8-064159ac9f61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:52.380555 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f00b9d-84e5-4c22-aee8-064159ac9f61 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:52.398707 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1333/2674] 10.222.0.91 () {58 vars in 1153 bytes} [Tue Aug 30 04:37:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:37:52.403775 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31414b78-4807-4e3b-98e2-504566675b50 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:52.415880 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31414b78-4807-4e3b-98e2-504566675b50 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:52.421819 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e95cc-cdad-493c-a383-a3ac3b303dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:52.422464 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e95cc-cdad-493c-a383-a3ac3b303dd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:52.422737 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e95cc-cdad-493c-a383-a3ac3b303dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:52.423067 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e95cc-cdad-493c-a383-a3ac3b303dd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:52.423792 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7e95cc-cdad-493c-a383-a3ac3b303dd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:52.425966 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7e95cc-cdad-493c-a383-a3ac3b303dd0 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:52.471504 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1342/2675] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:37:52 2022] POST /identity/v3/projects => generated 385 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:37:52.474023 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f00b9d-84e5-4c22-aee8-064159ac9f61 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:52.492402 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f00b9d-84e5-4c22-aee8-064159ac9f61 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:52.594272 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef3ccb-4529-4007-a230-ba9b3ac6b7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:52.595436 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef3ccb-4529-4007-a230-ba9b3ac6b7ca admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:52.595992 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef3ccb-4529-4007-a230-ba9b3ac6b7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:52.596490 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef3ccb-4529-4007-a230-ba9b3ac6b7ca admin admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:52.597612 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ef3ccb-4529-4007-a230-ba9b3ac6b7ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:52.601523 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ef3ccb-4529-4007-a230-ba9b3ac6b7ca admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:52.653348 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1334/2676] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:37:52 2022] POST /identity/v3/users => generated 293 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:37:52.659784 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e95cc-cdad-493c-a383-a3ac3b303dd0 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:52.679838 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e95cc-cdad-493c-a383-a3ac3b303dd0 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:52.688253 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e3eea3-3e9f-401c-9722-ed61662512e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:52.689300 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3eea3-3e9f-401c-9722-ed61662512e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:52.689781 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3eea3-3e9f-401c-9722-ed61662512e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:52.690242 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3eea3-3e9f-401c-9722-ed61662512e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:52.691424 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e3eea3-3e9f-401c-9722-ed61662512e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:52.694995 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e3eea3-3e9f-401c-9722-ed61662512e3 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:52.721414 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1343/2677] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:37:52 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:37:52.725874 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef3ccb-4529-4007-a230-ba9b3ac6b7ca admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:52.741149 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef3ccb-4529-4007-a230-ba9b3ac6b7ca admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:52.748126 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56191f02-e16d-4469-a0da-ab2311e8da13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:52.748970 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56191f02-e16d-4469-a0da-ab2311e8da13 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:52.749349 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56191f02-e16d-4469-a0da-ab2311e8da13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:52.749754 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56191f02-e16d-4469-a0da-ab2311e8da13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:52.750728 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56191f02-e16d-4469-a0da-ab2311e8da13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:52.752755 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56191f02-e16d-4469-a0da-ab2311e8da13 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:52.774190 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1335/2678] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:37:52 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:37:52.783357 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e3eea3-3e9f-401c-9722-ed61662512e3 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:52.800133 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e3eea3-3e9f-401c-9722-ed61662512e3 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:52.808344 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d4322c-bf79-4319-bb2b-0046f1097968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:52.809110 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4322c-bf79-4319-bb2b-0046f1097968 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:52.809472 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4322c-bf79-4319-bb2b-0046f1097968 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:52.809845 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4322c-bf79-4319-bb2b-0046f1097968 admin admin] PATH_INFO: `/v3/projects/d4208abe95a14ce8b75ba2c3682e3e0b/users/7307a5b41f9d4577bb23580d2974b1e2/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:52.831937 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d4322c-bf79-4319-bb2b-0046f1097968 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4208abe95a14ce8b75ba2c3682e3e0b, user_id=7307a5b41f9d4577bb23580d2974b1e2, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:52.849348 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d4322c-bf79-4319-bb2b-0046f1097968 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:52.884849 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1344/2679] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:37:52 2022] PUT /identity/v3/projects/d4208abe95a14ce8b75ba2c3682e3e0b/users/7307a5b41f9d4577bb23580d2974b1e2/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:37:52.887587 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978b4f4-fcff-4100-a09c-ca10e9b076e8 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:52.887868 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978b4f4-fcff-4100-a09c-ca10e9b076e8 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:52.888286 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978b4f4-fcff-4100-a09c-ca10e9b076e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:52.932937 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:52.937348 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-c978b4f4-fcff-4100-a09c-ca10e9b076e8 None None] MFA Rules not processed for user `7307a5b41f9d4577bb23580d2974b1e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:37:52.940590 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-c978b4f4-fcff-4100-a09c-ca10e9b076e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:53.068910 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1336/2680] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:37:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:37:53.075120 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d4322c-bf79-4319-bb2b-0046f1097968 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:53.156622 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:53.221446 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d4322c-bf79-4319-bb2b-0046f1097968 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:53.241201 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8dbb31-7ad9-4f43-bb0b-b5b4c76cdd4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:53.242471 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8dbb31-7ad9-4f43-bb0b-b5b4c76cdd4c admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:53.242805 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8dbb31-7ad9-4f43-bb0b-b5b4c76cdd4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:53.243222 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8dbb31-7ad9-4f43-bb0b-b5b4c76cdd4c admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:53.244383 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8dbb31-7ad9-4f43-bb0b-b5b4c76cdd4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:53.248043 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8dbb31-7ad9-4f43-bb0b-b5b4c76cdd4c admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:53.325946 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1345/2681] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:37:53 2022] POST /identity/v3/projects => generated 387 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:37:53.333164 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978b4f4-fcff-4100-a09c-ca10e9b076e8 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:53.354484 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978b4f4-fcff-4100-a09c-ca10e9b076e8 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:53.463093 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9054fca1-964a-4a5e-a7ae-b0aaa8a3601f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:53.463846 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9054fca1-964a-4a5e-a7ae-b0aaa8a3601f admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:53.464164 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9054fca1-964a-4a5e-a7ae-b0aaa8a3601f admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:53.464596 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9054fca1-964a-4a5e-a7ae-b0aaa8a3601f admin admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:53.465320 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9054fca1-964a-4a5e-a7ae-b0aaa8a3601f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:53.468491 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9054fca1-964a-4a5e-a7ae-b0aaa8a3601f admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:53.504730 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1337/2682] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:37:53 2022] POST /identity/v3/users => generated 300 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:37:53.506010 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8dbb31-7ad9-4f43-bb0b-b5b4c76cdd4c admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:53.529309 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8dbb31-7ad9-4f43-bb0b-b5b4c76cdd4c admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:53.537026 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b54fdc-4796-4f24-b572-6785e46a53aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:53.538114 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b54fdc-4796-4f24-b572-6785e46a53aa admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:53.538560 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b54fdc-4796-4f24-b572-6785e46a53aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:53.538824 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b54fdc-4796-4f24-b572-6785e46a53aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:53.539716 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b54fdc-4796-4f24-b572-6785e46a53aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:53.541992 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b54fdc-4796-4f24-b572-6785e46a53aa admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:53.556485 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1346/2683] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:37:53.563560 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9054fca1-964a-4a5e-a7ae-b0aaa8a3601f admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:53.583985 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9054fca1-964a-4a5e-a7ae-b0aaa8a3601f admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:53.593092 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d5b7e-b2fb-4dbd-83a7-bf33a501097c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:53.594317 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d5b7e-b2fb-4dbd-83a7-bf33a501097c admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:53.594737 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d5b7e-b2fb-4dbd-83a7-bf33a501097c admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:53.595267 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d5b7e-b2fb-4dbd-83a7-bf33a501097c admin admin] PATH_INFO: `/v3/projects/9a7698e5a2014e688f3eaec888edaea8/users/7ff56ab9f8684eb7a61d0602aef69568/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:53.626631 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2d5b7e-b2fb-4dbd-83a7-bf33a501097c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a7698e5a2014e688f3eaec888edaea8, user_id=7ff56ab9f8684eb7a61d0602aef69568, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:53.631373 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2d5b7e-b2fb-4dbd-83a7-bf33a501097c admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:53.677874 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1338/2684] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:37:53 2022] PUT /identity/v3/projects/9a7698e5a2014e688f3eaec888edaea8/users/7ff56ab9f8684eb7a61d0602aef69568/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:37:53.685572 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b54fdc-4796-4f24-b572-6785e46a53aa admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:53.701092 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b54fdc-4796-4f24-b572-6785e46a53aa admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:53.793849 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f202c4-d0b7-4d39-afdd-e308fd8f95ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:53.794523 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f202c4-d0b7-4d39-afdd-e308fd8f95ce admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:53.795127 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f202c4-d0b7-4d39-afdd-e308fd8f95ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:53.795376 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f202c4-d0b7-4d39-afdd-e308fd8f95ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:53.796269 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f202c4-d0b7-4d39-afdd-e308fd8f95ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:53.798703 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f202c4-d0b7-4d39-afdd-e308fd8f95ce admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:53.815059 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1347/2685] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:37:53.821396 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d5b7e-b2fb-4dbd-83a7-bf33a501097c admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:53.840563 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d5b7e-b2fb-4dbd-83a7-bf33a501097c admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:53.850694 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92649eb-2425-4854-9af9-c47b9c148304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:53.852102 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92649eb-2425-4854-9af9-c47b9c148304 admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:53.852728 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92649eb-2425-4854-9af9-c47b9c148304 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:53.853613 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92649eb-2425-4854-9af9-c47b9c148304 admin admin] PATH_INFO: `/v3/projects/9a7698e5a2014e688f3eaec888edaea8/users/7ff56ab9f8684eb7a61d0602aef69568/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:53.858519 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92649eb-2425-4854-9af9-c47b9c148304 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a7698e5a2014e688f3eaec888edaea8, user_id=7ff56ab9f8684eb7a61d0602aef69568, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:53.866700 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92649eb-2425-4854-9af9-c47b9c148304 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:53.891391 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1339/2686] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:37:53 2022] PUT /identity/v3/projects/9a7698e5a2014e688f3eaec888edaea8/users/7ff56ab9f8684eb7a61d0602aef69568/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:37:53.924086 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a398070b-d20c-451d-8477-bbbed9f5abad None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:53.925117 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a398070b-d20c-451d-8477-bbbed9f5abad None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:53.925987 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a398070b-d20c-451d-8477-bbbed9f5abad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:53.972977 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-a398070b-d20c-451d-8477-bbbed9f5abad None None] MFA Rules not processed for user `7ff56ab9f8684eb7a61d0602aef69568`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:37:53.974736 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-a398070b-d20c-451d-8477-bbbed9f5abad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:54.093211 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1348/2687] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:37:53 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:37:54.112062 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92649eb-2425-4854-9af9-c47b9c148304 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:54.114942 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-b92649eb-2425-4854-9af9-c47b9c148304 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:54.208508 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92649eb-2425-4854-9af9-c47b9c148304 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:54.215412 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65123d99-dfba-4efe-85db-5c4e4b006776 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:54.216530 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65123d99-dfba-4efe-85db-5c4e4b006776 service cinder] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:54.217087 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65123d99-dfba-4efe-85db-5c4e4b006776 service cinder] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:54.217518 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65123d99-dfba-4efe-85db-5c4e4b006776 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:54.236588 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65123d99-dfba-4efe-85db-5c4e4b006776 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:54.239661 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65123d99-dfba-4efe-85db-5c4e4b006776 service cinder] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:54.247941 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:54.259620 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1340/2688] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:37:54 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:37:54.297829 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a398070b-d20c-451d-8477-bbbed9f5abad None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:54.348452 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:54.397419 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a398070b-d20c-451d-8477-bbbed9f5abad None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:54.404230 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc74be-f55b-4dee-9232-9079127d57b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:54.404890 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc74be-f55b-4dee-9232-9079127d57b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:54.405165 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc74be-f55b-4dee-9232-9079127d57b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:54.405700 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc74be-f55b-4dee-9232-9079127d57b0 admin admin] PATH_INFO: `/v3/users/7307a5b41f9d4577bb23580d2974b1e2` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:54.406735 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facc74be-f55b-4dee-9232-9079127d57b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7307a5b41f9d4577bb23580d2974b1e2)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:54.408825 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facc74be-f55b-4dee-9232-9079127d57b0 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:54.479358 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-facc74be-f55b-4dee-9232-9079127d57b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7307a5b41f9d4577bb23580d2974b1e2'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:54.487228 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-facc74be-f55b-4dee-9232-9079127d57b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7307a5b41f9d4577bb23580d2974b1e2'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:54.497774 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-facc74be-f55b-4dee-9232-9079127d57b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7307a5b41f9d4577bb23580d2974b1e2'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:54.498501 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-facc74be-f55b-4dee-9232-9079127d57b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7307a5b41f9d4577bb23580d2974b1e2'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:54.515438 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-facc74be-f55b-4dee-9232-9079127d57b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7307a5b41f9d4577bb23580d2974b1e2'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:54.523510 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1349/2689] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:37:54 2022] DELETE /identity/v3/users/7307a5b41f9d4577bb23580d2974b1e2 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:37:54.529089 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34482e7f-f993-4a2e-88db-3a848be4adc9 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:54.529588 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34482e7f-f993-4a2e-88db-3a848be4adc9 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:54.529972 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34482e7f-f993-4a2e-88db-3a848be4adc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:54.553004 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-34482e7f-f993-4a2e-88db-3a848be4adc9 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:37:54.554288 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-34482e7f-f993-4a2e-88db-3a848be4adc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:54.632127 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1341/2690] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:37:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:37:54.647928 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc74be-f55b-4dee-9232-9079127d57b0 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:54.652100 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-facc74be-f55b-4dee-9232-9079127d57b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:54.734974 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc74be-f55b-4dee-9232-9079127d57b0 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:54.740181 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e03deb2-aa2f-4492-af2b-0a21234143fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:54.740916 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e03deb2-aa2f-4492-af2b-0a21234143fc service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:54.741354 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e03deb2-aa2f-4492-af2b-0a21234143fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:54.741671 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e03deb2-aa2f-4492-af2b-0a21234143fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:54.758328 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e03deb2-aa2f-4492-af2b-0a21234143fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:54.761225 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e03deb2-aa2f-4492-af2b-0a21234143fc service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:54.778481 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1350/2691] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:37:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:37:55.327000 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34482e7f-f993-4a2e-88db-3a848be4adc9 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:55.328954 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-34482e7f-f993-4a2e-88db-3a848be4adc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:55.354295 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34482e7f-f993-4a2e-88db-3a848be4adc9 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:55.363174 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117484ca-edfd-486b-a8e8-3d592e6b337d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:55.364733 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117484ca-edfd-486b-a8e8-3d592e6b337d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:55.365379 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117484ca-edfd-486b-a8e8-3d592e6b337d admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:55.366379 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117484ca-edfd-486b-a8e8-3d592e6b337d admin admin] PATH_INFO: `/v3/projects/d4208abe95a14ce8b75ba2c3682e3e0b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:55.368975 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117484ca-edfd-486b-a8e8-3d592e6b337d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4208abe95a14ce8b75ba2c3682e3e0b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:55.373217 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117484ca-edfd-486b-a8e8-3d592e6b337d admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:55.432758 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e03deb2-aa2f-4492-af2b-0a21234143fc service neutron] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:55.436173 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-6e03deb2-aa2f-4492-af2b-0a21234143fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:55.460455 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e03deb2-aa2f-4492-af2b-0a21234143fc service neutron] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:55.494702 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-117484ca-edfd-486b-a8e8-3d592e6b337d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4208abe95a14ce8b75ba2c3682e3e0b', 'request_id': 'req-117484ca-edfd-486b-a8e8-3d592e6b337d'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:55.515508 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-117484ca-edfd-486b-a8e8-3d592e6b337d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4208abe95a14ce8b75ba2c3682e3e0b', 'request_id': 'req-117484ca-edfd-486b-a8e8-3d592e6b337d'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:55.538504 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-117484ca-edfd-486b-a8e8-3d592e6b337d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4208abe95a14ce8b75ba2c3682e3e0b', 'request_id': 'req-117484ca-edfd-486b-a8e8-3d592e6b337d'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:55.559870 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-117484ca-edfd-486b-a8e8-3d592e6b337d admin admin] The token cache is being invalidate because project d4208abe95a14ce8b75ba2c3682e3e0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:37:55.560770 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-117484ca-edfd-486b-a8e8-3d592e6b337d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:55.562167 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-117484ca-edfd-486b-a8e8-3d592e6b337d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:55.564895 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1342/2692] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:37:55 2022] DELETE /identity/v3/projects/d4208abe95a14ce8b75ba2c3682e3e0b => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:37:55.569367 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117484ca-edfd-486b-a8e8-3d592e6b337d admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:55.571183 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-117484ca-edfd-486b-a8e8-3d592e6b337d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:55.574069 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:55.596437 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bab53e-6329-4d4b-8de4-adf111cf2b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:55.597326 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bab53e-6329-4d4b-8de4-adf111cf2b4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:55.597730 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bab53e-6329-4d4b-8de4-adf111cf2b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:55.600046 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bab53e-6329-4d4b-8de4-adf111cf2b4d admin admin] PATH_INFO: `/v3/users/226f3fbd514e4946bbc99a3b315a671f` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:55.602119 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bab53e-6329-4d4b-8de4-adf111cf2b4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=226f3fbd514e4946bbc99a3b315a671f)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:55.604787 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bab53e-6329-4d4b-8de4-adf111cf2b4d admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:55.671839 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117484ca-edfd-486b-a8e8-3d592e6b337d admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:55.678318 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb9d438-39ae-4910-a48e-21be3716a291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:55.678981 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9d438-39ae-4910-a48e-21be3716a291 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:55.679255 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9d438-39ae-4910-a48e-21be3716a291 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:55.679713 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9d438-39ae-4910-a48e-21be3716a291 admin admin] PATH_INFO: `/v3/users/7ff56ab9f8684eb7a61d0602aef69568` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:55.681371 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb9d438-39ae-4910-a48e-21be3716a291 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ff56ab9f8684eb7a61d0602aef69568)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:55.684113 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb9d438-39ae-4910-a48e-21be3716a291 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:55.713953 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-08bab53e-6329-4d4b-8de4-adf111cf2b4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '226f3fbd514e4946bbc99a3b315a671f'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:55.722425 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-08bab53e-6329-4d4b-8de4-adf111cf2b4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '226f3fbd514e4946bbc99a3b315a671f'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:55.733174 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-08bab53e-6329-4d4b-8de4-adf111cf2b4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '226f3fbd514e4946bbc99a3b315a671f'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:55.734480 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-08bab53e-6329-4d4b-8de4-adf111cf2b4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '226f3fbd514e4946bbc99a3b315a671f'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:55.737713 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:55.754066 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-08bab53e-6329-4d4b-8de4-adf111cf2b4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '226f3fbd514e4946bbc99a3b315a671f'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:55.764006 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1351/2693] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:37:55 2022] DELETE /identity/v3/users/226f3fbd514e4946bbc99a3b315a671f => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:37:55.771396 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c267a-b1f3-4c61-ab79-296c79daf699 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:55.772108 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c267a-b1f3-4c61-ab79-296c79daf699 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:55.772575 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c267a-b1f3-4c61-ab79-296c79daf699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:55.781675 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-3fb9d438-39ae-4910-a48e-21be3716a291 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ff56ab9f8684eb7a61d0602aef69568'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:55.782663 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-3fb9d438-39ae-4910-a48e-21be3716a291 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ff56ab9f8684eb7a61d0602aef69568'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:55.783404 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-3fb9d438-39ae-4910-a48e-21be3716a291 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ff56ab9f8684eb7a61d0602aef69568'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:55.801521 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-4b0c267a-b1f3-4c61-ab79-296c79daf699 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:37:55.802866 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-4b0c267a-b1f3-4c61-ab79-296c79daf699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:55.804688 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-3fb9d438-39ae-4910-a48e-21be3716a291 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ff56ab9f8684eb7a61d0602aef69568'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:55.832057 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-3fb9d438-39ae-4910-a48e-21be3716a291 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ff56ab9f8684eb7a61d0602aef69568'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:55.853181 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1343/2694] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:37:55 2022] DELETE /identity/v3/users/7ff56ab9f8684eb7a61d0602aef69568 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:37:55.922878 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1352/2695] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:37:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:37:55.943199 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb9d438-39ae-4910-a48e-21be3716a291 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:55.946576 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-3fb9d438-39ae-4910-a48e-21be3716a291 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:56.073954 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb9d438-39ae-4910-a48e-21be3716a291 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:56.081170 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe1377d-6049-4a5f-9155-7b1be41d09db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:56.082404 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe1377d-6049-4a5f-9155-7b1be41d09db service neutron] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:56.082932 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe1377d-6049-4a5f-9155-7b1be41d09db service neutron] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:56.083554 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe1377d-6049-4a5f-9155-7b1be41d09db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:56.245451 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe1377d-6049-4a5f-9155-7b1be41d09db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:56.248456 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe1377d-6049-4a5f-9155-7b1be41d09db service neutron] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:56.270685 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1344/2696] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:37:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:37:56.512186 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0c267a-b1f3-4c61-ab79-296c79daf699 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:56.514185 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-4b0c267a-b1f3-4c61-ab79-296c79daf699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:56.528575 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0c267a-b1f3-4c61-ab79-296c79daf699 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:56.535836 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03908da-aa30-4c08-83ac-e1b16d34eaf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:56.538015 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03908da-aa30-4c08-83ac-e1b16d34eaf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:56.538479 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03908da-aa30-4c08-83ac-e1b16d34eaf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:56.538732 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03908da-aa30-4c08-83ac-e1b16d34eaf8 admin admin] PATH_INFO: `/v3/projects/9a7698e5a2014e688f3eaec888edaea8` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:56.540230 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03908da-aa30-4c08-83ac-e1b16d34eaf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a7698e5a2014e688f3eaec888edaea8)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:56.542394 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03908da-aa30-4c08-83ac-e1b16d34eaf8 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:56.610659 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-a03908da-aa30-4c08-83ac-e1b16d34eaf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a7698e5a2014e688f3eaec888edaea8', 'request_id': 'req-a03908da-aa30-4c08-83ac-e1b16d34eaf8'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:56.632745 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-a03908da-aa30-4c08-83ac-e1b16d34eaf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a7698e5a2014e688f3eaec888edaea8', 'request_id': 'req-a03908da-aa30-4c08-83ac-e1b16d34eaf8'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:56.648403 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-a03908da-aa30-4c08-83ac-e1b16d34eaf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a7698e5a2014e688f3eaec888edaea8', 'request_id': 'req-a03908da-aa30-4c08-83ac-e1b16d34eaf8'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:56.653501 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:56.695032 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-a03908da-aa30-4c08-83ac-e1b16d34eaf8 admin admin] The token cache is being invalidate because project 9a7698e5a2014e688f3eaec888edaea8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:37:56.695479 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-a03908da-aa30-4c08-83ac-e1b16d34eaf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:56.696383 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-a03908da-aa30-4c08-83ac-e1b16d34eaf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:56.698471 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1353/2697] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:37:56 2022] DELETE /identity/v3/projects/9a7698e5a2014e688f3eaec888edaea8 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:37:56.705012 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625b235-8cd0-4bcb-8850-2cb3e91b5829 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:56.705916 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625b235-8cd0-4bcb-8850-2cb3e91b5829 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:56.705916 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625b235-8cd0-4bcb-8850-2cb3e91b5829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:56.735164 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-a625b235-8cd0-4bcb-8850-2cb3e91b5829 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:37:56.737044 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-a625b235-8cd0-4bcb-8850-2cb3e91b5829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:56.837678 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:56.872559 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1345/2698] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:37:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:37:56.887649 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8224397d-7ce7-4485-9797-693469ae8fc7 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:56.889751 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8224397d-7ce7-4485-9797-693469ae8fc7 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:56.890527 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8224397d-7ce7-4485-9797-693469ae8fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:56.927812 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-8224397d-7ce7-4485-9797-693469ae8fc7 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:37:56.930431 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-8224397d-7ce7-4485-9797-693469ae8fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:56.954124 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1354/2699] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:37:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:37:56.965930 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625b235-8cd0-4bcb-8850-2cb3e91b5829 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:56.997142 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625b235-8cd0-4bcb-8850-2cb3e91b5829 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:57.009718 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e13ab-e059-4e66-a601-48a1b00c141e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:57.010898 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e13ab-e059-4e66-a601-48a1b00c141e admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:57.011376 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e13ab-e059-4e66-a601-48a1b00c141e admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:57.011826 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e13ab-e059-4e66-a601-48a1b00c141e admin admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:57.013221 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1e13ab-e059-4e66-a601-48a1b00c141e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:37:57.013843 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1e13ab-e059-4e66-a601-48a1b00c141e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:57.017314 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1e13ab-e059-4e66-a601-48a1b00c141e admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:57.042274 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8224397d-7ce7-4485-9797-693469ae8fc7 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:57.044130 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-8224397d-7ce7-4485-9797-693469ae8fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:57.048630 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1346/2700] 10.222.0.91 () {58 vars in 1153 bytes} [Tue Aug 30 04:37:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:37:57.061048 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e13ab-e059-4e66-a601-48a1b00c141e admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:57.068286 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8224397d-7ce7-4485-9797-693469ae8fc7 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:57.090865 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e13ab-e059-4e66-a601-48a1b00c141e admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:57.091830 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa7f4e-594f-4fc8-a77b-5df641b0de25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:57.092703 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa7f4e-594f-4fc8-a77b-5df641b0de25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:57.093198 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa7f4e-594f-4fc8-a77b-5df641b0de25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:57.093517 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa7f4e-594f-4fc8-a77b-5df641b0de25 admin admin] PATH_INFO: `/v3/projects/51571af25ec64fa0b196dbe22596abdd` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:57.094923 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa7f4e-594f-4fc8-a77b-5df641b0de25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51571af25ec64fa0b196dbe22596abdd)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:57.097328 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa7f4e-594f-4fc8-a77b-5df641b0de25 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:57.103499 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe93132-a624-4d6a-8c52-e8fb2e218641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:57.104244 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe93132-a624-4d6a-8c52-e8fb2e218641 admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:57.104733 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe93132-a624-4d6a-8c52-e8fb2e218641 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:57.105055 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe93132-a624-4d6a-8c52-e8fb2e218641 admin admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:57.105725 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe93132-a624-4d6a-8c52-e8fb2e218641 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:57.107730 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe93132-a624-4d6a-8c52-e8fb2e218641 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:57.153882 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1347/2701] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:37:57 2022] POST /identity/v3/projects => generated 393 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:37:57.155431 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe93132-a624-4d6a-8c52-e8fb2e218641 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:57.173097 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-14aa7f4e-594f-4fc8-a77b-5df641b0de25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51571af25ec64fa0b196dbe22596abdd', 'request_id': 'req-14aa7f4e-594f-4fc8-a77b-5df641b0de25'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:57.187647 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-14aa7f4e-594f-4fc8-a77b-5df641b0de25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51571af25ec64fa0b196dbe22596abdd', 'request_id': 'req-14aa7f4e-594f-4fc8-a77b-5df641b0de25'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:57.209443 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-14aa7f4e-594f-4fc8-a77b-5df641b0de25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51571af25ec64fa0b196dbe22596abdd', 'request_id': 'req-14aa7f4e-594f-4fc8-a77b-5df641b0de25'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:57.235107 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-14aa7f4e-594f-4fc8-a77b-5df641b0de25 admin admin] The token cache is being invalidate because project 51571af25ec64fa0b196dbe22596abdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:37:57.235455 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-14aa7f4e-594f-4fc8-a77b-5df641b0de25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:57.236469 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-14aa7f4e-594f-4fc8-a77b-5df641b0de25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:57.239282 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1355/2702] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:37:57 2022] DELETE /identity/v3/projects/51571af25ec64fa0b196dbe22596abdd => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:37:57.245604 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa7f4e-594f-4fc8-a77b-5df641b0de25 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:57.250726 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-14aa7f4e-594f-4fc8-a77b-5df641b0de25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:57.312104 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe93132-a624-4d6a-8c52-e8fb2e218641 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:57.318951 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219069a4-ca29-4ebe-9ef4-d6ae78434495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:57.319599 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219069a4-ca29-4ebe-9ef4-d6ae78434495 admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:57.319880 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219069a4-ca29-4ebe-9ef4-d6ae78434495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:57.320899 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219069a4-ca29-4ebe-9ef4-d6ae78434495 admin admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:57.321645 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219069a4-ca29-4ebe-9ef4-d6ae78434495 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:57.323664 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219069a4-ca29-4ebe-9ef4-d6ae78434495 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:57.353663 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1348/2703] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:37:57 2022] POST /identity/v3/users => generated 297 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:37:57.362896 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219069a4-ca29-4ebe-9ef4-d6ae78434495 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:57.365752 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-219069a4-ca29-4ebe-9ef4-d6ae78434495 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:57.387280 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219069a4-ca29-4ebe-9ef4-d6ae78434495 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:57.388239 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa7f4e-594f-4fc8-a77b-5df641b0de25 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:57.395623 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e750c260-4df0-4d06-94ce-1910d7e11ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:57.396735 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e750c260-4df0-4d06-94ce-1910d7e11ead admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:57.397279 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e750c260-4df0-4d06-94ce-1910d7e11ead admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:57.397417 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4668b9f-827e-43ab-b15a-cd32069ec5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:57.397887 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e750c260-4df0-4d06-94ce-1910d7e11ead admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:57.398297 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4668b9f-827e-43ab-b15a-cd32069ec5a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:57.398750 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4668b9f-827e-43ab-b15a-cd32069ec5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:57.399217 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4668b9f-827e-43ab-b15a-cd32069ec5a3 admin admin] PATH_INFO: `/v3/users/b94bb7d8fb8a432b931384baaf8c42dc` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:57.399354 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e750c260-4df0-4d06-94ce-1910d7e11ead admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:57.401213 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4668b9f-827e-43ab-b15a-cd32069ec5a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b94bb7d8fb8a432b931384baaf8c42dc)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:57.402551 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e750c260-4df0-4d06-94ce-1910d7e11ead admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:57.404703 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4668b9f-827e-43ab-b15a-cd32069ec5a3 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:57.425781 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1349/2704] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:37:57 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:37:57.428352 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e750c260-4df0-4d06-94ce-1910d7e11ead admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:57.449040 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e750c260-4df0-4d06-94ce-1910d7e11ead admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:57.458333 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4e07a-8e51-4e9a-bdc7-06b12b20895f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:57.459742 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4e07a-8e51-4e9a-bdc7-06b12b20895f admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:57.460147 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4e07a-8e51-4e9a-bdc7-06b12b20895f admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:57.460628 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4e07a-8e51-4e9a-bdc7-06b12b20895f admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:57.461936 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb4e07a-8e51-4e9a-bdc7-06b12b20895f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:57.465288 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb4e07a-8e51-4e9a-bdc7-06b12b20895f admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:57.486061 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1350/2705] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:37:57 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:37:57.490689 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4e07a-8e51-4e9a-bdc7-06b12b20895f admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:57.493668 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-a4668b9f-827e-43ab-b15a-cd32069ec5a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b94bb7d8fb8a432b931384baaf8c42dc'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:57.504296 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-a4668b9f-827e-43ab-b15a-cd32069ec5a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b94bb7d8fb8a432b931384baaf8c42dc'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:57.509139 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4e07a-8e51-4e9a-bdc7-06b12b20895f admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:57.515950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-a4668b9f-827e-43ab-b15a-cd32069ec5a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b94bb7d8fb8a432b931384baaf8c42dc'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:57.516666 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-a4668b9f-827e-43ab-b15a-cd32069ec5a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b94bb7d8fb8a432b931384baaf8c42dc'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:57.518827 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a59cb-bf53-45a9-99a1-0436a2b57d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:57.520653 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a59cb-bf53-45a9-99a1-0436a2b57d37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:57.521259 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a59cb-bf53-45a9-99a1-0436a2b57d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:57.521865 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a59cb-bf53-45a9-99a1-0436a2b57d37 admin admin] PATH_INFO: `/v3/projects/53194453412045da973b8170fa64b593/users/9af8f1e723704570a539d54969980b18/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:57.530133 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:57.539219 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-a4668b9f-827e-43ab-b15a-cd32069ec5a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b94bb7d8fb8a432b931384baaf8c42dc'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:57.551141 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a59cb-bf53-45a9-99a1-0436a2b57d37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53194453412045da973b8170fa64b593, user_id=9af8f1e723704570a539d54969980b18, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:57.553683 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1356/2706] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:37:57 2022] DELETE /identity/v3/users/b94bb7d8fb8a432b931384baaf8c42dc => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:37:57.555697 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a59cb-bf53-45a9-99a1-0436a2b57d37 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:57.578539 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1351/2707] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:37:57 2022] PUT /identity/v3/projects/53194453412045da973b8170fa64b593/users/9af8f1e723704570a539d54969980b18/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:37:57.589950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261c609-7694-432f-8086-8849e12c6ddf None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:57.590315 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261c609-7694-432f-8086-8849e12c6ddf None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:57.590532 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261c609-7694-432f-8086-8849e12c6ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:57.646834 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-2261c609-7694-432f-8086-8849e12c6ddf None None] MFA Rules not processed for user `9af8f1e723704570a539d54969980b18`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:37:57.648235 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-2261c609-7694-432f-8086-8849e12c6ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:57.788015 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1357/2708] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:37:57 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:37:57.793597 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a59cb-bf53-45a9-99a1-0436a2b57d37 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:57.798159 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-af0a59cb-bf53-45a9-99a1-0436a2b57d37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:57.910526 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a59cb-bf53-45a9-99a1-0436a2b57d37 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:57.916952 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96825b44-c397-4af2-80fc-a72f6a45e3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:57.917601 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96825b44-c397-4af2-80fc-a72f6a45e3b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:57.917884 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96825b44-c397-4af2-80fc-a72f6a45e3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:57.918158 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96825b44-c397-4af2-80fc-a72f6a45e3b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:57.918815 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96825b44-c397-4af2-80fc-a72f6a45e3b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:57.920824 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96825b44-c397-4af2-80fc-a72f6a45e3b0 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:57.928460 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:57.958304 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1352/2709] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:37:57 2022] POST /identity/v3/projects => generated 393 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:37:57.962291 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2261c609-7694-432f-8086-8849e12c6ddf None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:57.977137 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2261c609-7694-432f-8086-8849e12c6ddf None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:58.012047 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96825b44-c397-4af2-80fc-a72f6a45e3b0 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:58.014654 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-96825b44-c397-4af2-80fc-a72f6a45e3b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:58.061128 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d0987-ec8d-4075-ab50-7c0e0b652aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:58.062085 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d0987-ec8d-4075-ab50-7c0e0b652aae admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:58.062298 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d0987-ec8d-4075-ab50-7c0e0b652aae admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:58.062628 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d0987-ec8d-4075-ab50-7c0e0b652aae admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:58.063444 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1d0987-ec8d-4075-ab50-7c0e0b652aae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:58.065493 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1d0987-ec8d-4075-ab50-7c0e0b652aae admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:58.103684 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1358/2710] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:37:57 2022] POST /identity/v3/users => generated 303 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:37:58.107958 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d0987-ec8d-4075-ab50-7c0e0b652aae admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:58.120280 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d0987-ec8d-4075-ab50-7c0e0b652aae admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:58.134238 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96825b44-c397-4af2-80fc-a72f6a45e3b0 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:58.134611 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abaced2-13a9-45fa-8f40-84775043a06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:58.136166 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abaced2-13a9-45fa-8f40-84775043a06e admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:58.136761 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abaced2-13a9-45fa-8f40-84775043a06e admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:58.137342 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abaced2-13a9-45fa-8f40-84775043a06e admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:58.138850 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abaced2-13a9-45fa-8f40-84775043a06e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:58.141615 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c82c016-7d88-4c2e-bdb3-f15a1cf5f59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:58.141942 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abaced2-13a9-45fa-8f40-84775043a06e admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:58.142802 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82c016-7d88-4c2e-bdb3-f15a1cf5f59a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:58.143233 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82c016-7d88-4c2e-bdb3-f15a1cf5f59a admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:58.143836 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82c016-7d88-4c2e-bdb3-f15a1cf5f59a admin admin] PATH_INFO: `/v3/projects/945f4eaf67e24f39a86fbe5d0ac0c260` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:58.145862 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c82c016-7d88-4c2e-bdb3-f15a1cf5f59a admin admin] RBAC: Authorizing `identity:delete_project(project_id=945f4eaf67e24f39a86fbe5d0ac0c260)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:58.148681 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c82c016-7d88-4c2e-bdb3-f15a1cf5f59a admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:58.156011 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1359/2711] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:37:58.160501 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abaced2-13a9-45fa-8f40-84775043a06e admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:58.174731 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abaced2-13a9-45fa-8f40-84775043a06e admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:58.183763 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e21262-2d52-455b-82ed-b441c56249af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:58.187155 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e21262-2d52-455b-82ed-b441c56249af admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:58.187155 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e21262-2d52-455b-82ed-b441c56249af admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:58.187155 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e21262-2d52-455b-82ed-b441c56249af admin admin] PATH_INFO: `/v3/projects/015808ae76c44009b16f84f02c9b8f42/users/5a54e2d895bc4e64a6f9d6ed786c9354/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:58.207056 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e21262-2d52-455b-82ed-b441c56249af admin admin] RBAC: Authorizing `identity:create_grant(project_id=015808ae76c44009b16f84f02c9b8f42, user_id=5a54e2d895bc4e64a6f9d6ed786c9354, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:58.211085 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e21262-2d52-455b-82ed-b441c56249af admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:58.233733 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1360/2712] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:37:58 2022] PUT /identity/v3/projects/015808ae76c44009b16f84f02c9b8f42/users/5a54e2d895bc4e64a6f9d6ed786c9354/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:37:58.240054 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e21262-2d52-455b-82ed-b441c56249af admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:58.264345 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-8c82c016-7d88-4c2e-bdb3-f15a1cf5f59a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '945f4eaf67e24f39a86fbe5d0ac0c260', 'request_id': 'req-8c82c016-7d88-4c2e-bdb3-f15a1cf5f59a'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:58.274340 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-8c82c016-7d88-4c2e-bdb3-f15a1cf5f59a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '945f4eaf67e24f39a86fbe5d0ac0c260', 'request_id': 'req-8c82c016-7d88-4c2e-bdb3-f15a1cf5f59a'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:58.292718 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:58.293050 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-8c82c016-7d88-4c2e-bdb3-f15a1cf5f59a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '945f4eaf67e24f39a86fbe5d0ac0c260', 'request_id': 'req-8c82c016-7d88-4c2e-bdb3-f15a1cf5f59a'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:58.315755 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-8c82c016-7d88-4c2e-bdb3-f15a1cf5f59a admin admin] The token cache is being invalidate because project 945f4eaf67e24f39a86fbe5d0ac0c260 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:37:58.316074 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-8c82c016-7d88-4c2e-bdb3-f15a1cf5f59a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:58.317025 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-8c82c016-7d88-4c2e-bdb3-f15a1cf5f59a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:58.324459 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1353/2713] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:37:58 2022] DELETE /identity/v3/projects/945f4eaf67e24f39a86fbe5d0ac0c260 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:37:58.327395 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c094c-41a7-4007-8259-decc690192e8 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:58.327823 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c094c-41a7-4007-8259-decc690192e8 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:58.328134 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c094c-41a7-4007-8259-decc690192e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:58.352517 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-c44c094c-41a7-4007-8259-decc690192e8 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:37:58.354016 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-c44c094c-41a7-4007-8259-decc690192e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:58.358543 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e21262-2d52-455b-82ed-b441c56249af admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:58.451462 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4350bd49-8aa9-40a9-8af0-68e6a2fbac7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:58.452102 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4350bd49-8aa9-40a9-8af0-68e6a2fbac7c admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:58.452426 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4350bd49-8aa9-40a9-8af0-68e6a2fbac7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:58.452716 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4350bd49-8aa9-40a9-8af0-68e6a2fbac7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:58.453366 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4350bd49-8aa9-40a9-8af0-68e6a2fbac7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:58.455114 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4350bd49-8aa9-40a9-8af0-68e6a2fbac7c admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:58.466926 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1354/2714] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:37:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:37:58.468172 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1361/2715] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:37:58.473563 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c094c-41a7-4007-8259-decc690192e8 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:58.475295 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae0558-8ca5-4f13-b5d5-804ef9186b17 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:58.475836 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae0558-8ca5-4f13-b5d5-804ef9186b17 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:58.476224 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae0558-8ca5-4f13-b5d5-804ef9186b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:58.476415 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-c44c094c-41a7-4007-8259-decc690192e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:58.497765 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c094c-41a7-4007-8259-decc690192e8 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:58.502823 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f2c6ca-ccfd-4218-87cc-fb03a8b626e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:58.503530 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f2c6ca-ccfd-4218-87cc-fb03a8b626e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:58.503800 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f2c6ca-ccfd-4218-87cc-fb03a8b626e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:58.504552 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f2c6ca-ccfd-4218-87cc-fb03a8b626e3 admin admin] PATH_INFO: `/v3/projects/015808ae76c44009b16f84f02c9b8f42/users/5a54e2d895bc4e64a6f9d6ed786c9354/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:58.507701 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f2c6ca-ccfd-4218-87cc-fb03a8b626e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=015808ae76c44009b16f84f02c9b8f42, user_id=5a54e2d895bc4e64a6f9d6ed786c9354, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:58.512217 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-78ae0558-8ca5-4f13-b5d5-804ef9186b17 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:37:58.513318 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f2c6ca-ccfd-4218-87cc-fb03a8b626e3 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:58.513902 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-78ae0558-8ca5-4f13-b5d5-804ef9186b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:58.523464 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1362/2716] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:37:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:37:58.528542 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ae0558-8ca5-4f13-b5d5-804ef9186b17 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:58.534133 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1355/2717] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:37:58 2022] PUT /identity/v3/projects/015808ae76c44009b16f84f02c9b8f42/users/5a54e2d895bc4e64a6f9d6ed786c9354/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:37:58.539782 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ae0558-8ca5-4f13-b5d5-804ef9186b17 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:58.555033 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864714d-cbc8-4c3a-af3b-40f0ba98a463 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:58.555535 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864714d-cbc8-4c3a-af3b-40f0ba98a463 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:58.556145 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864714d-cbc8-4c3a-af3b-40f0ba98a463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:58.569569 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:58.611804 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-a864714d-cbc8-4c3a-af3b-40f0ba98a463 None None] MFA Rules not processed for user `5a54e2d895bc4e64a6f9d6ed786c9354`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:37:58.613397 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-a864714d-cbc8-4c3a-af3b-40f0ba98a463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:58.633786 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2073e7-6ba5-457b-96ba-ecb66b126fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:58.634914 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2073e7-6ba5-457b-96ba-ecb66b126fdf admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:58.635864 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2073e7-6ba5-457b-96ba-ecb66b126fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:58.636414 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2073e7-6ba5-457b-96ba-ecb66b126fdf admin admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:58.638324 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2073e7-6ba5-457b-96ba-ecb66b126fdf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:37:58.638324 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2073e7-6ba5-457b-96ba-ecb66b126fdf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:58.641683 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2073e7-6ba5-457b-96ba-ecb66b126fdf admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:58.668783 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1363/2718] 10.222.0.91 () {58 vars in 1153 bytes} [Tue Aug 30 04:37:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:37:58.675550 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2073e7-6ba5-457b-96ba-ecb66b126fdf admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:58.698047 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2073e7-6ba5-457b-96ba-ecb66b126fdf admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:58.708652 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1dc429-d61d-4050-ac25-3fee5910679b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:58.709480 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1dc429-d61d-4050-ac25-3fee5910679b admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:58.710812 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1dc429-d61d-4050-ac25-3fee5910679b admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:58.710812 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1dc429-d61d-4050-ac25-3fee5910679b admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:58.711474 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1dc429-d61d-4050-ac25-3fee5910679b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:58.714391 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1dc429-d61d-4050-ac25-3fee5910679b admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:58.740157 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1356/2719] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:37:58 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:37:58.754237 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a864714d-cbc8-4c3a-af3b-40f0ba98a463 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:58.759029 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-a864714d-cbc8-4c3a-af3b-40f0ba98a463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:58.768333 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1364/2720] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:37:58 2022] POST /identity/v3/projects => generated 379 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:37:58.771505 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1dc429-d61d-4050-ac25-3fee5910679b admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:58.847501 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:58.857049 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a864714d-cbc8-4c3a-af3b-40f0ba98a463 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:58.896220 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1dc429-d61d-4050-ac25-3fee5910679b admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:58.905565 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1474cf3-e402-4875-a0a1-6ce439220f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:58.906601 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1474cf3-e402-4875-a0a1-6ce439220f20 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:58.907295 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1474cf3-e402-4875-a0a1-6ce439220f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:58.907536 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1474cf3-e402-4875-a0a1-6ce439220f20 admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:58.909196 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1474cf3-e402-4875-a0a1-6ce439220f20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:58.913064 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1474cf3-e402-4875-a0a1-6ce439220f20 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:58.942842 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8030a356-2057-4a73-a45e-f0e1f2065bb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:58.943329 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030a356-2057-4a73-a45e-f0e1f2065bb7 service cinder] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:58.943738 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030a356-2057-4a73-a45e-f0e1f2065bb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:58.944397 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030a356-2057-4a73-a45e-f0e1f2065bb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:58.964380 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1365/2721] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:37:58 2022] POST /identity/v3/users => generated 290 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:37:58.970602 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1474cf3-e402-4875-a0a1-6ce439220f20 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:58.993363 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1474cf3-e402-4875-a0a1-6ce439220f20 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:59.003200 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d586747-7a13-4e72-9fe3-16200bd2deef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:59.004368 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d586747-7a13-4e72-9fe3-16200bd2deef admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:59.004889 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d586747-7a13-4e72-9fe3-16200bd2deef admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:59.005453 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d586747-7a13-4e72-9fe3-16200bd2deef admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:59.006562 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d586747-7a13-4e72-9fe3-16200bd2deef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:59.009720 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d586747-7a13-4e72-9fe3-16200bd2deef admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:59.031644 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1366/2722] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:37:59.038280 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d586747-7a13-4e72-9fe3-16200bd2deef admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:59.052617 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:59.057269 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d586747-7a13-4e72-9fe3-16200bd2deef admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:59.062088 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8030a356-2057-4a73-a45e-f0e1f2065bb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:59.064985 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8030a356-2057-4a73-a45e-f0e1f2065bb7 service cinder] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:59.066407 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a5a3cd-ec51-4a2f-9b27-4157ac2f8378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:59.068255 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5a3cd-ec51-4a2f-9b27-4157ac2f8378 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:59.068984 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5a3cd-ec51-4a2f-9b27-4157ac2f8378 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:59.069520 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5a3cd-ec51-4a2f-9b27-4157ac2f8378 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:59.070912 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a5a3cd-ec51-4a2f-9b27-4157ac2f8378 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:59.074411 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a5a3cd-ec51-4a2f-9b27-4157ac2f8378 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:59.086578 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1357/2723] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:37:58 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:37:59.099827 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1367/2724] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:37:59.103489 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8030a356-2057-4a73-a45e-f0e1f2065bb7 service cinder] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:59.123841 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8030a356-2057-4a73-a45e-f0e1f2065bb7 service cinder] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:59.138180 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109f20b9-a51a-4639-88d8-847050f2e3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:59.139187 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f20b9-a51a-4639-88d8-847050f2e3e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:59.139477 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f20b9-a51a-4639-88d8-847050f2e3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:59.139842 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f20b9-a51a-4639-88d8-847050f2e3e1 admin admin] PATH_INFO: `/v3/projects/ae901bf0464742b1b9d012aaef1551a1/users/e920cb6e202a48f1b4167f384c5456e2/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:59.166316 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109f20b9-a51a-4639-88d8-847050f2e3e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae901bf0464742b1b9d012aaef1551a1, user_id=e920cb6e202a48f1b4167f384c5456e2, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:59.166316 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109f20b9-a51a-4639-88d8-847050f2e3e1 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:59.175583 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a5a3cd-ec51-4a2f-9b27-4157ac2f8378 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:59.179056 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-c7a5a3cd-ec51-4a2f-9b27-4157ac2f8378 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:59.197726 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a5a3cd-ec51-4a2f-9b27-4157ac2f8378 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:59.202968 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1358/2725] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:37:59 2022] PUT /identity/v3/projects/ae901bf0464742b1b9d012aaef1551a1/users/e920cb6e202a48f1b4167f384c5456e2/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:37:59.226334 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8f614-6555-401a-8646-51e2453db0cb None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:59.227099 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8f614-6555-401a-8646-51e2453db0cb None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:59.227536 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8f614-6555-401a-8646-51e2453db0cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:59.273300 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-c9f8f614-6555-401a-8646-51e2453db0cb None None] MFA Rules not processed for user `e920cb6e202a48f1b4167f384c5456e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:37:59.274898 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-c9f8f614-6555-401a-8646-51e2453db0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:59.301105 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea5632-ea06-42b8-8058-33f68603d09b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:59.302997 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea5632-ea06-42b8-8058-33f68603d09b service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:59.303681 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea5632-ea06-42b8-8058-33f68603d09b service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:59.304116 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea5632-ea06-42b8-8058-33f68603d09b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:59.307298 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-4dea5632-ea06-42b8-8058-33f68603d09b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:59.376256 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1359/2726] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:37:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:37:59.381656 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f8f614-6555-401a-8646-51e2453db0cb None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:59.400013 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dea5632-ea06-42b8-8058-33f68603d09b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:59.403337 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dea5632-ea06-42b8-8058-33f68603d09b service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:59.431162 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1368/2727] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:37:59 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:37:59.463661 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f8f614-6555-401a-8646-51e2453db0cb None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:59.469248 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa433591-032b-4ac0-9bf4-8c9c90430153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:59.469897 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa433591-032b-4ac0-9bf4-8c9c90430153 admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:59.470180 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa433591-032b-4ac0-9bf4-8c9c90430153 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:59.470448 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa433591-032b-4ac0-9bf4-8c9c90430153 admin admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:59.471102 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa433591-032b-4ac0-9bf4-8c9c90430153 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:59.473243 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa433591-032b-4ac0-9bf4-8c9c90430153 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:59.512778 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1360/2728] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:37:59 2022] POST /identity/v3/projects => generated 379 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:37:59.520333 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea5632-ea06-42b8-8058-33f68603d09b service cinder] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:59.539571 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea5632-ea06-42b8-8058-33f68603d09b service cinder] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:59.611945 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6259470-4552-40dc-9aa0-b02998866318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:59.612755 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6259470-4552-40dc-9aa0-b02998866318 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:59.613035 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6259470-4552-40dc-9aa0-b02998866318 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:59.613535 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6259470-4552-40dc-9aa0-b02998866318 admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:59.614392 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6259470-4552-40dc-9aa0-b02998866318 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:59.616628 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6259470-4552-40dc-9aa0-b02998866318 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:59.628773 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:59.647443 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1369/2729] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:37:59 2022] POST /identity/v3/users => generated 296 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:37:59.652502 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa433591-032b-4ac0-9bf4-8c9c90430153 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:59.668826 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa433591-032b-4ac0-9bf4-8c9c90430153 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:59.679020 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df039a78-60fe-46cb-8626-f10383b1d6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:59.679654 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df039a78-60fe-46cb-8626-f10383b1d6bf admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:59.679966 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df039a78-60fe-46cb-8626-f10383b1d6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:59.680240 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df039a78-60fe-46cb-8626-f10383b1d6bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:59.680897 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df039a78-60fe-46cb-8626-f10383b1d6bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:59.683301 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df039a78-60fe-46cb-8626-f10383b1d6bf admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:59.695146 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1361/2730] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:37:59.699683 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6259470-4552-40dc-9aa0-b02998866318 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:59.714642 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6259470-4552-40dc-9aa0-b02998866318 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:59.722470 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c42281-f7b6-42d2-bc73-2f3fe7809b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:59.724482 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c42281-f7b6-42d2-bc73-2f3fe7809b90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:59.725090 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c42281-f7b6-42d2-bc73-2f3fe7809b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:59.725664 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c42281-f7b6-42d2-bc73-2f3fe7809b90 admin admin] PATH_INFO: `/v3/projects/3050b27fe5a74c798e6afe41b3748cbf/users/c4018a08abe54c1195a69bdd95e90c3f/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:59.755338 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c42281-f7b6-42d2-bc73-2f3fe7809b90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3050b27fe5a74c798e6afe41b3748cbf, user_id=c4018a08abe54c1195a69bdd95e90c3f, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:59.758077 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c42281-f7b6-42d2-bc73-2f3fe7809b90 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:59.774094 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1370/2731] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:37:59 2022] PUT /identity/v3/projects/3050b27fe5a74c798e6afe41b3748cbf/users/c4018a08abe54c1195a69bdd95e90c3f/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:37:59.780150 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df039a78-60fe-46cb-8626-f10383b1d6bf admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:59.792724 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df039a78-60fe-46cb-8626-f10383b1d6bf admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:59.850370 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:59.902145 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e746e57e-c0b3-4366-b502-b7198444ee4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:59.903859 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746e57e-c0b3-4366-b502-b7198444ee4e admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:59.904356 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746e57e-c0b3-4366-b502-b7198444ee4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:59.904678 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746e57e-c0b3-4366-b502-b7198444ee4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:59.905585 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e746e57e-c0b3-4366-b502-b7198444ee4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:59.907513 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e746e57e-c0b3-4366-b502-b7198444ee4e admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:59.925400 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1362/2732] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:37:59.929760 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c42281-f7b6-42d2-bc73-2f3fe7809b90 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:59.945896 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c42281-f7b6-42d2-bc73-2f3fe7809b90 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:59.952456 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5f53b-e949-4be1-a0ae-d69da9ae66eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:59.953530 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5f53b-e949-4be1-a0ae-d69da9ae66eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:59.954003 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5f53b-e949-4be1-a0ae-d69da9ae66eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:59.954531 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5f53b-e949-4be1-a0ae-d69da9ae66eb admin admin] PATH_INFO: `/v3/projects/3050b27fe5a74c798e6afe41b3748cbf/users/c4018a08abe54c1195a69bdd95e90c3f/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:59.958302 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef5f53b-e949-4be1-a0ae-d69da9ae66eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3050b27fe5a74c798e6afe41b3748cbf, user_id=c4018a08abe54c1195a69bdd95e90c3f, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:59.961622 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef5f53b-e949-4be1-a0ae-d69da9ae66eb admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:59.992427 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1371/2733] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:37:59 2022] PUT /identity/v3/projects/3050b27fe5a74c798e6afe41b3748cbf/users/c4018a08abe54c1195a69bdd95e90c3f/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:37:59.995285 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677734f-af90-4d13-90ae-74a3124614ee None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:59.995571 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677734f-af90-4d13-90ae-74a3124614ee None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:59.995844 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677734f-af90-4d13-90ae-74a3124614ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:00.058384 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-0677734f-af90-4d13-90ae-74a3124614ee None None] MFA Rules not processed for user `c4018a08abe54c1195a69bdd95e90c3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:38:00.058384 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-0677734f-af90-4d13-90ae-74a3124614ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:00.193642 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1363/2734] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:37:59 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:38:00.209024 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5f53b-e949-4be1-a0ae-d69da9ae66eb admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:00.289659 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5f53b-e949-4be1-a0ae-d69da9ae66eb admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:00.293661 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a49487b-02ab-4e58-b69d-c1084524a4c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:00.294303 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49487b-02ab-4e58-b69d-c1084524a4c1 service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:00.294580 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49487b-02ab-4e58-b69d-c1084524a4c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:00.294841 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49487b-02ab-4e58-b69d-c1084524a4c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:00.372090 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a49487b-02ab-4e58-b69d-c1084524a4c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:00.373809 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a49487b-02ab-4e58-b69d-c1084524a4c1 service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:00.385834 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1372/2735] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:38:00 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:38:01.950259 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0677734f-af90-4d13-90ae-74a3124614ee None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:01.966870 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0677734f-af90-4d13-90ae-74a3124614ee None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:01.972617 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152cc36b-3614-40d0-af7b-590445d9f48d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:01.974435 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152cc36b-3614-40d0-af7b-590445d9f48d service cinder] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:01.974839 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152cc36b-3614-40d0-af7b-590445d9f48d service cinder] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:01.975241 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152cc36b-3614-40d0-af7b-590445d9f48d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:02.001506 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152cc36b-3614-40d0-af7b-590445d9f48d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:02.005028 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152cc36b-3614-40d0-af7b-590445d9f48d service cinder] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:02.023760 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1364/2736] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:38:01 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:38:03.548407 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a49487b-02ab-4e58-b69d-c1084524a4c1 service cinder] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:03.675564 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a49487b-02ab-4e58-b69d-c1084524a4c1 service cinder] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:03.684245 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2166cab-eec1-4e22-ae21-58b7ffded5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:03.685375 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2166cab-eec1-4e22-ae21-58b7ffded5cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:03.685856 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2166cab-eec1-4e22-ae21-58b7ffded5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:03.686330 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2166cab-eec1-4e22-ae21-58b7ffded5cf admin admin] PATH_INFO: `/v3/users/9af8f1e723704570a539d54969980b18` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:03.688817 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2166cab-eec1-4e22-ae21-58b7ffded5cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=9af8f1e723704570a539d54969980b18)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:03.693273 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2166cab-eec1-4e22-ae21-58b7ffded5cf admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:03.722305 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:INSERT=3,keystone:SELECT=96,keystone:DELETE=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:03.791696 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-b2166cab-eec1-4e22-ae21-58b7ffded5cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9af8f1e723704570a539d54969980b18'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:03.808064 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-b2166cab-eec1-4e22-ae21-58b7ffded5cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9af8f1e723704570a539d54969980b18'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:03.818584 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-b2166cab-eec1-4e22-ae21-58b7ffded5cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9af8f1e723704570a539d54969980b18'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:03.819296 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-b2166cab-eec1-4e22-ae21-58b7ffded5cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9af8f1e723704570a539d54969980b18'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:03.838015 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-b2166cab-eec1-4e22-ae21-58b7ffded5cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9af8f1e723704570a539d54969980b18'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:03.849996 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1373/2737] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:38:03 2022] DELETE /identity/v3/users/9af8f1e723704570a539d54969980b18 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:38:03.851646 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16e882-a10c-4226-b0c5-3b6414c1a657 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:03.852381 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16e882-a10c-4226-b0c5-3b6414c1a657 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:03.852381 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16e882-a10c-4226-b0c5-3b6414c1a657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:03.880133 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-7e16e882-a10c-4226-b0c5-3b6414c1a657 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:38:03.882689 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-7e16e882-a10c-4226-b0c5-3b6414c1a657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:03.964456 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1365/2738] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:38:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:38:03.975877 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2166cab-eec1-4e22-ae21-58b7ffded5cf admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:03.977875 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-b2166cab-eec1-4e22-ae21-58b7ffded5cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:04.053083 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2166cab-eec1-4e22-ae21-58b7ffded5cf admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:04.057068 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71db726-6dcb-40e7-a9f1-9b2c697118e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:04.057755 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71db726-6dcb-40e7-a9f1-9b2c697118e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:04.058288 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71db726-6dcb-40e7-a9f1-9b2c697118e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:04.058711 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71db726-6dcb-40e7-a9f1-9b2c697118e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:04.072088 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71db726-6dcb-40e7-a9f1-9b2c697118e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:04.073607 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71db726-6dcb-40e7-a9f1-9b2c697118e1 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:04.086821 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1374/2739] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:38:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:38:04.452515 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e16e882-a10c-4226-b0c5-3b6414c1a657 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:04.454432 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-7e16e882-a10c-4226-b0c5-3b6414c1a657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:04.470475 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e16e882-a10c-4226-b0c5-3b6414c1a657 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:04.477111 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5baf3b-7bfd-4670-a09d-e65acf39b8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:04.477918 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5baf3b-7bfd-4670-a09d-e65acf39b8e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:04.478313 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5baf3b-7bfd-4670-a09d-e65acf39b8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:04.478675 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5baf3b-7bfd-4670-a09d-e65acf39b8e6 admin admin] PATH_INFO: `/v3/projects/53194453412045da973b8170fa64b593` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:04.480198 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5baf3b-7bfd-4670-a09d-e65acf39b8e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53194453412045da973b8170fa64b593)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:04.483602 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5baf3b-7bfd-4670-a09d-e65acf39b8e6 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:04.532703 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:04.545979 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-8a5baf3b-7bfd-4670-a09d-e65acf39b8e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53194453412045da973b8170fa64b593', 'request_id': 'req-8a5baf3b-7bfd-4670-a09d-e65acf39b8e6'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:04.554774 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-8a5baf3b-7bfd-4670-a09d-e65acf39b8e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53194453412045da973b8170fa64b593', 'request_id': 'req-8a5baf3b-7bfd-4670-a09d-e65acf39b8e6'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:04.565111 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-8a5baf3b-7bfd-4670-a09d-e65acf39b8e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53194453412045da973b8170fa64b593', 'request_id': 'req-8a5baf3b-7bfd-4670-a09d-e65acf39b8e6'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:04.581183 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-8a5baf3b-7bfd-4670-a09d-e65acf39b8e6 admin admin] The token cache is being invalidate because project 53194453412045da973b8170fa64b593 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:38:04.581559 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-8a5baf3b-7bfd-4670-a09d-e65acf39b8e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:04.582797 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-8a5baf3b-7bfd-4670-a09d-e65acf39b8e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:04.585056 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1366/2740] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:38:04 2022] DELETE /identity/v3/projects/53194453412045da973b8170fa64b593 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:38:04.590593 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71db726-6dcb-40e7-a9f1-9b2c697118e1 service neutron] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:04.608529 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71db726-6dcb-40e7-a9f1-9b2c697118e1 service neutron] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:04.714038 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcfe356-afdc-405e-9005-d9ea2a8bc056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:04.715146 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcfe356-afdc-405e-9005-d9ea2a8bc056 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:04.715607 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcfe356-afdc-405e-9005-d9ea2a8bc056 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:04.716006 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcfe356-afdc-405e-9005-d9ea2a8bc056 admin admin] PATH_INFO: `/v3/users/5a54e2d895bc4e64a6f9d6ed786c9354` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:04.717445 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcfe356-afdc-405e-9005-d9ea2a8bc056 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a54e2d895bc4e64a6f9d6ed786c9354)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:04.719777 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcfe356-afdc-405e-9005-d9ea2a8bc056 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:04.771826 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:04.789237 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-9dcfe356-afdc-405e-9005-d9ea2a8bc056 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a54e2d895bc4e64a6f9d6ed786c9354'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:04.805571 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-9dcfe356-afdc-405e-9005-d9ea2a8bc056 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a54e2d895bc4e64a6f9d6ed786c9354'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:04.817554 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-9dcfe356-afdc-405e-9005-d9ea2a8bc056 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a54e2d895bc4e64a6f9d6ed786c9354'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:04.818756 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-9dcfe356-afdc-405e-9005-d9ea2a8bc056 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a54e2d895bc4e64a6f9d6ed786c9354'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:04.837526 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-9dcfe356-afdc-405e-9005-d9ea2a8bc056 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a54e2d895bc4e64a6f9d6ed786c9354'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:04.849355 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1375/2741] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:38:04 2022] DELETE /identity/v3/users/5a54e2d895bc4e64a6f9d6ed786c9354 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:38:05.285059 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5baf3b-7bfd-4670-a09d-e65acf39b8e6 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:05.288437 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-8a5baf3b-7bfd-4670-a09d-e65acf39b8e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:05.312650 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5baf3b-7bfd-4670-a09d-e65acf39b8e6 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:05.403767 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ec3ba8-9e91-4b9f-a9ab-8633105e6fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:05.404472 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec3ba8-9e91-4b9f-a9ab-8633105e6fad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:05.404828 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec3ba8-9e91-4b9f-a9ab-8633105e6fad admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:05.405106 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec3ba8-9e91-4b9f-a9ab-8633105e6fad admin admin] PATH_INFO: `/v3/projects/015808ae76c44009b16f84f02c9b8f42` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:05.406651 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ec3ba8-9e91-4b9f-a9ab-8633105e6fad admin admin] RBAC: Authorizing `identity:delete_project(project_id=015808ae76c44009b16f84f02c9b8f42)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:05.408527 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ec3ba8-9e91-4b9f-a9ab-8633105e6fad admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:05.481259 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-38ec3ba8-9e91-4b9f-a9ab-8633105e6fad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '015808ae76c44009b16f84f02c9b8f42', 'request_id': 'req-38ec3ba8-9e91-4b9f-a9ab-8633105e6fad'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:05.492491 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-38ec3ba8-9e91-4b9f-a9ab-8633105e6fad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '015808ae76c44009b16f84f02c9b8f42', 'request_id': 'req-38ec3ba8-9e91-4b9f-a9ab-8633105e6fad'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:05.504625 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-38ec3ba8-9e91-4b9f-a9ab-8633105e6fad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '015808ae76c44009b16f84f02c9b8f42', 'request_id': 'req-38ec3ba8-9e91-4b9f-a9ab-8633105e6fad'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:05.522876 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-38ec3ba8-9e91-4b9f-a9ab-8633105e6fad admin admin] The token cache is being invalidate because project 015808ae76c44009b16f84f02c9b8f42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:38:05.523301 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-38ec3ba8-9e91-4b9f-a9ab-8633105e6fad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:05.524240 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-38ec3ba8-9e91-4b9f-a9ab-8633105e6fad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:05.526799 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1367/2742] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:38:05 2022] DELETE /identity/v3/projects/015808ae76c44009b16f84f02c9b8f42 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:38:05.536312 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c679b43-7cab-4172-b64b-4b0aa807fa8c None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:05.536827 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c679b43-7cab-4172-b64b-4b0aa807fa8c None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:05.537669 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c679b43-7cab-4172-b64b-4b0aa807fa8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:05.578937 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-6c679b43-7cab-4172-b64b-4b0aa807fa8c None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:38:05.581139 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-6c679b43-7cab-4172-b64b-4b0aa807fa8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:05.673642 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1376/2743] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:38:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:38:05.684458 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b9943-d5f0-4922-9949-dc8991bd24fa None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:05.684656 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b9943-d5f0-4922-9949-dc8991bd24fa None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:05.684897 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b9943-d5f0-4922-9949-dc8991bd24fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:05.708961 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-482b9943-d5f0-4922-9949-dc8991bd24fa None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:38:05.710380 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-482b9943-d5f0-4922-9949-dc8991bd24fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:05.720275 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1368/2744] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:38:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:38:05.726075 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c679b43-7cab-4172-b64b-4b0aa807fa8c None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:05.741793 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c679b43-7cab-4172-b64b-4b0aa807fa8c None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:05.747902 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56cdf8c-538d-43ee-8808-eba9e15cf5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:05.748948 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56cdf8c-538d-43ee-8808-eba9e15cf5ac admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:05.749453 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56cdf8c-538d-43ee-8808-eba9e15cf5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:05.749922 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56cdf8c-538d-43ee-8808-eba9e15cf5ac admin admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:05.750793 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56cdf8c-538d-43ee-8808-eba9e15cf5ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:38:05.751244 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56cdf8c-538d-43ee-8808-eba9e15cf5ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:05.753857 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56cdf8c-538d-43ee-8808-eba9e15cf5ac admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:05.768896 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1377/2745] 10.222.0.91 () {58 vars in 1153 bytes} [Tue Aug 30 04:38:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:38:05.774527 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482b9943-d5f0-4922-9949-dc8991bd24fa None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:05.793910 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482b9943-d5f0-4922-9949-dc8991bd24fa None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:05.802004 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8e1626-24ad-46f0-8758-a11ca70f7595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:05.803033 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e1626-24ad-46f0-8758-a11ca70f7595 admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:05.803493 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e1626-24ad-46f0-8758-a11ca70f7595 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:05.803992 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e1626-24ad-46f0-8758-a11ca70f7595 admin admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:05.804842 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8e1626-24ad-46f0-8758-a11ca70f7595 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:05.807993 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8e1626-24ad-46f0-8758-a11ca70f7595 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:05.845897 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1369/2746] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:38:05 2022] POST /identity/v3/projects => generated 387 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:38:05.850772 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56cdf8c-538d-43ee-8808-eba9e15cf5ac admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:05.862527 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56cdf8c-538d-43ee-8808-eba9e15cf5ac admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:05.937431 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85820d69-9ee6-4370-9d50-39548188aecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:05.938056 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85820d69-9ee6-4370-9d50-39548188aecb admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:05.938348 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85820d69-9ee6-4370-9d50-39548188aecb admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:05.938617 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85820d69-9ee6-4370-9d50-39548188aecb admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:05.939284 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85820d69-9ee6-4370-9d50-39548188aecb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:05.941427 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85820d69-9ee6-4370-9d50-39548188aecb admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:05.967246 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1378/2747] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:38:05 2022] POST /identity/v3/users => generated 294 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:38:05.972838 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8e1626-24ad-46f0-8758-a11ca70f7595 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:05.996139 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8e1626-24ad-46f0-8758-a11ca70f7595 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:06.002293 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c28220-c3f0-4e35-9b5e-a95ad58bb3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:06.003124 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c28220-c3f0-4e35-9b5e-a95ad58bb3df admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:06.003475 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c28220-c3f0-4e35-9b5e-a95ad58bb3df admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:06.004190 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c28220-c3f0-4e35-9b5e-a95ad58bb3df admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:06.005165 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c28220-c3f0-4e35-9b5e-a95ad58bb3df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:06.006937 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c28220-c3f0-4e35-9b5e-a95ad58bb3df admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:06.020018 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1370/2748] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:38:06.025807 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85820d69-9ee6-4370-9d50-39548188aecb admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:06.037611 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85820d69-9ee6-4370-9d50-39548188aecb admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:06.042639 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b583e-33bf-40a6-9cbc-2a1f76136abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:06.043267 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b583e-33bf-40a6-9cbc-2a1f76136abb admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:06.043556 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b583e-33bf-40a6-9cbc-2a1f76136abb admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:06.043828 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b583e-33bf-40a6-9cbc-2a1f76136abb admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:06.044549 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470b583e-33bf-40a6-9cbc-2a1f76136abb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:06.046382 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470b583e-33bf-40a6-9cbc-2a1f76136abb admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:06.060130 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1379/2749] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:38:06.065640 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c28220-c3f0-4e35-9b5e-a95ad58bb3df admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:06.084238 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c28220-c3f0-4e35-9b5e-a95ad58bb3df admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:06.092286 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7514748-4652-4bda-ace2-5491f47f6f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:06.093411 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7514748-4652-4bda-ace2-5491f47f6f96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:06.093936 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7514748-4652-4bda-ace2-5491f47f6f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:06.094420 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7514748-4652-4bda-ace2-5491f47f6f96 admin admin] PATH_INFO: `/v3/projects/df7b0ee76cb04660bd95d7ffbb3a7148/users/27ea5d79b96548b9a1b079a54d4af4e5/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:06.117790 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:06.123608 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7514748-4652-4bda-ace2-5491f47f6f96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df7b0ee76cb04660bd95d7ffbb3a7148, user_id=27ea5d79b96548b9a1b079a54d4af4e5, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:06.130631 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7514748-4652-4bda-ace2-5491f47f6f96 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:06.155544 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1371/2750] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:38:06 2022] PUT /identity/v3/projects/df7b0ee76cb04660bd95d7ffbb3a7148/users/27ea5d79b96548b9a1b079a54d4af4e5/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:38:06.167254 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba706a-ce42-4614-a5fd-4044d0404d0e None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:06.167572 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba706a-ce42-4614-a5fd-4044d0404d0e None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:06.167895 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba706a-ce42-4614-a5fd-4044d0404d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:06.290089 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7514748-4652-4bda-ace2-5491f47f6f96 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:06.292704 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-c7514748-4652-4bda-ace2-5491f47f6f96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:06.347264 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-d7ba706a-ce42-4614-a5fd-4044d0404d0e None None] MFA Rules not processed for user `27ea5d79b96548b9a1b079a54d4af4e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:38:06.348884 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-d7ba706a-ce42-4614-a5fd-4044d0404d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:06.356711 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:06.389369 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7514748-4652-4bda-ace2-5491f47f6f96 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:06.395580 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6018826-196d-4b77-b60f-cf168a8ced17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:06.396506 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6018826-196d-4b77-b60f-cf168a8ced17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:06.396889 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6018826-196d-4b77-b60f-cf168a8ced17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:06.397249 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6018826-196d-4b77-b60f-cf168a8ced17 admin admin] PATH_INFO: `/v3/users/e920cb6e202a48f1b4167f384c5456e2` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:06.398748 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6018826-196d-4b77-b60f-cf168a8ced17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e920cb6e202a48f1b4167f384c5456e2)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:06.401209 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6018826-196d-4b77-b60f-cf168a8ced17 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:06.463082 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1380/2751] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:38:06 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:38:06.468535 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ba706a-ce42-4614-a5fd-4044d0404d0e None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:06.473990 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-e6018826-196d-4b77-b60f-cf168a8ced17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e920cb6e202a48f1b4167f384c5456e2'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:06.474901 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-e6018826-196d-4b77-b60f-cf168a8ced17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e920cb6e202a48f1b4167f384c5456e2'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:06.475753 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-e6018826-196d-4b77-b60f-cf168a8ced17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e920cb6e202a48f1b4167f384c5456e2'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:06.485214 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ba706a-ce42-4614-a5fd-4044d0404d0e None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:06.488017 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-e6018826-196d-4b77-b60f-cf168a8ced17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e920cb6e202a48f1b4167f384c5456e2'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:06.493937 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbdc8fa-e1de-4490-919d-e71a21c03a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:06.494727 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbdc8fa-e1de-4490-919d-e71a21c03a71 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:06.495199 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbdc8fa-e1de-4490-919d-e71a21c03a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:06.495617 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbdc8fa-e1de-4490-919d-e71a21c03a71 admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:06.496500 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbdc8fa-e1de-4490-919d-e71a21c03a71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:06.499242 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbdc8fa-e1de-4490-919d-e71a21c03a71 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:06.507346 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-e6018826-196d-4b77-b60f-cf168a8ced17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e920cb6e202a48f1b4167f384c5456e2'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:06.526033 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1372/2752] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:38:06 2022] DELETE /identity/v3/users/e920cb6e202a48f1b4167f384c5456e2 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:38:06.532683 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936e6cc-2915-4de3-a7a4-ea2506a76b78 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:06.533131 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936e6cc-2915-4de3-a7a4-ea2506a76b78 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:06.533572 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936e6cc-2915-4de3-a7a4-ea2506a76b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:06.543507 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1381/2753] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:38:06 2022] POST /identity/v3/projects => generated 387 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:38:06.548386 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbdc8fa-e1de-4490-919d-e71a21c03a71 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:06.550371 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-bdbdc8fa-e1de-4490-919d-e71a21c03a71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:06.561516 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-d936e6cc-2915-4de3-a7a4-ea2506a76b78 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:38:06.562882 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-d936e6cc-2915-4de3-a7a4-ea2506a76b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:06.651700 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbdc8fa-e1de-4490-919d-e71a21c03a71 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:06.654826 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1373/2754] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:38:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:38:06.659878 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0cc02a-682a-4ad4-9fa2-575e524f8fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:06.661351 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0cc02a-682a-4ad4-9fa2-575e524f8fd7 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:06.661786 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0cc02a-682a-4ad4-9fa2-575e524f8fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:06.662470 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0cc02a-682a-4ad4-9fa2-575e524f8fd7 admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:06.663408 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0cc02a-682a-4ad4-9fa2-575e524f8fd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:06.665899 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0cc02a-682a-4ad4-9fa2-575e524f8fd7 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:06.668010 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d936e6cc-2915-4de3-a7a4-ea2506a76b78 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:06.669708 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-d936e6cc-2915-4de3-a7a4-ea2506a76b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:06.688555 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:06.696168 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1382/2755] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:38:06 2022] POST /identity/v3/users => generated 300 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:38:06.702091 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0cc02a-682a-4ad4-9fa2-575e524f8fd7 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:06.715730 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0cc02a-682a-4ad4-9fa2-575e524f8fd7 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:06.721885 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2460062-57e4-4c83-8706-64e98d57d948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:06.722699 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2460062-57e4-4c83-8706-64e98d57d948 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:06.723077 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2460062-57e4-4c83-8706-64e98d57d948 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:06.723434 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2460062-57e4-4c83-8706-64e98d57d948 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:06.724389 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2460062-57e4-4c83-8706-64e98d57d948 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:06.726872 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2460062-57e4-4c83-8706-64e98d57d948 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:06.755139 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1383/2756] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:38:06.757136 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2460062-57e4-4c83-8706-64e98d57d948 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:06.760874 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d936e6cc-2915-4de3-a7a4-ea2506a76b78 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:06.766767 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259b72b-69f7-4509-b79a-a9ef9564ba3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:06.767542 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259b72b-69f7-4509-b79a-a9ef9564ba3f service neutron] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:06.767984 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259b72b-69f7-4509-b79a-a9ef9564ba3f service neutron] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:06.768441 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259b72b-69f7-4509-b79a-a9ef9564ba3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:06.776723 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2460062-57e4-4c83-8706-64e98d57d948 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:06.786830 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d04182-fef9-426e-8e2e-561454519d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:06.788967 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d04182-fef9-426e-8e2e-561454519d79 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:06.789462 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d04182-fef9-426e-8e2e-561454519d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:06.789578 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6259b72b-69f7-4509-b79a-a9ef9564ba3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:06.790038 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d04182-fef9-426e-8e2e-561454519d79 admin admin] PATH_INFO: `/v3/projects/cfe468086bdf4fc3b1bf95498b8329d5/users/d8ab8a5633b24a49948dce10ea68e8e0/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:06.793617 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6259b72b-69f7-4509-b79a-a9ef9564ba3f service neutron] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:06.814115 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1374/2757] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:38:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:38:06.822349 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d04182-fef9-426e-8e2e-561454519d79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfe468086bdf4fc3b1bf95498b8329d5, user_id=d8ab8a5633b24a49948dce10ea68e8e0, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:06.827888 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d04182-fef9-426e-8e2e-561454519d79 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:06.856893 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1384/2758] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:38:06 2022] PUT /identity/v3/projects/cfe468086bdf4fc3b1bf95498b8329d5/users/d8ab8a5633b24a49948dce10ea68e8e0/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:38:06.861692 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259b72b-69f7-4509-b79a-a9ef9564ba3f service neutron] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:06.882981 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259b72b-69f7-4509-b79a-a9ef9564ba3f service neutron] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:06.990378 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54dbc95-8860-4a18-9f2f-397b3f3d713f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:06.990979 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54dbc95-8860-4a18-9f2f-397b3f3d713f admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:06.991245 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54dbc95-8860-4a18-9f2f-397b3f3d713f admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:06.991514 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54dbc95-8860-4a18-9f2f-397b3f3d713f admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:06.992364 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54dbc95-8860-4a18-9f2f-397b3f3d713f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:06.994396 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54dbc95-8860-4a18-9f2f-397b3f3d713f admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:07.007977 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1375/2759] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:38:07.012464 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d04182-fef9-426e-8e2e-561454519d79 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:07.026069 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d04182-fef9-426e-8e2e-561454519d79 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:07.031876 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e655a4b-5fbf-40d2-9bc5-07c941b50f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:07.032640 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e655a4b-5fbf-40d2-9bc5-07c941b50f33 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:07.032914 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e655a4b-5fbf-40d2-9bc5-07c941b50f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:07.033179 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e655a4b-5fbf-40d2-9bc5-07c941b50f33 admin admin] PATH_INFO: `/v3/projects/cfe468086bdf4fc3b1bf95498b8329d5/users/d8ab8a5633b24a49948dce10ea68e8e0/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:07.035769 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e655a4b-5fbf-40d2-9bc5-07c941b50f33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfe468086bdf4fc3b1bf95498b8329d5, user_id=d8ab8a5633b24a49948dce10ea68e8e0, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:07.038839 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e655a4b-5fbf-40d2-9bc5-07c941b50f33 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:07.051621 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1385/2760] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:38:07 2022] PUT /identity/v3/projects/cfe468086bdf4fc3b1bf95498b8329d5/users/d8ab8a5633b24a49948dce10ea68e8e0/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:38:07.063739 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34cb3e-3e7c-48d9-b8c8-f518cfc6a3bf None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:07.064091 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34cb3e-3e7c-48d9-b8c8-f518cfc6a3bf None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:07.064328 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34cb3e-3e7c-48d9-b8c8-f518cfc6a3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:07.098979 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-2a34cb3e-3e7c-48d9-b8c8-f518cfc6a3bf None None] MFA Rules not processed for user `d8ab8a5633b24a49948dce10ea68e8e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:38:07.100321 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-2a34cb3e-3e7c-48d9-b8c8-f518cfc6a3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:07.190491 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1376/2761] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:38:07 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:38:07.203253 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e655a4b-5fbf-40d2-9bc5-07c941b50f33 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:07.205404 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-0e655a4b-5fbf-40d2-9bc5-07c941b50f33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:07.269086 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:07.321616 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e655a4b-5fbf-40d2-9bc5-07c941b50f33 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:07.328243 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47399cf0-80da-46a1-a5cd-6d77fe49b107 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:07.329515 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47399cf0-80da-46a1-a5cd-6d77fe49b107 service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:07.330005 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47399cf0-80da-46a1-a5cd-6d77fe49b107 service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:07.330416 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47399cf0-80da-46a1-a5cd-6d77fe49b107 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:07.350473 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47399cf0-80da-46a1-a5cd-6d77fe49b107 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:07.353464 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47399cf0-80da-46a1-a5cd-6d77fe49b107 service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:07.376245 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1386/2762] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:38:07 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:38:07.474581 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a34cb3e-3e7c-48d9-b8c8-f518cfc6a3bf None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:07.477037 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-2a34cb3e-3e7c-48d9-b8c8-f518cfc6a3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:07.557260 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=100 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:07.591222 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a34cb3e-3e7c-48d9-b8c8-f518cfc6a3bf None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:07.596532 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c448e7-c074-410d-a34a-e17f8d33ad87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:07.597362 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c448e7-c074-410d-a34a-e17f8d33ad87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:07.597768 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c448e7-c074-410d-a34a-e17f8d33ad87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:07.598172 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c448e7-c074-410d-a34a-e17f8d33ad87 admin admin] PATH_INFO: `/v3/projects/ae901bf0464742b1b9d012aaef1551a1` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:07.599607 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c448e7-c074-410d-a34a-e17f8d33ad87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae901bf0464742b1b9d012aaef1551a1)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:07.601903 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c448e7-c074-410d-a34a-e17f8d33ad87 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:07.630093 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47399cf0-80da-46a1-a5cd-6d77fe49b107 service cinder] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:07.659187 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47399cf0-80da-46a1-a5cd-6d77fe49b107 service cinder] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:07.666385 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fa2994-9922-4f2d-8721-6a7505153479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:07.667347 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa2994-9922-4f2d-8721-6a7505153479 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:07.667789 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa2994-9922-4f2d-8721-6a7505153479 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:07.668308 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa2994-9922-4f2d-8721-6a7505153479 admin admin] PATH_INFO: `/v3/users/27ea5d79b96548b9a1b079a54d4af4e5` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:07.670125 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fa2994-9922-4f2d-8721-6a7505153479 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27ea5d79b96548b9a1b079a54d4af4e5)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:07.672789 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fa2994-9922-4f2d-8721-6a7505153479 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:07.684124 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-30c448e7-c074-410d-a34a-e17f8d33ad87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae901bf0464742b1b9d012aaef1551a1', 'request_id': 'req-30c448e7-c074-410d-a34a-e17f8d33ad87'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:07.693785 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-30c448e7-c074-410d-a34a-e17f8d33ad87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae901bf0464742b1b9d012aaef1551a1', 'request_id': 'req-30c448e7-c074-410d-a34a-e17f8d33ad87'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:07.706462 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-30c448e7-c074-410d-a34a-e17f8d33ad87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae901bf0464742b1b9d012aaef1551a1', 'request_id': 'req-30c448e7-c074-410d-a34a-e17f8d33ad87'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:07.723341 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-30c448e7-c074-410d-a34a-e17f8d33ad87 admin admin] The token cache is being invalidate because project ae901bf0464742b1b9d012aaef1551a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:38:07.724189 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-30c448e7-c074-410d-a34a-e17f8d33ad87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:07.724814 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-30c448e7-c074-410d-a34a-e17f8d33ad87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:07.726707 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1377/2763] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:38:07 2022] DELETE /identity/v3/projects/ae901bf0464742b1b9d012aaef1551a1 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:38:07.732293 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c448e7-c074-410d-a34a-e17f8d33ad87 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:07.733524 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-30c448e7-c074-410d-a34a-e17f8d33ad87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:07.756160 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-b4fa2994-9922-4f2d-8721-6a7505153479 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27ea5d79b96548b9a1b079a54d4af4e5'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:07.773843 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-b4fa2994-9922-4f2d-8721-6a7505153479 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27ea5d79b96548b9a1b079a54d4af4e5'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:07.794823 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-b4fa2994-9922-4f2d-8721-6a7505153479 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27ea5d79b96548b9a1b079a54d4af4e5'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:07.795676 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-b4fa2994-9922-4f2d-8721-6a7505153479 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27ea5d79b96548b9a1b079a54d4af4e5'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:07.824401 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-b4fa2994-9922-4f2d-8721-6a7505153479 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27ea5d79b96548b9a1b079a54d4af4e5'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:07.835940 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1387/2764] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:38:07 2022] DELETE /identity/v3/users/27ea5d79b96548b9a1b079a54d4af4e5 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:38:07.844084 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb32b5f-88a9-4de0-8f85-ff09c14eed1e None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:07.844628 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb32b5f-88a9-4de0-8f85-ff09c14eed1e None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:07.845772 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb32b5f-88a9-4de0-8f85-ff09c14eed1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:07.853932 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c448e7-c074-410d-a34a-e17f8d33ad87 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:07.881246 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-cbb32b5f-88a9-4de0-8f85-ff09c14eed1e None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:38:07.883008 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-cbb32b5f-88a9-4de0-8f85-ff09c14eed1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:07.971368 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605689c0-ae00-46b9-911b-cf5292d54b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:07.972680 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605689c0-ae00-46b9-911b-cf5292d54b9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:07.973197 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605689c0-ae00-46b9-911b-cf5292d54b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:07.973656 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605689c0-ae00-46b9-911b-cf5292d54b9a admin admin] PATH_INFO: `/v3/users/c4018a08abe54c1195a69bdd95e90c3f` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:07.976206 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605689c0-ae00-46b9-911b-cf5292d54b9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4018a08abe54c1195a69bdd95e90c3f)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:07.980252 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605689c0-ae00-46b9-911b-cf5292d54b9a admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:07.994990 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1388/2765] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:38:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:38:08.006730 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb32b5f-88a9-4de0-8f85-ff09c14eed1e None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:08.008307 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-cbb32b5f-88a9-4de0-8f85-ff09c14eed1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:08.009735 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:08.073228 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-605689c0-ae00-46b9-911b-cf5292d54b9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4018a08abe54c1195a69bdd95e90c3f'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:08.075030 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-605689c0-ae00-46b9-911b-cf5292d54b9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4018a08abe54c1195a69bdd95e90c3f'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:08.075801 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-605689c0-ae00-46b9-911b-cf5292d54b9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4018a08abe54c1195a69bdd95e90c3f'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:08.077632 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:08.088049 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-605689c0-ae00-46b9-911b-cf5292d54b9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4018a08abe54c1195a69bdd95e90c3f'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:08.101574 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb32b5f-88a9-4de0-8f85-ff09c14eed1e None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:08.104562 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-605689c0-ae00-46b9-911b-cf5292d54b9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4018a08abe54c1195a69bdd95e90c3f'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:08.109249 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d21e8-89b4-4da0-a6a6-51996f225991 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:08.110136 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d21e8-89b4-4da0-a6a6-51996f225991 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:08.110618 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d21e8-89b4-4da0-a6a6-51996f225991 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:08.111065 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d21e8-89b4-4da0-a6a6-51996f225991 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:08.115024 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-256d21e8-89b4-4da0-a6a6-51996f225991 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:08.126523 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1378/2766] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:38:07 2022] DELETE /identity/v3/users/c4018a08abe54c1195a69bdd95e90c3f => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:38:08.131797 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256d21e8-89b4-4da0-a6a6-51996f225991 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:08.133415 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256d21e8-89b4-4da0-a6a6-51996f225991 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:08.147061 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1389/2767] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:38:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:38:08.653422 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605689c0-ae00-46b9-911b-cf5292d54b9a admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:08.655141 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-605689c0-ae00-46b9-911b-cf5292d54b9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:08.661903 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d21e8-89b4-4da0-a6a6-51996f225991 service neutron] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:08.664430 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-256d21e8-89b4-4da0-a6a6-51996f225991 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:08.696690 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d21e8-89b4-4da0-a6a6-51996f225991 service neutron] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:08.769074 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605689c0-ae00-46b9-911b-cf5292d54b9a admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:08.775954 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61321c43-4448-4742-affe-b816cf5e35f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:08.776849 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61321c43-4448-4742-affe-b816cf5e35f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:08.777332 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61321c43-4448-4742-affe-b816cf5e35f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:08.777757 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61321c43-4448-4742-affe-b816cf5e35f6 admin admin] PATH_INFO: `/v3/projects/df7b0ee76cb04660bd95d7ffbb3a7148` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:08.778234 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc8868-26ec-4ada-aaa7-818f7e8bf13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:08.778987 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc8868-26ec-4ada-aaa7-818f7e8bf13a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:08.779202 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61321c43-4448-4742-affe-b816cf5e35f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df7b0ee76cb04660bd95d7ffbb3a7148)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:08.779372 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc8868-26ec-4ada-aaa7-818f7e8bf13a admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:08.779372 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc8868-26ec-4ada-aaa7-818f7e8bf13a admin admin] PATH_INFO: `/v3/projects/3050b27fe5a74c798e6afe41b3748cbf` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:08.780545 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfc8868-26ec-4ada-aaa7-818f7e8bf13a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3050b27fe5a74c798e6afe41b3748cbf)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:08.781320 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61321c43-4448-4742-affe-b816cf5e35f6 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:08.782450 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfc8868-26ec-4ada-aaa7-818f7e8bf13a admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:08.852245 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-4cfc8868-26ec-4ada-aaa7-818f7e8bf13a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3050b27fe5a74c798e6afe41b3748cbf', 'request_id': 'req-4cfc8868-26ec-4ada-aaa7-818f7e8bf13a'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:08.859392 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-4cfc8868-26ec-4ada-aaa7-818f7e8bf13a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3050b27fe5a74c798e6afe41b3748cbf', 'request_id': 'req-4cfc8868-26ec-4ada-aaa7-818f7e8bf13a'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:08.862326 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-61321c43-4448-4742-affe-b816cf5e35f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df7b0ee76cb04660bd95d7ffbb3a7148', 'request_id': 'req-61321c43-4448-4742-affe-b816cf5e35f6'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:08.870105 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-4cfc8868-26ec-4ada-aaa7-818f7e8bf13a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3050b27fe5a74c798e6afe41b3748cbf', 'request_id': 'req-4cfc8868-26ec-4ada-aaa7-818f7e8bf13a'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:08.870983 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-61321c43-4448-4742-affe-b816cf5e35f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df7b0ee76cb04660bd95d7ffbb3a7148', 'request_id': 'req-61321c43-4448-4742-affe-b816cf5e35f6'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:08.885338 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-61321c43-4448-4742-affe-b816cf5e35f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df7b0ee76cb04660bd95d7ffbb3a7148', 'request_id': 'req-61321c43-4448-4742-affe-b816cf5e35f6'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:08.900508 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-4cfc8868-26ec-4ada-aaa7-818f7e8bf13a admin admin] The token cache is being invalidate because project 3050b27fe5a74c798e6afe41b3748cbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:38:08.900848 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-61321c43-4448-4742-affe-b816cf5e35f6 admin admin] The token cache is being invalidate because project df7b0ee76cb04660bd95d7ffbb3a7148 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:38:08.900848 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-61321c43-4448-4742-affe-b816cf5e35f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:08.901300 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-4cfc8868-26ec-4ada-aaa7-818f7e8bf13a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:08.901763 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-61321c43-4448-4742-affe-b816cf5e35f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:08.902055 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-4cfc8868-26ec-4ada-aaa7-818f7e8bf13a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:08.903471 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1379/2768] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:38:08 2022] DELETE /identity/v3/projects/df7b0ee76cb04660bd95d7ffbb3a7148 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:38:08.909122 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1390/2769] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:38:08 2022] DELETE /identity/v3/projects/3050b27fe5a74c798e6afe41b3748cbf => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:38:08.910121 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98c985-8e1a-4a3e-b311-843cbbc2e03b None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:08.910446 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc8868-26ec-4ada-aaa7-818f7e8bf13a admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:08.910631 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98c985-8e1a-4a3e-b311-843cbbc2e03b None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:08.910864 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98c985-8e1a-4a3e-b311-843cbbc2e03b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:08.912753 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-4cfc8868-26ec-4ada-aaa7-818f7e8bf13a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:08.940221 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-fd98c985-8e1a-4a3e-b311-843cbbc2e03b None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:38:08.942032 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-fd98c985-8e1a-4a3e-b311-843cbbc2e03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:08.973184 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:09.017604 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc8868-26ec-4ada-aaa7-818f7e8bf13a admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:09.023676 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55def96c-d38e-4af9-b2d4-1f39593454d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:09.024728 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55def96c-d38e-4af9-b2d4-1f39593454d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:09.025156 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55def96c-d38e-4af9-b2d4-1f39593454d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:09.025611 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55def96c-d38e-4af9-b2d4-1f39593454d2 admin admin] PATH_INFO: `/v3/users/d8ab8a5633b24a49948dce10ea68e8e0` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:09.027080 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55def96c-d38e-4af9-b2d4-1f39593454d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8ab8a5633b24a49948dce10ea68e8e0)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:09.029471 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55def96c-d38e-4af9-b2d4-1f39593454d2 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:09.040820 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1380/2770] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:38:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:38:09.053191 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b31ce4-c5a6-4725-95b8-ecae51dc33c9 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:09.053584 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b31ce4-c5a6-4725-95b8-ecae51dc33c9 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:09.053917 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b31ce4-c5a6-4725-95b8-ecae51dc33c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:09.054879 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:09.082168 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-08b31ce4-c5a6-4725-95b8-ecae51dc33c9 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:38:09.084169 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-08b31ce4-c5a6-4725-95b8-ecae51dc33c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:09.098392 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-55def96c-d38e-4af9-b2d4-1f39593454d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8ab8a5633b24a49948dce10ea68e8e0'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:09.102090 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1381/2771] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:38:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:38:09.103325 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b31ce4-c5a6-4725-95b8-ecae51dc33c9 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:09.112443 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-55def96c-d38e-4af9-b2d4-1f39593454d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8ab8a5633b24a49948dce10ea68e8e0'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:09.115774 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b31ce4-c5a6-4725-95b8-ecae51dc33c9 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:09.123276 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-55def96c-d38e-4af9-b2d4-1f39593454d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8ab8a5633b24a49948dce10ea68e8e0'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:09.124243 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c604db-bd73-4dfc-bb96-ff452aefbf85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:09.124449 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-55def96c-d38e-4af9-b2d4-1f39593454d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8ab8a5633b24a49948dce10ea68e8e0'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:09.125264 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c604db-bd73-4dfc-bb96-ff452aefbf85 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:09.125718 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c604db-bd73-4dfc-bb96-ff452aefbf85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:09.126175 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c604db-bd73-4dfc-bb96-ff452aefbf85 admin admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:09.127337 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c604db-bd73-4dfc-bb96-ff452aefbf85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:38:09.128043 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c604db-bd73-4dfc-bb96-ff452aefbf85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:09.132085 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c604db-bd73-4dfc-bb96-ff452aefbf85 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:09.141019 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-55def96c-d38e-4af9-b2d4-1f39593454d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8ab8a5633b24a49948dce10ea68e8e0'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:09.148784 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1391/2772] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:38:08 2022] DELETE /identity/v3/users/d8ab8a5633b24a49948dce10ea68e8e0 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:38:09.162804 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1382/2773] 10.222.0.91 () {58 vars in 1153 bytes} [Tue Aug 30 04:38:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:38:09.164633 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55def96c-d38e-4af9-b2d4-1f39593454d2 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:09.167463 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-55def96c-d38e-4af9-b2d4-1f39593454d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:09.292722 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55def96c-d38e-4af9-b2d4-1f39593454d2 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:09.301585 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eedfe6-277e-4ce2-833c-1aed9b567851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:09.302737 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eedfe6-277e-4ce2-833c-1aed9b567851 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:09.303221 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eedfe6-277e-4ce2-833c-1aed9b567851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:09.303671 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eedfe6-277e-4ce2-833c-1aed9b567851 admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:09.304830 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eedfe6-277e-4ce2-833c-1aed9b567851 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:09.308590 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eedfe6-277e-4ce2-833c-1aed9b567851 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:09.356986 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1392/2774] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:38:09 2022] POST /identity/v3/projects => generated 383 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:38:09.358854 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c604db-bd73-4dfc-bb96-ff452aefbf85 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:09.372580 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c604db-bd73-4dfc-bb96-ff452aefbf85 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:09.474016 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0377865e-229c-4803-bf79-d84031765280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:09.475055 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0377865e-229c-4803-bf79-d84031765280 admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:09.475532 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0377865e-229c-4803-bf79-d84031765280 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:09.476050 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0377865e-229c-4803-bf79-d84031765280 admin admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:09.477349 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0377865e-229c-4803-bf79-d84031765280 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:09.480973 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0377865e-229c-4803-bf79-d84031765280 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:09.520751 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e50d18-1429-4c23-9a0f-990a2977906c None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:09.521421 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e50d18-1429-4c23-9a0f-990a2977906c None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:09.521896 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e50d18-1429-4c23-9a0f-990a2977906c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:09.532208 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1383/2775] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:38:09 2022] POST /identity/v3/users => generated 292 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:38:09.534074 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0377865e-229c-4803-bf79-d84031765280 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:09.554425 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0377865e-229c-4803-bf79-d84031765280 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:09.563042 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67a1713-e520-42d0-baf2-94883bfda7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:09.564846 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a1713-e520-42d0-baf2-94883bfda7bf admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:09.564846 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a1713-e520-42d0-baf2-94883bfda7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:09.565219 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a1713-e520-42d0-baf2-94883bfda7bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:09.565380 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-b1e50d18-1429-4c23-9a0f-990a2977906c None None] MFA Rules not processed for user `ea5b20f6358c471480c78566d44c573d`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:38:09.566372 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67a1713-e520-42d0-baf2-94883bfda7bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:09.567366 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-b1e50d18-1429-4c23-9a0f-990a2977906c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:09.569696 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67a1713-e520-42d0-baf2-94883bfda7bf admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:09.592096 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1384/2776] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:38:09 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:38:09.599315 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67a1713-e520-42d0-baf2-94883bfda7bf admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:09.620664 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67a1713-e520-42d0-baf2-94883bfda7bf admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:09.628719 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd352889-ee2b-4888-96ad-5083b2a3f7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:09.629515 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd352889-ee2b-4888-96ad-5083b2a3f7f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:09.629850 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd352889-ee2b-4888-96ad-5083b2a3f7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:09.630048 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd352889-ee2b-4888-96ad-5083b2a3f7f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:09.630759 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd352889-ee2b-4888-96ad-5083b2a3f7f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:09.637346 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd352889-ee2b-4888-96ad-5083b2a3f7f2 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:09.659743 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1385/2777] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:38:09 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:38:09.660827 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd352889-ee2b-4888-96ad-5083b2a3f7f2 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:09.669999 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-cd352889-ee2b-4888-96ad-5083b2a3f7f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:09.685647 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd352889-ee2b-4888-96ad-5083b2a3f7f2 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:09.686384 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1393/2778] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:38:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:38:09.687444 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e50d18-1429-4c23-9a0f-990a2977906c None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:09.698946 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6266aa-5b4c-487a-b2bd-ca00dc2f1e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:09.699798 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6266aa-5b4c-487a-b2bd-ca00dc2f1e6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:09.700243 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6266aa-5b4c-487a-b2bd-ca00dc2f1e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:09.700609 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6266aa-5b4c-487a-b2bd-ca00dc2f1e6e admin admin] PATH_INFO: `/v3/projects/cfe468086bdf4fc3b1bf95498b8329d5` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:09.702697 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6266aa-5b4c-487a-b2bd-ca00dc2f1e6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfe468086bdf4fc3b1bf95498b8329d5)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:09.705064 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6266aa-5b4c-487a-b2bd-ca00dc2f1e6e admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:09.706015 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e50d18-1429-4c23-9a0f-990a2977906c None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:09.714781 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18831581-1134-4884-8e6e-695b885201f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:09.716349 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18831581-1134-4884-8e6e-695b885201f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:09.716825 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18831581-1134-4884-8e6e-695b885201f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:09.717281 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18831581-1134-4884-8e6e-695b885201f4 admin admin] PATH_INFO: `/v3/projects/a03aefcf7f894cbbbfdb50ee3b7f3442/users/cfde6017054644f4994a2499a6ffcb49/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:09.747720 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18831581-1134-4884-8e6e-695b885201f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a03aefcf7f894cbbbfdb50ee3b7f3442, user_id=cfde6017054644f4994a2499a6ffcb49, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:09.753957 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18831581-1134-4884-8e6e-695b885201f4 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:09.771618 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:09.780279 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1394/2779] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:38:09 2022] PUT /identity/v3/projects/a03aefcf7f894cbbbfdb50ee3b7f3442/users/cfde6017054644f4994a2499a6ffcb49/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:38:09.790347 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-4a6266aa-5b4c-487a-b2bd-ca00dc2f1e6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfe468086bdf4fc3b1bf95498b8329d5', 'request_id': 'req-4a6266aa-5b4c-487a-b2bd-ca00dc2f1e6e'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:09.802122 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bacfbc4-f360-4b49-a8fb-e1fae875bdce None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:09.802608 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bacfbc4-f360-4b49-a8fb-e1fae875bdce None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:09.803054 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bacfbc4-f360-4b49-a8fb-e1fae875bdce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:09.805071 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-4a6266aa-5b4c-487a-b2bd-ca00dc2f1e6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfe468086bdf4fc3b1bf95498b8329d5', 'request_id': 'req-4a6266aa-5b4c-487a-b2bd-ca00dc2f1e6e'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:09.819217 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-4a6266aa-5b4c-487a-b2bd-ca00dc2f1e6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfe468086bdf4fc3b1bf95498b8329d5', 'request_id': 'req-4a6266aa-5b4c-487a-b2bd-ca00dc2f1e6e'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:09.827451 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:09.848438 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-4a6266aa-5b4c-487a-b2bd-ca00dc2f1e6e admin admin] The token cache is being invalidate because project cfe468086bdf4fc3b1bf95498b8329d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:38:09.849833 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-4a6266aa-5b4c-487a-b2bd-ca00dc2f1e6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:09.851801 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-4a6266aa-5b4c-487a-b2bd-ca00dc2f1e6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:09.852156 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-4bacfbc4-f360-4b49-a8fb-e1fae875bdce None None] MFA Rules not processed for user `cfde6017054644f4994a2499a6ffcb49`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:38:09.853647 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-4bacfbc4-f360-4b49-a8fb-e1fae875bdce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:09.855210 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1386/2780] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:38:09 2022] DELETE /identity/v3/projects/cfe468086bdf4fc3b1bf95498b8329d5 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:38:09.861722 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07fc6b3-a6e9-4871-ae2a-e803aa0d892d None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:09.862382 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07fc6b3-a6e9-4871-ae2a-e803aa0d892d None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:09.862870 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07fc6b3-a6e9-4871-ae2a-e803aa0d892d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:09.889073 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-d07fc6b3-a6e9-4871-ae2a-e803aa0d892d None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:38:09.890511 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-d07fc6b3-a6e9-4871-ae2a-e803aa0d892d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:09.953373 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1395/2781] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:38:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:38:09.958170 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bacfbc4-f360-4b49-a8fb-e1fae875bdce None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:09.960691 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-4bacfbc4-f360-4b49-a8fb-e1fae875bdce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:09.973097 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1387/2782] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:38:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:38:09.988428 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b40f28-944d-4ca1-aa0b-1d7cb66085c8 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:09.988755 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b40f28-944d-4ca1-aa0b-1d7cb66085c8 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:09.989636 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b40f28-944d-4ca1-aa0b-1d7cb66085c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:10.020274 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-00b40f28-944d-4ca1-aa0b-1d7cb66085c8 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:38:10.021740 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-00b40f28-944d-4ca1-aa0b-1d7cb66085c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:10.031690 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1388/2783] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:38:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:38:10.035831 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b40f28-944d-4ca1-aa0b-1d7cb66085c8 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:10.046602 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b40f28-944d-4ca1-aa0b-1d7cb66085c8 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:10.052463 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dde063-a550-43ec-b2b8-536fb747b907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:10.053112 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dde063-a550-43ec-b2b8-536fb747b907 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:10.053392 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dde063-a550-43ec-b2b8-536fb747b907 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:10.053667 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dde063-a550-43ec-b2b8-536fb747b907 admin admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:10.054362 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dde063-a550-43ec-b2b8-536fb747b907 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:38:10.054663 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dde063-a550-43ec-b2b8-536fb747b907 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:10.055763 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bacfbc4-f360-4b49-a8fb-e1fae875bdce None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:10.056347 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dde063-a550-43ec-b2b8-536fb747b907 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:10.061816 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f6c0c-89e5-450f-a290-b34bb7f434f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:10.062836 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f6c0c-89e5-450f-a290-b34bb7f434f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:10.063411 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f6c0c-89e5-450f-a290-b34bb7f434f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:10.063836 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f6c0c-89e5-450f-a290-b34bb7f434f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:10.064919 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09f6c0c-89e5-450f-a290-b34bb7f434f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:10.068245 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09f6c0c-89e5-450f-a290-b34bb7f434f2 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:10.077052 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1389/2784] 10.222.0.91 () {58 vars in 1153 bytes} [Tue Aug 30 04:38:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:38:10.078044 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dde063-a550-43ec-b2b8-536fb747b907 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:10.098736 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dde063-a550-43ec-b2b8-536fb747b907 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:10.107751 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1396/2785] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:38:09 2022] POST /identity/v3/projects => generated 387 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:38:10.109294 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f6c0c-89e5-450f-a290-b34bb7f434f2 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:10.110421 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3b290a-2c62-4d54-a38d-1098c6899d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:10.111602 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b290a-2c62-4d54-a38d-1098c6899d8d admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:10.112220 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b290a-2c62-4d54-a38d-1098c6899d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:10.112793 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b290a-2c62-4d54-a38d-1098c6899d8d admin admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:10.114751 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3b290a-2c62-4d54-a38d-1098c6899d8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:10.118621 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3b290a-2c62-4d54-a38d-1098c6899d8d admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:10.179844 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1390/2786] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:38:10 2022] POST /identity/v3/projects => generated 409 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:38:10.189125 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3b290a-2c62-4d54-a38d-1098c6899d8d admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:10.211682 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f6c0c-89e5-450f-a290-b34bb7f434f2 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:10.248837 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:10.290970 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3b290a-2c62-4d54-a38d-1098c6899d8d admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:10.297083 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84992554-a48a-45f2-b829-28e48e74f2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:10.298385 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84992554-a48a-45f2-b829-28e48e74f2e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:10.298667 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84992554-a48a-45f2-b829-28e48e74f2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:10.298968 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84992554-a48a-45f2-b829-28e48e74f2e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:10.299599 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84992554-a48a-45f2-b829-28e48e74f2e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:10.302416 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84992554-a48a-45f2-b829-28e48e74f2e5 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:10.326949 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aae54d-8dde-458a-af14-92a2d35b092a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:10.327716 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aae54d-8dde-458a-af14-92a2d35b092a admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:10.328119 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aae54d-8dde-458a-af14-92a2d35b092a admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:10.328559 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aae54d-8dde-458a-af14-92a2d35b092a admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:10.329429 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aae54d-8dde-458a-af14-92a2d35b092a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:10.332121 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aae54d-8dde-458a-af14-92a2d35b092a admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:10.332578 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1391/2787] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:38:10 2022] POST /identity/v3/users => generated 305 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:38:10.336938 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84992554-a48a-45f2-b829-28e48e74f2e5 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:10.353132 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84992554-a48a-45f2-b829-28e48e74f2e5 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:10.361087 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f96ea3c-e30c-4922-87c2-ed24d00276ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:10.362147 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96ea3c-e30c-4922-87c2-ed24d00276ff admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:10.363113 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96ea3c-e30c-4922-87c2-ed24d00276ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:10.363642 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96ea3c-e30c-4922-87c2-ed24d00276ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:10.364646 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f96ea3c-e30c-4922-87c2-ed24d00276ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:10.368961 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f96ea3c-e30c-4922-87c2-ed24d00276ff admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:10.381982 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1397/2788] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:38:10 2022] POST /identity/v3/users => generated 294 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:38:10.389086 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1392/2789] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:38:10.389364 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aae54d-8dde-458a-af14-92a2d35b092a admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:10.390607 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f96ea3c-e30c-4922-87c2-ed24d00276ff admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:10.402062 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aae54d-8dde-458a-af14-92a2d35b092a admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:10.405286 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f96ea3c-e30c-4922-87c2-ed24d00276ff admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:10.407589 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c3173-d4ce-4873-8892-6e36aa94db50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:10.408272 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c3173-d4ce-4873-8892-6e36aa94db50 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:10.408544 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c3173-d4ce-4873-8892-6e36aa94db50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:10.408924 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c3173-d4ce-4873-8892-6e36aa94db50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:10.409649 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779c3173-d4ce-4873-8892-6e36aa94db50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:10.412707 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779c3173-d4ce-4873-8892-6e36aa94db50 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:10.413079 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5895f80b-3891-4c5a-8197-4a0ff34a94ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:10.413861 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5895f80b-3891-4c5a-8197-4a0ff34a94ce admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:10.414377 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5895f80b-3891-4c5a-8197-4a0ff34a94ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:10.414818 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5895f80b-3891-4c5a-8197-4a0ff34a94ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:10.415978 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5895f80b-3891-4c5a-8197-4a0ff34a94ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:10.417889 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5895f80b-3891-4c5a-8197-4a0ff34a94ce admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:10.436683 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1393/2790] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:38:10.436951 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1398/2791] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:38:10.438424 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5895f80b-3891-4c5a-8197-4a0ff34a94ce admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:10.439452 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c3173-d4ce-4873-8892-6e36aa94db50 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:10.451965 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5895f80b-3891-4c5a-8197-4a0ff34a94ce admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:10.458913 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaaf0cc-4a13-4bc6-bd0d-168b02746ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:10.459152 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c3173-d4ce-4873-8892-6e36aa94db50 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:10.459804 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaaf0cc-4a13-4bc6-bd0d-168b02746ca9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:10.460206 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaaf0cc-4a13-4bc6-bd0d-168b02746ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:10.460565 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaaf0cc-4a13-4bc6-bd0d-168b02746ca9 admin admin] PATH_INFO: `/v3/projects/6084f937082f4d00881f0ac144e8a80a/users/f6bc66ade4a449f6bc55ee0dddb795da/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:10.465801 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df8e134-4ef8-472a-a902-20a7e9eb448f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:10.466530 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8e134-4ef8-472a-a902-20a7e9eb448f admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:10.466896 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8e134-4ef8-472a-a902-20a7e9eb448f admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:10.467217 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8e134-4ef8-472a-a902-20a7e9eb448f admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:10.468115 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df8e134-4ef8-472a-a902-20a7e9eb448f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:10.469862 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df8e134-4ef8-472a-a902-20a7e9eb448f admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:10.479734 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaaf0cc-4a13-4bc6-bd0d-168b02746ca9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6084f937082f4d00881f0ac144e8a80a, user_id=f6bc66ade4a449f6bc55ee0dddb795da, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:10.482659 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaaf0cc-4a13-4bc6-bd0d-168b02746ca9 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:10.486717 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:DELETE=1,keystone:SELECT=94,keystone:INSERT=5 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:10.510390 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1394/2792] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:38:10 2022] PUT /identity/v3/projects/6084f937082f4d00881f0ac144e8a80a/users/f6bc66ade4a449f6bc55ee0dddb795da/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:38:10.510802 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1399/2793] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:38:10.513531 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaaf0cc-4a13-4bc6-bd0d-168b02746ca9 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:10.517554 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a1cd7-ed61-4a0c-840b-fc4f27366a57 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:10.517901 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a1cd7-ed61-4a0c-840b-fc4f27366a57 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:10.518312 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a1cd7-ed61-4a0c-840b-fc4f27366a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:10.570542 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-207a1cd7-ed61-4a0c-840b-fc4f27366a57 None None] MFA Rules not processed for user `f6bc66ade4a449f6bc55ee0dddb795da`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:38:10.572559 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-207a1cd7-ed61-4a0c-840b-fc4f27366a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:10.663973 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaaf0cc-4a13-4bc6-bd0d-168b02746ca9 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:10.670203 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2206b4c-70bf-45e7-b205-2f35d529fa81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:10.671248 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2206b4c-70bf-45e7-b205-2f35d529fa81 admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:10.671750 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2206b4c-70bf-45e7-b205-2f35d529fa81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:10.672239 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2206b4c-70bf-45e7-b205-2f35d529fa81 admin admin] PATH_INFO: `/v3/projects/a7aad5136b74459896f67d3c0c16cf48/users/700a61b50fe84ab6898dd03ad9e36e30/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:10.681275 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1400/2794] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:38:10 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:38:10.687611 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a1cd7-ed61-4a0c-840b-fc4f27366a57 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:10.696272 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2206b4c-70bf-45e7-b205-2f35d529fa81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7aad5136b74459896f67d3c0c16cf48, user_id=700a61b50fe84ab6898dd03ad9e36e30, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:10.699724 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2206b4c-70bf-45e7-b205-2f35d529fa81 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:10.717408 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a1cd7-ed61-4a0c-840b-fc4f27366a57 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:10.725134 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1395/2795] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:38:10 2022] PUT /identity/v3/projects/a7aad5136b74459896f67d3c0c16cf48/users/700a61b50fe84ab6898dd03ad9e36e30/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:38:10.747047 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46310d86-1d1a-4566-9052-781deb51cbb0 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:10.747857 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46310d86-1d1a-4566-9052-781deb51cbb0 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:10.748458 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46310d86-1d1a-4566-9052-781deb51cbb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:10.784020 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-46310d86-1d1a-4566-9052-781deb51cbb0 None None] MFA Rules not processed for user `700a61b50fe84ab6898dd03ad9e36e30`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:38:10.785768 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-46310d86-1d1a-4566-9052-781deb51cbb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:10.817809 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c8ac6-2957-473d-848d-afa5fe79b202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:10.818645 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c8ac6-2957-473d-848d-afa5fe79b202 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:10.818791 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c8ac6-2957-473d-848d-afa5fe79b202 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:10.818955 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c8ac6-2957-473d-848d-afa5fe79b202 admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:10.819602 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976c8ac6-2957-473d-848d-afa5fe79b202 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:10.821756 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976c8ac6-2957-473d-848d-afa5fe79b202 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:10.856572 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1401/2796] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:38:10 2022] POST /identity/v3/projects => generated 409 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:38:10.860658 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c8ac6-2957-473d-848d-afa5fe79b202 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:10.871039 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:10.884038 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1396/2797] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:38:10 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:38:10.899698 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46310d86-1d1a-4566-9052-781deb51cbb0 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:10.914569 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46310d86-1d1a-4566-9052-781deb51cbb0 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:10.985707 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c8ac6-2957-473d-848d-afa5fe79b202 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:11.001591 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1be041-bfdf-4784-9ebc-b101caf29f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:11.003636 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1be041-bfdf-4784-9ebc-b101caf29f03 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:11.003636 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1be041-bfdf-4784-9ebc-b101caf29f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:11.004145 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1be041-bfdf-4784-9ebc-b101caf29f03 admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:11.005205 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e31b44-9b48-4ad9-8d71-8d63026e2aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:11.005608 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1be041-bfdf-4784-9ebc-b101caf29f03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:11.006023 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e31b44-9b48-4ad9-8d71-8d63026e2aef admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:11.006545 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e31b44-9b48-4ad9-8d71-8d63026e2aef admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:11.006887 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e31b44-9b48-4ad9-8d71-8d63026e2aef admin admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:11.007816 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e31b44-9b48-4ad9-8d71-8d63026e2aef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:11.008599 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1be041-bfdf-4784-9ebc-b101caf29f03 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:11.009977 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e31b44-9b48-4ad9-8d71-8d63026e2aef admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:11.028113 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:11.045660 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1402/2798] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:38:10 2022] POST /identity/v3/users => generated 311 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:38:11.048225 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1397/2799] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:38:10 2022] POST /identity/v3/projects => generated 387 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:38:11.051690 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1be041-bfdf-4784-9ebc-b101caf29f03 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:11.053491 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e31b44-9b48-4ad9-8d71-8d63026e2aef admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:11.062873 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1be041-bfdf-4784-9ebc-b101caf29f03 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:11.158066 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e31b44-9b48-4ad9-8d71-8d63026e2aef admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:11.158375 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f663ef-e3e2-41fe-bd24-44fbfa9cc4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:11.159219 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f663ef-e3e2-41fe-bd24-44fbfa9cc4b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:11.159730 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f663ef-e3e2-41fe-bd24-44fbfa9cc4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:11.161471 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f663ef-e3e2-41fe-bd24-44fbfa9cc4b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:11.163132 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f663ef-e3e2-41fe-bd24-44fbfa9cc4b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:11.166622 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f663ef-e3e2-41fe-bd24-44fbfa9cc4b6 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:11.169950 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebc683b-1b75-4b87-908e-e8a8e76373c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:11.171922 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc683b-1b75-4b87-908e-e8a8e76373c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:11.172487 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc683b-1b75-4b87-908e-e8a8e76373c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:11.172966 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc683b-1b75-4b87-908e-e8a8e76373c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:11.173913 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebc683b-1b75-4b87-908e-e8a8e76373c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:11.178251 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebc683b-1b75-4b87-908e-e8a8e76373c0 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:11.184798 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1403/2800] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:38:11.190927 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f663ef-e3e2-41fe-bd24-44fbfa9cc4b6 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:11.215356 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f663ef-e3e2-41fe-bd24-44fbfa9cc4b6 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:11.220802 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1398/2801] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:38:11 2022] POST /identity/v3/users => generated 300 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:38:11.221326 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebc683b-1b75-4b87-908e-e8a8e76373c0 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:11.225900 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef5887-ae72-4a0e-8cdd-cb67aa5511de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:11.227460 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef5887-ae72-4a0e-8cdd-cb67aa5511de admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:11.228064 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef5887-ae72-4a0e-8cdd-cb67aa5511de admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:11.229352 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef5887-ae72-4a0e-8cdd-cb67aa5511de admin admin] PATH_INFO: `/v3/projects/162348a5bc9d4e54b5dd30be1dba815e/users/7b06b2d883a641f7b7ddb995e530ed4f/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:11.239654 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebc683b-1b75-4b87-908e-e8a8e76373c0 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:11.252389 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cdabf7-8dfc-4e28-84c3-cf60828c87fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:11.253150 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cef5887-ae72-4a0e-8cdd-cb67aa5511de admin admin] RBAC: Authorizing `identity:create_grant(project_id=162348a5bc9d4e54b5dd30be1dba815e, user_id=7b06b2d883a641f7b7ddb995e530ed4f, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:11.254318 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cdabf7-8dfc-4e28-84c3-cf60828c87fd admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:11.254838 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cdabf7-8dfc-4e28-84c3-cf60828c87fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:11.255351 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cdabf7-8dfc-4e28-84c3-cf60828c87fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:11.256093 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cef5887-ae72-4a0e-8cdd-cb67aa5511de admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:11.256522 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cdabf7-8dfc-4e28-84c3-cf60828c87fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:11.260591 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cdabf7-8dfc-4e28-84c3-cf60828c87fd admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:11.281101 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1404/2802] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:38:11 2022] PUT /identity/v3/projects/162348a5bc9d4e54b5dd30be1dba815e/users/7b06b2d883a641f7b7ddb995e530ed4f/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:38:11.287975 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef5887-ae72-4a0e-8cdd-cb67aa5511de admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:11.288290 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1399/2803] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:38:11.292251 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cdabf7-8dfc-4e28-84c3-cf60828c87fd admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:11.314048 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cdabf7-8dfc-4e28-84c3-cf60828c87fd admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:11.437950 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef5887-ae72-4a0e-8cdd-cb67aa5511de admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:11.439211 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e660ace0-82a0-4d70-af4e-f392949d0f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:11.440498 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660ace0-82a0-4d70-af4e-f392949d0f5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:11.441061 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660ace0-82a0-4d70-af4e-f392949d0f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:11.444172 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660ace0-82a0-4d70-af4e-f392949d0f5f admin admin] PATH_INFO: `/v3/projects/babf3fb68a924e13859565d272125f13/users/5581b25a98b142e39971d4d83833692e/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:11.446416 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd597a5e-da77-4b28-b137-730471047fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:11.447343 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd597a5e-da77-4b28-b137-730471047fc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:11.447706 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd597a5e-da77-4b28-b137-730471047fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:11.448312 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd597a5e-da77-4b28-b137-730471047fc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:11.448837 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd597a5e-da77-4b28-b137-730471047fc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:11.451009 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd597a5e-da77-4b28-b137-730471047fc0 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:11.466772 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1405/2804] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:38:11.472605 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd597a5e-da77-4b28-b137-730471047fc0 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:11.479833 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e660ace0-82a0-4d70-af4e-f392949d0f5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=babf3fb68a924e13859565d272125f13, user_id=5581b25a98b142e39971d4d83833692e, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:11.482119 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:11.486920 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e660ace0-82a0-4d70-af4e-f392949d0f5f admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:11.498069 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd597a5e-da77-4b28-b137-730471047fc0 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:11.509206 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98388f-65f2-4be3-86c0-ea2fd2b2a51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:11.510339 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98388f-65f2-4be3-86c0-ea2fd2b2a51d admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:11.510814 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98388f-65f2-4be3-86c0-ea2fd2b2a51d admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:11.511299 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98388f-65f2-4be3-86c0-ea2fd2b2a51d admin admin] PATH_INFO: `/v3/projects/162348a5bc9d4e54b5dd30be1dba815e/users/7b06b2d883a641f7b7ddb995e530ed4f/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:11.512571 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1400/2805] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:38:11 2022] PUT /identity/v3/projects/babf3fb68a924e13859565d272125f13/users/5581b25a98b142e39971d4d83833692e/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:38:11.514999 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee98388f-65f2-4be3-86c0-ea2fd2b2a51d admin admin] RBAC: Authorizing `identity:create_grant(project_id=162348a5bc9d4e54b5dd30be1dba815e, user_id=7b06b2d883a641f7b7ddb995e530ed4f, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:11.518767 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e660ace0-82a0-4d70-af4e-f392949d0f5f admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:11.520633 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee98388f-65f2-4be3-86c0-ea2fd2b2a51d admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:11.544508 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1406/2806] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:38:11 2022] PUT /identity/v3/projects/162348a5bc9d4e54b5dd30be1dba815e/users/7b06b2d883a641f7b7ddb995e530ed4f/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:38:11.559298 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec3a74-da5a-48ae-b3b9-bbf8d39160f3 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:11.559628 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec3a74-da5a-48ae-b3b9-bbf8d39160f3 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:11.559902 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec3a74-da5a-48ae-b3b9-bbf8d39160f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:11.607541 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-daec3a74-da5a-48ae-b3b9-bbf8d39160f3 None None] MFA Rules not processed for user `7b06b2d883a641f7b7ddb995e530ed4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:38:11.609631 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-daec3a74-da5a-48ae-b3b9-bbf8d39160f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:11.653332 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:11.667419 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e660ace0-82a0-4d70-af4e-f392949d0f5f admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:11.737526 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1407/2807] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:38:11 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:38:11.753530 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaee746a-715c-42ac-85c9-673ada945364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:11.754886 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee746a-715c-42ac-85c9-673ada945364 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:11.755131 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee746a-715c-42ac-85c9-673ada945364 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:11.755570 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee746a-715c-42ac-85c9-673ada945364 admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:11.756293 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daec3a74-da5a-48ae-b3b9-bbf8d39160f3 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:11.756940 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaee746a-715c-42ac-85c9-673ada945364 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:11.758729 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-daec3a74-da5a-48ae-b3b9-bbf8d39160f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:11.758951 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaee746a-715c-42ac-85c9-673ada945364 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:11.771683 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1401/2808] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:38:11.777692 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaee746a-715c-42ac-85c9-673ada945364 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:11.790973 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaee746a-715c-42ac-85c9-673ada945364 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:11.797562 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b30576-cb64-4fd7-a00a-58dedaff5073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:11.800745 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b30576-cb64-4fd7-a00a-58dedaff5073 admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:11.800745 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b30576-cb64-4fd7-a00a-58dedaff5073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:11.800745 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b30576-cb64-4fd7-a00a-58dedaff5073 admin admin] PATH_INFO: `/v3/projects/babf3fb68a924e13859565d272125f13/users/5581b25a98b142e39971d4d83833692e/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:11.804351 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b30576-cb64-4fd7-a00a-58dedaff5073 admin admin] RBAC: Authorizing `identity:create_grant(project_id=babf3fb68a924e13859565d272125f13, user_id=5581b25a98b142e39971d4d83833692e, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:11.807466 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b30576-cb64-4fd7-a00a-58dedaff5073 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:11.826536 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1402/2809] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:38:11 2022] PUT /identity/v3/projects/babf3fb68a924e13859565d272125f13/users/5581b25a98b142e39971d4d83833692e/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:38:11.846290 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daec3a74-da5a-48ae-b3b9-bbf8d39160f3 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:11.938443 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3e956a-2944-495d-8538-1e163e3efaad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:11.939474 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e956a-2944-495d-8538-1e163e3efaad service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:11.939947 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e956a-2944-495d-8538-1e163e3efaad service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:11.940759 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e956a-2944-495d-8538-1e163e3efaad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:11.941971 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290f807-a9d5-410a-bbc0-32287ec2155d None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:11.942246 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290f807-a9d5-410a-bbc0-32287ec2155d None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:11.942677 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290f807-a9d5-410a-bbc0-32287ec2155d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:12.006261 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-0290f807-a9d5-410a-bbc0-32287ec2155d None None] MFA Rules not processed for user `5581b25a98b142e39971d4d83833692e`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:38:12.008236 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-0290f807-a9d5-410a-bbc0-32287ec2155d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:12.026566 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:12.060675 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3e956a-2944-495d-8538-1e163e3efaad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:12.062529 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3e956a-2944-495d-8538-1e163e3efaad service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:12.076823 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1408/2810] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:38:11 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:38:12.147957 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1403/2811] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:38:11 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:38:12.165797 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3e956a-2944-495d-8538-1e163e3efaad service cinder] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:12.168538 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-aa3e956a-2944-495d-8538-1e163e3efaad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:12.189258 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3e956a-2944-495d-8538-1e163e3efaad service cinder] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:12.195000 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7ae4d2-06d9-4f57-bd61-6df3e4e05d49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:12.196469 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ae4d2-06d9-4f57-bd61-6df3e4e05d49 service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:12.196919 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ae4d2-06d9-4f57-bd61-6df3e4e05d49 service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:12.197417 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ae4d2-06d9-4f57-bd61-6df3e4e05d49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:12.211044 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7ae4d2-06d9-4f57-bd61-6df3e4e05d49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:12.212805 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7ae4d2-06d9-4f57-bd61-6df3e4e05d49 service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:12.224560 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1409/2812] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:38:12 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:38:12.373801 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0290f807-a9d5-410a-bbc0-32287ec2155d None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:12.396818 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0290f807-a9d5-410a-bbc0-32287ec2155d None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:12.413383 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a2b00-7135-46de-9125-e846a584d6cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:12.414718 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a2b00-7135-46de-9125-e846a584d6cd service cinder] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:12.415268 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a2b00-7135-46de-9125-e846a584d6cd service cinder] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:12.416482 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a2b00-7135-46de-9125-e846a584d6cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:12.517694 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a2b00-7135-46de-9125-e846a584d6cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:12.519796 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a2b00-7135-46de-9125-e846a584d6cd service cinder] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:12.530903 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1404/2813] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:38:12 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:38:13.105310 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7ae4d2-06d9-4f57-bd61-6df3e4e05d49 service cinder] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:13.118326 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7ae4d2-06d9-4f57-bd61-6df3e4e05d49 service cinder] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:13.123023 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d717b4-180b-414a-aa63-991b936b6108 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:13.123866 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d717b4-180b-414a-aa63-991b936b6108 service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:13.124323 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d717b4-180b-414a-aa63-991b936b6108 service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:13.124660 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d717b4-180b-414a-aa63-991b936b6108 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:13.217122 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d717b4-180b-414a-aa63-991b936b6108 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:13.218890 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d717b4-180b-414a-aa63-991b936b6108 service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:13.231109 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1410/2814] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:38:13 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:38:17.825219 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a2b00-7135-46de-9125-e846a584d6cd service cinder] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:17.835805 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a2b00-7135-46de-9125-e846a584d6cd service cinder] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:17.840270 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f4fbc-b06c-4c80-9788-a2bfab948b49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:17.840937 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f4fbc-b06c-4c80-9788-a2bfab948b49 service cinder] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:17.841215 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f4fbc-b06c-4c80-9788-a2bfab948b49 service cinder] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:17.841483 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f4fbc-b06c-4c80-9788-a2bfab948b49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:17.848586 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:17.946011 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126f4fbc-b06c-4c80-9788-a2bfab948b49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:17.948329 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126f4fbc-b06c-4c80-9788-a2bfab948b49 service cinder] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:17.965751 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1405/2815] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:38:17 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:38:18.715987 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d717b4-180b-414a-aa63-991b936b6108 service cinder] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:18.788164 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d717b4-180b-414a-aa63-991b936b6108 service cinder] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:18.793420 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58842ab4-51f3-494c-bd29-bbcb869e26b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:18.794121 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58842ab4-51f3-494c-bd29-bbcb869e26b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:18.794396 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58842ab4-51f3-494c-bd29-bbcb869e26b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:18.794671 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58842ab4-51f3-494c-bd29-bbcb869e26b3 admin admin] PATH_INFO: `/v3/users/f6bc66ade4a449f6bc55ee0dddb795da` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:18.796021 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58842ab4-51f3-494c-bd29-bbcb869e26b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6bc66ade4a449f6bc55ee0dddb795da)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:18.797989 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58842ab4-51f3-494c-bd29-bbcb869e26b3 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:18.868563 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-58842ab4-51f3-494c-bd29-bbcb869e26b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6bc66ade4a449f6bc55ee0dddb795da'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:18.883391 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-58842ab4-51f3-494c-bd29-bbcb869e26b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6bc66ade4a449f6bc55ee0dddb795da'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:18.897772 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-58842ab4-51f3-494c-bd29-bbcb869e26b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6bc66ade4a449f6bc55ee0dddb795da'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:18.898978 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-58842ab4-51f3-494c-bd29-bbcb869e26b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6bc66ade4a449f6bc55ee0dddb795da'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:18.907447 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:18.934967 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-58842ab4-51f3-494c-bd29-bbcb869e26b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6bc66ade4a449f6bc55ee0dddb795da'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:18.945174 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1411/2816] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:38:18 2022] DELETE /identity/v3/users/f6bc66ade4a449f6bc55ee0dddb795da => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:38:18.951608 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff298d-2d96-40a1-91d5-04813793ec50 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:18.952250 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff298d-2d96-40a1-91d5-04813793ec50 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:18.952250 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff298d-2d96-40a1-91d5-04813793ec50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:18.987421 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-30ff298d-2d96-40a1-91d5-04813793ec50 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:38:18.989612 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-30ff298d-2d96-40a1-91d5-04813793ec50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:19.088308 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1406/2817] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:38:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:38:19.102912 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58842ab4-51f3-494c-bd29-bbcb869e26b3 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:19.104659 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-58842ab4-51f3-494c-bd29-bbcb869e26b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:19.180882 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58842ab4-51f3-494c-bd29-bbcb869e26b3 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:19.185845 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b3c7d-7456-401d-9e7a-abbefbf5b248 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:19.186673 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b3c7d-7456-401d-9e7a-abbefbf5b248 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:19.187132 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b3c7d-7456-401d-9e7a-abbefbf5b248 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:19.187442 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b3c7d-7456-401d-9e7a-abbefbf5b248 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:19.199615 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6b3c7d-7456-401d-9e7a-abbefbf5b248 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:19.201298 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6b3c7d-7456-401d-9e7a-abbefbf5b248 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:19.212896 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1412/2818] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:38:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:38:19.602903 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ff298d-2d96-40a1-91d5-04813793ec50 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:19.605393 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-30ff298d-2d96-40a1-91d5-04813793ec50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:19.629149 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ff298d-2d96-40a1-91d5-04813793ec50 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:19.634956 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9943e599-06d4-4778-80e7-8979d9e9d8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:19.642100 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943e599-06d4-4778-80e7-8979d9e9d8fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:19.642100 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943e599-06d4-4778-80e7-8979d9e9d8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:19.642100 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943e599-06d4-4778-80e7-8979d9e9d8fb admin admin] PATH_INFO: `/v3/projects/6084f937082f4d00881f0ac144e8a80a` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:19.643635 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9943e599-06d4-4778-80e7-8979d9e9d8fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=6084f937082f4d00881f0ac144e8a80a)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:19.646295 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9943e599-06d4-4778-80e7-8979d9e9d8fb admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:19.734093 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-9943e599-06d4-4778-80e7-8979d9e9d8fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6084f937082f4d00881f0ac144e8a80a', 'request_id': 'req-9943e599-06d4-4778-80e7-8979d9e9d8fb'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:19.744916 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-9943e599-06d4-4778-80e7-8979d9e9d8fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6084f937082f4d00881f0ac144e8a80a', 'request_id': 'req-9943e599-06d4-4778-80e7-8979d9e9d8fb'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:19.760014 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-9943e599-06d4-4778-80e7-8979d9e9d8fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6084f937082f4d00881f0ac144e8a80a', 'request_id': 'req-9943e599-06d4-4778-80e7-8979d9e9d8fb'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:19.784817 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-9943e599-06d4-4778-80e7-8979d9e9d8fb admin admin] The token cache is being invalidate because project 6084f937082f4d00881f0ac144e8a80a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:38:19.785351 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-9943e599-06d4-4778-80e7-8979d9e9d8fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:19.786951 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-9943e599-06d4-4778-80e7-8979d9e9d8fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:19.789686 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1407/2819] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:38:19 2022] DELETE /identity/v3/projects/6084f937082f4d00881f0ac144e8a80a => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:38:19.796100 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b3c7d-7456-401d-9e7a-abbefbf5b248 service neutron] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:19.813727 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b3c7d-7456-401d-9e7a-abbefbf5b248 service neutron] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:19.923444 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2741d5a-922e-46f5-97ee-a4648f33d4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:19.924586 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2741d5a-922e-46f5-97ee-a4648f33d4b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:19.925058 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2741d5a-922e-46f5-97ee-a4648f33d4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:19.925532 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2741d5a-922e-46f5-97ee-a4648f33d4b9 admin admin] PATH_INFO: `/v3/users/7b06b2d883a641f7b7ddb995e530ed4f` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:19.927660 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2741d5a-922e-46f5-97ee-a4648f33d4b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b06b2d883a641f7b7ddb995e530ed4f)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:19.931614 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2741d5a-922e-46f5-97ee-a4648f33d4b9 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:19.996023 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-c2741d5a-922e-46f5-97ee-a4648f33d4b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b06b2d883a641f7b7ddb995e530ed4f'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:20.004587 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-c2741d5a-922e-46f5-97ee-a4648f33d4b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b06b2d883a641f7b7ddb995e530ed4f'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:20.015149 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-c2741d5a-922e-46f5-97ee-a4648f33d4b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b06b2d883a641f7b7ddb995e530ed4f'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:20.016173 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-c2741d5a-922e-46f5-97ee-a4648f33d4b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b06b2d883a641f7b7ddb995e530ed4f'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:20.035042 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-c2741d5a-922e-46f5-97ee-a4648f33d4b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b06b2d883a641f7b7ddb995e530ed4f'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:20.044107 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1413/2820] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:38:19 2022] DELETE /identity/v3/users/7b06b2d883a641f7b7ddb995e530ed4f => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:38:20.409610 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9943e599-06d4-4778-80e7-8979d9e9d8fb admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:20.412640 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-9943e599-06d4-4778-80e7-8979d9e9d8fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:20.437978 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9943e599-06d4-4778-80e7-8979d9e9d8fb admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:20.479758 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:20.525900 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab2476-99d6-4859-9818-61070d028e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:20.526891 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab2476-99d6-4859-9818-61070d028e1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:20.527407 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab2476-99d6-4859-9818-61070d028e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:20.527871 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab2476-99d6-4859-9818-61070d028e1f admin admin] PATH_INFO: `/v3/projects/162348a5bc9d4e54b5dd30be1dba815e` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:20.530000 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ab2476-99d6-4859-9818-61070d028e1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=162348a5bc9d4e54b5dd30be1dba815e)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:20.533839 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ab2476-99d6-4859-9818-61070d028e1f admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:20.604247 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-e9ab2476-99d6-4859-9818-61070d028e1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '162348a5bc9d4e54b5dd30be1dba815e', 'request_id': 'req-e9ab2476-99d6-4859-9818-61070d028e1f'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:20.612056 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-e9ab2476-99d6-4859-9818-61070d028e1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '162348a5bc9d4e54b5dd30be1dba815e', 'request_id': 'req-e9ab2476-99d6-4859-9818-61070d028e1f'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:20.621013 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-e9ab2476-99d6-4859-9818-61070d028e1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '162348a5bc9d4e54b5dd30be1dba815e', 'request_id': 'req-e9ab2476-99d6-4859-9818-61070d028e1f'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:20.642431 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-e9ab2476-99d6-4859-9818-61070d028e1f admin admin] The token cache is being invalidate because project 162348a5bc9d4e54b5dd30be1dba815e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:38:20.643011 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-e9ab2476-99d6-4859-9818-61070d028e1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:20.646083 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-e9ab2476-99d6-4859-9818-61070d028e1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:20.649267 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1408/2821] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:38:20 2022] DELETE /identity/v3/projects/162348a5bc9d4e54b5dd30be1dba815e => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:38:20.654055 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226655c-1f19-4474-bc6b-89da1a10d08e None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:20.654557 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226655c-1f19-4474-bc6b-89da1a10d08e None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:20.654991 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226655c-1f19-4474-bc6b-89da1a10d08e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:20.666778 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab2476-99d6-4859-9818-61070d028e1f admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:20.668373 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-e9ab2476-99d6-4859-9818-61070d028e1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:20.676589 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:20.688117 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-5226655c-1f19-4474-bc6b-89da1a10d08e None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:38:20.690078 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-5226655c-1f19-4474-bc6b-89da1a10d08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:20.751472 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab2476-99d6-4859-9818-61070d028e1f admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:20.757821 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338e3dc-9789-46e8-9214-f3779c6e1f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:20.758852 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338e3dc-9789-46e8-9214-f3779c6e1f6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:20.759322 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338e3dc-9789-46e8-9214-f3779c6e1f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:20.759799 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338e3dc-9789-46e8-9214-f3779c6e1f6a admin admin] PATH_INFO: `/v3/users/cfde6017054644f4994a2499a6ffcb49` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:20.762137 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0338e3dc-9789-46e8-9214-f3779c6e1f6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfde6017054644f4994a2499a6ffcb49)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:20.765751 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0338e3dc-9789-46e8-9214-f3779c6e1f6a admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:20.773405 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1414/2822] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:38:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:38:20.781869 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223dcbf-cefb-4237-865f-ac7a1d85ca37 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:20.782163 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223dcbf-cefb-4237-865f-ac7a1d85ca37 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:20.782353 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223dcbf-cefb-4237-865f-ac7a1d85ca37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:20.806027 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-a223dcbf-cefb-4237-865f-ac7a1d85ca37 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:38:20.807292 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-a223dcbf-cefb-4237-865f-ac7a1d85ca37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:20.816347 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1415/2823] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:38:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:38:20.820901 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a223dcbf-cefb-4237-865f-ac7a1d85ca37 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:20.832967 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a223dcbf-cefb-4237-865f-ac7a1d85ca37 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:20.835353 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-0338e3dc-9789-46e8-9214-f3779c6e1f6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfde6017054644f4994a2499a6ffcb49'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:20.836410 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-0338e3dc-9789-46e8-9214-f3779c6e1f6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfde6017054644f4994a2499a6ffcb49'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:20.836895 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-0338e3dc-9789-46e8-9214-f3779c6e1f6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfde6017054644f4994a2499a6ffcb49'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:20.843652 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3756ca-26b1-453e-ab73-3f4e76cde0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:20.844745 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3756ca-26b1-453e-ab73-3f4e76cde0d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:20.845327 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3756ca-26b1-453e-ab73-3f4e76cde0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:20.845852 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3756ca-26b1-453e-ab73-3f4e76cde0d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:20.846856 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3756ca-26b1-453e-ab73-3f4e76cde0d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:38:20.847731 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3756ca-26b1-453e-ab73-3f4e76cde0d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:20.850680 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-0338e3dc-9789-46e8-9214-f3779c6e1f6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfde6017054644f4994a2499a6ffcb49'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:20.850905 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3756ca-26b1-453e-ab73-3f4e76cde0d0 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:20.866532 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:20.876227 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1416/2824] 10.222.0.91 () {58 vars in 1153 bytes} [Tue Aug 30 04:38:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:38:20.882048 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-0338e3dc-9789-46e8-9214-f3779c6e1f6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfde6017054644f4994a2499a6ffcb49'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:20.882368 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3756ca-26b1-453e-ab73-3f4e76cde0d0 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:20.885932 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-3d3756ca-26b1-453e-ab73-3f4e76cde0d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:20.904001 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1409/2825] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:38:20 2022] DELETE /identity/v3/users/cfde6017054644f4994a2499a6ffcb49 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:38:20.906485 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352bcf9a-1e30-4550-a8c8-b481e77bb818 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:20.906772 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352bcf9a-1e30-4550-a8c8-b481e77bb818 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:20.907047 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352bcf9a-1e30-4550-a8c8-b481e77bb818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:20.909753 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3756ca-26b1-453e-ab73-3f4e76cde0d0 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:21.004054 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67948da0-9aa8-4d44-9a4c-45ffae50b3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:21.004965 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67948da0-9aa8-4d44-9a4c-45ffae50b3dc admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:21.005536 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67948da0-9aa8-4d44-9a4c-45ffae50b3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:21.006009 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67948da0-9aa8-4d44-9a4c-45ffae50b3dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:21.007181 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67948da0-9aa8-4d44-9a4c-45ffae50b3dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:21.011066 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67948da0-9aa8-4d44-9a4c-45ffae50b3dc admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:21.060943 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-352bcf9a-1e30-4550-a8c8-b481e77bb818 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:38:21.062175 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-352bcf9a-1e30-4550-a8c8-b481e77bb818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:21.064763 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1417/2826] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:38:20 2022] POST /identity/v3/projects => generated 359 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:38:21.069952 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67948da0-9aa8-4d44-9a4c-45ffae50b3dc admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:21.167041 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1410/2827] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:38:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:38:21.178159 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352bcf9a-1e30-4550-a8c8-b481e77bb818 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:21.179607 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-352bcf9a-1e30-4550-a8c8-b481e77bb818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:21.193416 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67948da0-9aa8-4d44-9a4c-45ffae50b3dc admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:21.201623 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398b1490-50e2-45ba-887f-67e6391920f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:21.202681 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398b1490-50e2-45ba-887f-67e6391920f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:21.203160 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398b1490-50e2-45ba-887f-67e6391920f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:21.203640 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398b1490-50e2-45ba-887f-67e6391920f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:21.204941 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398b1490-50e2-45ba-887f-67e6391920f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:21.208872 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398b1490-50e2-45ba-887f-67e6391920f1 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:21.250227 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1418/2828] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:38:21 2022] POST /identity/v3/users => generated 280 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:38:21.252327 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398b1490-50e2-45ba-887f-67e6391920f1 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:21.261044 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:21.271893 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398b1490-50e2-45ba-887f-67e6391920f1 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:21.281691 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c6f4a-61e1-44c2-86c3-b372e7025ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:21.282589 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c6f4a-61e1-44c2-86c3-b372e7025ddd admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:21.283049 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c6f4a-61e1-44c2-86c3-b372e7025ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:21.283855 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c6f4a-61e1-44c2-86c3-b372e7025ddd admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:21.285788 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17c6f4a-61e1-44c2-86c3-b372e7025ddd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:21.288482 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352bcf9a-1e30-4550-a8c8-b481e77bb818 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:21.289438 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17c6f4a-61e1-44c2-86c3-b372e7025ddd admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:21.294742 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d66e2f-48ad-4d40-a6b5-31495881e6ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:21.295713 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d66e2f-48ad-4d40-a6b5-31495881e6ef service neutron] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:21.296223 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d66e2f-48ad-4d40-a6b5-31495881e6ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:21.296603 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d66e2f-48ad-4d40-a6b5-31495881e6ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:21.309003 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1419/2829] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:38:21 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:38:21.314180 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c6f4a-61e1-44c2-86c3-b372e7025ddd admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:21.318839 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d66e2f-48ad-4d40-a6b5-31495881e6ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:21.321748 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d66e2f-48ad-4d40-a6b5-31495881e6ef service neutron] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:21.334237 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c6f4a-61e1-44c2-86c3-b372e7025ddd admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:21.338885 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1411/2830] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:38:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:38:21.342152 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afb496a-725b-42bc-967c-e57e86256e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:21.343008 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb496a-725b-42bc-967c-e57e86256e07 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:21.343661 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb496a-725b-42bc-967c-e57e86256e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:21.343956 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb496a-725b-42bc-967c-e57e86256e07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:21.344926 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afb496a-725b-42bc-967c-e57e86256e07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:21.347335 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afb496a-725b-42bc-967c-e57e86256e07 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:21.373904 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1420/2831] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:38:21 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:38:21.374691 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d66e2f-48ad-4d40-a6b5-31495881e6ef service neutron] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:21.393860 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d66e2f-48ad-4d40-a6b5-31495881e6ef service neutron] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:21.406035 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2363e49-a3c2-4e77-90e2-3a122bb10875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:21.407848 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2363e49-a3c2-4e77-90e2-3a122bb10875 admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:21.408279 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2363e49-a3c2-4e77-90e2-3a122bb10875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:21.408660 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2363e49-a3c2-4e77-90e2-3a122bb10875 admin admin] PATH_INFO: `/v3/projects/99b1e6c36c91400f87f7c2ea08bab924/users/ecda46a987dd4866a84dfd4be69b2fe2/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:21.445016 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2363e49-a3c2-4e77-90e2-3a122bb10875 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99b1e6c36c91400f87f7c2ea08bab924, user_id=ecda46a987dd4866a84dfd4be69b2fe2, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:21.450489 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2363e49-a3c2-4e77-90e2-3a122bb10875 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:21.480633 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1412/2832] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:38:21 2022] PUT /identity/v3/projects/99b1e6c36c91400f87f7c2ea08bab924/users/ecda46a987dd4866a84dfd4be69b2fe2/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:38:21.496204 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e07153-e5ae-4422-b26e-85d2f0616d97 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:21.496547 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e07153-e5ae-4422-b26e-85d2f0616d97 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:21.496845 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e07153-e5ae-4422-b26e-85d2f0616d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:21.560959 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-77e07153-e5ae-4422-b26e-85d2f0616d97 None None] MFA Rules not processed for user `ecda46a987dd4866a84dfd4be69b2fe2`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:38:21.563430 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-77e07153-e5ae-4422-b26e-85d2f0616d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:21.701971 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1421/2833] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:38:21 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:38:21.757421 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2363e49-a3c2-4e77-90e2-3a122bb10875 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:21.760954 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-f2363e49-a3c2-4e77-90e2-3a122bb10875 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:21.843500 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e07153-e5ae-4422-b26e-85d2f0616d97 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:21.846268 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-77e07153-e5ae-4422-b26e-85d2f0616d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:21.878405 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2363e49-a3c2-4e77-90e2-3a122bb10875 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:21.884508 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f38c01-435a-4471-881b-ad8cfc0bceb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:21.886271 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f38c01-435a-4471-881b-ad8cfc0bceb9 service cinder] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:21.887018 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f38c01-435a-4471-881b-ad8cfc0bceb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:21.887633 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f38c01-435a-4471-881b-ad8cfc0bceb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:21.901861 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f38c01-435a-4471-881b-ad8cfc0bceb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:21.904002 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f38c01-435a-4471-881b-ad8cfc0bceb9 service cinder] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:21.928845 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1413/2834] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:38:21 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:38:21.954628 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f38c01-435a-4471-881b-ad8cfc0bceb9 service cinder] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:21.960627 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:22.002147 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e07153-e5ae-4422-b26e-85d2f0616d97 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:22.009200 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a269c-6135-4531-935f-c6c5e8db4dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:22.010294 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a269c-6135-4531-935f-c6c5e8db4dca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:22.010875 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a269c-6135-4531-935f-c6c5e8db4dca admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:22.011065 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a269c-6135-4531-935f-c6c5e8db4dca admin admin] PATH_INFO: `/v3/projects/a03aefcf7f894cbbbfdb50ee3b7f3442` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:22.012454 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298a269c-6135-4531-935f-c6c5e8db4dca admin admin] RBAC: Authorizing `identity:delete_project(project_id=a03aefcf7f894cbbbfdb50ee3b7f3442)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:22.014675 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298a269c-6135-4531-935f-c6c5e8db4dca admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:22.070438 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f38c01-435a-4471-881b-ad8cfc0bceb9 service cinder] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:22.079092 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9e28ab-dd09-4e86-b5e7-b585ae700aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:22.080267 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e28ab-dd09-4e86-b5e7-b585ae700aec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:22.080707 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e28ab-dd09-4e86-b5e7-b585ae700aec admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:22.081243 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e28ab-dd09-4e86-b5e7-b585ae700aec admin admin] PATH_INFO: `/v3/users/ecda46a987dd4866a84dfd4be69b2fe2` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:22.083375 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9e28ab-dd09-4e86-b5e7-b585ae700aec admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecda46a987dd4866a84dfd4be69b2fe2)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:22.087143 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9e28ab-dd09-4e86-b5e7-b585ae700aec admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:22.104835 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-298a269c-6135-4531-935f-c6c5e8db4dca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a03aefcf7f894cbbbfdb50ee3b7f3442', 'request_id': 'req-298a269c-6135-4531-935f-c6c5e8db4dca'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:22.116962 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-298a269c-6135-4531-935f-c6c5e8db4dca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a03aefcf7f894cbbbfdb50ee3b7f3442', 'request_id': 'req-298a269c-6135-4531-935f-c6c5e8db4dca'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:22.128795 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-298a269c-6135-4531-935f-c6c5e8db4dca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a03aefcf7f894cbbbfdb50ee3b7f3442', 'request_id': 'req-298a269c-6135-4531-935f-c6c5e8db4dca'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:22.149307 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:22.153756 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-298a269c-6135-4531-935f-c6c5e8db4dca admin admin] The token cache is being invalidate because project a03aefcf7f894cbbbfdb50ee3b7f3442 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:38:22.154707 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-298a269c-6135-4531-935f-c6c5e8db4dca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:22.156658 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-298a269c-6135-4531-935f-c6c5e8db4dca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:22.164211 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1422/2835] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:38:21 2022] DELETE /identity/v3/projects/a03aefcf7f894cbbbfdb50ee3b7f3442 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:38:22.166377 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-2e9e28ab-dd09-4e86-b5e7-b585ae700aec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecda46a987dd4866a84dfd4be69b2fe2'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:22.167162 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-2e9e28ab-dd09-4e86-b5e7-b585ae700aec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecda46a987dd4866a84dfd4be69b2fe2'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:22.167314 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a269c-6135-4531-935f-c6c5e8db4dca admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:22.168016 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-2e9e28ab-dd09-4e86-b5e7-b585ae700aec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecda46a987dd4866a84dfd4be69b2fe2'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:22.170398 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-298a269c-6135-4531-935f-c6c5e8db4dca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:22.179743 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-2e9e28ab-dd09-4e86-b5e7-b585ae700aec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecda46a987dd4866a84dfd4be69b2fe2'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:22.199200 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-2e9e28ab-dd09-4e86-b5e7-b585ae700aec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecda46a987dd4866a84dfd4be69b2fe2'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:22.217156 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1414/2836] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:38:21 2022] DELETE /identity/v3/users/ecda46a987dd4866a84dfd4be69b2fe2 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:38:22.223955 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2725792-bec5-4a68-b9e3-f7524c038c11 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:22.224463 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2725792-bec5-4a68-b9e3-f7524c038c11 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:22.224913 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2725792-bec5-4a68-b9e3-f7524c038c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:22.245731 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-b2725792-bec5-4a68-b9e3-f7524c038c11 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:38:22.247474 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-b2725792-bec5-4a68-b9e3-f7524c038c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:22.295814 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a269c-6135-4531-935f-c6c5e8db4dca admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:22.354453 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1415/2837] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:38:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:38:22.368796 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2725792-bec5-4a68-b9e3-f7524c038c11 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:22.370664 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-b2725792-bec5-4a68-b9e3-f7524c038c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:22.380550 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7395835-8819-4d8a-a7df-24add3a89c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:22.381431 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7395835-8819-4d8a-a7df-24add3a89c14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:22.381821 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7395835-8819-4d8a-a7df-24add3a89c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:22.382272 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7395835-8819-4d8a-a7df-24add3a89c14 admin admin] PATH_INFO: `/v3/users/700a61b50fe84ab6898dd03ad9e36e30` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:22.383794 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7395835-8819-4d8a-a7df-24add3a89c14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=700a61b50fe84ab6898dd03ad9e36e30)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:22.386082 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7395835-8819-4d8a-a7df-24add3a89c14 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:22.403499 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:22.457223 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2725792-bec5-4a68-b9e3-f7524c038c11 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:22.459092 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-f7395835-8819-4d8a-a7df-24add3a89c14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '700a61b50fe84ab6898dd03ad9e36e30'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:22.463028 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc3f7c-92cf-4b42-990b-ea5792d48bad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:22.464014 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc3f7c-92cf-4b42-990b-ea5792d48bad service neutron] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:22.464366 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc3f7c-92cf-4b42-990b-ea5792d48bad service neutron] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:22.464686 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc3f7c-92cf-4b42-990b-ea5792d48bad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:22.469669 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-f7395835-8819-4d8a-a7df-24add3a89c14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '700a61b50fe84ab6898dd03ad9e36e30'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:22.477661 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bc3f7c-92cf-4b42-990b-ea5792d48bad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:22.479978 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bc3f7c-92cf-4b42-990b-ea5792d48bad service neutron] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:22.481885 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-f7395835-8819-4d8a-a7df-24add3a89c14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '700a61b50fe84ab6898dd03ad9e36e30'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:22.483132 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-f7395835-8819-4d8a-a7df-24add3a89c14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '700a61b50fe84ab6898dd03ad9e36e30'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:22.494515 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1416/2838] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:38:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:38:22.499689 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-f7395835-8819-4d8a-a7df-24add3a89c14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '700a61b50fe84ab6898dd03ad9e36e30'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:22.506932 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1423/2839] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:38:22 2022] DELETE /identity/v3/users/700a61b50fe84ab6898dd03ad9e36e30 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:38:22.938534 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc3f7c-92cf-4b42-990b-ea5792d48bad service neutron] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:22.941398 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-b0bc3f7c-92cf-4b42-990b-ea5792d48bad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:22.958588 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc3f7c-92cf-4b42-990b-ea5792d48bad service neutron] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:23.005867 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7395835-8819-4d8a-a7df-24add3a89c14 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:23.007421 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-f7395835-8819-4d8a-a7df-24add3a89c14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:23.060484 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:23.079149 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb4a94-8523-41b4-92f3-9e37d5788bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:23.080394 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb4a94-8523-41b4-92f3-9e37d5788bab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:23.081027 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb4a94-8523-41b4-92f3-9e37d5788bab admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:23.081527 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb4a94-8523-41b4-92f3-9e37d5788bab admin admin] PATH_INFO: `/v3/projects/99b1e6c36c91400f87f7c2ea08bab924` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:23.084234 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccb4a94-8523-41b4-92f3-9e37d5788bab admin admin] RBAC: Authorizing `identity:delete_project(project_id=99b1e6c36c91400f87f7c2ea08bab924)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:23.087321 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccb4a94-8523-41b4-92f3-9e37d5788bab admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:23.116960 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7395835-8819-4d8a-a7df-24add3a89c14 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:23.123525 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25dd4c8-1ed0-4ce0-9b4e-236806b96322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:23.124526 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25dd4c8-1ed0-4ce0-9b4e-236806b96322 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:23.124934 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25dd4c8-1ed0-4ce0-9b4e-236806b96322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:23.125365 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25dd4c8-1ed0-4ce0-9b4e-236806b96322 admin admin] PATH_INFO: `/v3/projects/a7aad5136b74459896f67d3c0c16cf48` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:23.126836 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25dd4c8-1ed0-4ce0-9b4e-236806b96322 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7aad5136b74459896f67d3c0c16cf48)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:23.130242 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25dd4c8-1ed0-4ce0-9b4e-236806b96322 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:23.188202 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-bccb4a94-8523-41b4-92f3-9e37d5788bab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99b1e6c36c91400f87f7c2ea08bab924', 'request_id': 'req-bccb4a94-8523-41b4-92f3-9e37d5788bab'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:23.199117 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-bccb4a94-8523-41b4-92f3-9e37d5788bab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99b1e6c36c91400f87f7c2ea08bab924', 'request_id': 'req-bccb4a94-8523-41b4-92f3-9e37d5788bab'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:23.209805 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-bccb4a94-8523-41b4-92f3-9e37d5788bab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99b1e6c36c91400f87f7c2ea08bab924', 'request_id': 'req-bccb4a94-8523-41b4-92f3-9e37d5788bab'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:23.216812 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-e25dd4c8-1ed0-4ce0-9b4e-236806b96322 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7aad5136b74459896f67d3c0c16cf48', 'request_id': 'req-e25dd4c8-1ed0-4ce0-9b4e-236806b96322'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:23.223157 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-bccb4a94-8523-41b4-92f3-9e37d5788bab admin admin] The token cache is being invalidate because project 99b1e6c36c91400f87f7c2ea08bab924 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:38:23.223453 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-bccb4a94-8523-41b4-92f3-9e37d5788bab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:23.224264 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-bccb4a94-8523-41b4-92f3-9e37d5788bab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:23.225818 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1417/2840] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:38:22 2022] DELETE /identity/v3/projects/99b1e6c36c91400f87f7c2ea08bab924 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:38:23.232488 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91848486-3f36-47c0-9b15-f4874c5ea66e None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:23.232785 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91848486-3f36-47c0-9b15-f4874c5ea66e None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:23.232991 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91848486-3f36-47c0-9b15-f4874c5ea66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:23.235535 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-e25dd4c8-1ed0-4ce0-9b4e-236806b96322 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7aad5136b74459896f67d3c0c16cf48', 'request_id': 'req-e25dd4c8-1ed0-4ce0-9b4e-236806b96322'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:23.257357 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-91848486-3f36-47c0-9b15-f4874c5ea66e None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:38:23.258909 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-91848486-3f36-47c0-9b15-f4874c5ea66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:23.259371 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-e25dd4c8-1ed0-4ce0-9b4e-236806b96322 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7aad5136b74459896f67d3c0c16cf48', 'request_id': 'req-e25dd4c8-1ed0-4ce0-9b4e-236806b96322'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:23.285597 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-e25dd4c8-1ed0-4ce0-9b4e-236806b96322 admin admin] The token cache is being invalidate because project a7aad5136b74459896f67d3c0c16cf48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:38:23.286087 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-e25dd4c8-1ed0-4ce0-9b4e-236806b96322 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:23.287608 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-e25dd4c8-1ed0-4ce0-9b4e-236806b96322 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:23.289544 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1424/2841] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:38:23 2022] DELETE /identity/v3/projects/a7aad5136b74459896f67d3c0c16cf48 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:38:23.295310 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25dd4c8-1ed0-4ce0-9b4e-236806b96322 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:23.297665 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-e25dd4c8-1ed0-4ce0-9b4e-236806b96322 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:23.332351 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:23.361426 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1418/2842] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:38:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:38:23.405768 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25dd4c8-1ed0-4ce0-9b4e-236806b96322 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:23.412390 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3ae75-9b39-40a9-b7fa-4aff46ec4a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:23.413289 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3ae75-9b39-40a9-b7fa-4aff46ec4a78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:23.413879 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3ae75-9b39-40a9-b7fa-4aff46ec4a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:23.414329 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3ae75-9b39-40a9-b7fa-4aff46ec4a78 admin admin] PATH_INFO: `/v3/users/5581b25a98b142e39971d4d83833692e` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:23.416075 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d3ae75-9b39-40a9-b7fa-4aff46ec4a78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5581b25a98b142e39971d4d83833692e)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:23.419632 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d3ae75-9b39-40a9-b7fa-4aff46ec4a78 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:23.485659 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72123e-d830-406d-a8b6-43abf8e21689 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:23.486547 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72123e-d830-406d-a8b6-43abf8e21689 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:23.486547 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72123e-d830-406d-a8b6-43abf8e21689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:23.518065 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-0b72123e-d830-406d-a8b6-43abf8e21689 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:38:23.518404 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-68d3ae75-9b39-40a9-b7fa-4aff46ec4a78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5581b25a98b142e39971d4d83833692e'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:23.520516 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-0b72123e-d830-406d-a8b6-43abf8e21689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:23.534873 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1419/2843] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:38:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:38:23.535171 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-68d3ae75-9b39-40a9-b7fa-4aff46ec4a78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5581b25a98b142e39971d4d83833692e'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:23.541827 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b72123e-d830-406d-a8b6-43abf8e21689 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:23.542400 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:23.561442 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b72123e-d830-406d-a8b6-43abf8e21689 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:23.562523 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-68d3ae75-9b39-40a9-b7fa-4aff46ec4a78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5581b25a98b142e39971d4d83833692e'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:23.564103 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-68d3ae75-9b39-40a9-b7fa-4aff46ec4a78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5581b25a98b142e39971d4d83833692e'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:23.571025 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38542dd-e160-46b2-a625-6d7db159dda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:23.571694 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38542dd-e160-46b2-a625-6d7db159dda3 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:23.572201 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38542dd-e160-46b2-a625-6d7db159dda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:23.572515 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38542dd-e160-46b2-a625-6d7db159dda3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:23.573220 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38542dd-e160-46b2-a625-6d7db159dda3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:38:23.573533 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38542dd-e160-46b2-a625-6d7db159dda3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:23.575606 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38542dd-e160-46b2-a625-6d7db159dda3 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:23.595102 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-68d3ae75-9b39-40a9-b7fa-4aff46ec4a78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5581b25a98b142e39971d4d83833692e'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:23.598910 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1420/2844] 10.222.0.91 () {58 vars in 1153 bytes} [Tue Aug 30 04:38:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:38:23.604522 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38542dd-e160-46b2-a625-6d7db159dda3 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:23.607852 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-f38542dd-e160-46b2-a625-6d7db159dda3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:23.610234 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1425/2845] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:38:23 2022] DELETE /identity/v3/users/5581b25a98b142e39971d4d83833692e => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:38:23.635990 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38542dd-e160-46b2-a625-6d7db159dda3 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:23.777684 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d4052d-77de-4a0c-91bc-cb031bab8b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:23.778458 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d4052d-77de-4a0c-91bc-cb031bab8b42 admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:23.778774 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d4052d-77de-4a0c-91bc-cb031bab8b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:23.779129 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d4052d-77de-4a0c-91bc-cb031bab8b42 admin admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:23.780404 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d4052d-77de-4a0c-91bc-cb031bab8b42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:23.782723 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d4052d-77de-4a0c-91bc-cb031bab8b42 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:23.822346 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1421/2846] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:38:23 2022] POST /identity/v3/projects => generated 371 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:38:23.826353 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3ae75-9b39-40a9-b7fa-4aff46ec4a78 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:23.842276 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3ae75-9b39-40a9-b7fa-4aff46ec4a78 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:23.991288 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed4e5af-b7d4-47c0-9fd0-ba56a09abd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:23.992292 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4e5af-b7d4-47c0-9fd0-ba56a09abd31 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:23.992792 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4e5af-b7d4-47c0-9fd0-ba56a09abd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:23.993340 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4e5af-b7d4-47c0-9fd0-ba56a09abd31 admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:23.995792 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed4e5af-b7d4-47c0-9fd0-ba56a09abd31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:24.000954 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed4e5af-b7d4-47c0-9fd0-ba56a09abd31 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:24.053511 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1426/2847] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:38:23 2022] POST /identity/v3/users => generated 286 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:38:24.056319 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d4052d-77de-4a0c-91bc-cb031bab8b42 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:24.093894 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d4052d-77de-4a0c-91bc-cb031bab8b42 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:24.103999 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6553563-ee79-438f-9619-25a0a6abe2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:24.105445 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6553563-ee79-438f-9619-25a0a6abe2c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:24.105997 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6553563-ee79-438f-9619-25a0a6abe2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:24.106614 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6553563-ee79-438f-9619-25a0a6abe2c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:24.107862 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6553563-ee79-438f-9619-25a0a6abe2c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:24.110000 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6553563-ee79-438f-9619-25a0a6abe2c8 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:24.127605 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1422/2848] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:38:24.134302 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed4e5af-b7d4-47c0-9fd0-ba56a09abd31 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:24.139402 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6553563-ee79-438f-9619-25a0a6abe2c8 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:24.141973 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-e6553563-ee79-438f-9619-25a0a6abe2c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:24.159265 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed4e5af-b7d4-47c0-9fd0-ba56a09abd31 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:24.161148 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6553563-ee79-438f-9619-25a0a6abe2c8 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:24.168194 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc6ae7c-40a2-4ee8-bc93-2e0307218f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:24.169235 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6ae7c-40a2-4ee8-bc93-2e0307218f45 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:24.170078 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6ae7c-40a2-4ee8-bc93-2e0307218f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:24.170761 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6ae7c-40a2-4ee8-bc93-2e0307218f45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:24.172366 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc6ae7c-40a2-4ee8-bc93-2e0307218f45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:24.174655 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc6ae7c-40a2-4ee8-bc93-2e0307218f45 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:24.176485 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdd684c-2663-44a6-88cc-2b68d6a6b6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:24.177202 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd684c-2663-44a6-88cc-2b68d6a6b6e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:24.177678 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd684c-2663-44a6-88cc-2b68d6a6b6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:24.178443 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd684c-2663-44a6-88cc-2b68d6a6b6e4 admin admin] PATH_INFO: `/v3/projects/babf3fb68a924e13859565d272125f13` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:24.195545 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdd684c-2663-44a6-88cc-2b68d6a6b6e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=babf3fb68a924e13859565d272125f13)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:24.198588 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1427/2849] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:38:24.198844 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdd684c-2663-44a6-88cc-2b68d6a6b6e4 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:24.203177 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc6ae7c-40a2-4ee8-bc93-2e0307218f45 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:24.218093 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc6ae7c-40a2-4ee8-bc93-2e0307218f45 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:24.225022 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70143dfe-8222-4526-a367-668d512f243b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:24.226187 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70143dfe-8222-4526-a367-668d512f243b admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:24.226639 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70143dfe-8222-4526-a367-668d512f243b admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:24.227166 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70143dfe-8222-4526-a367-668d512f243b admin admin] PATH_INFO: `/v3/projects/58665b263db6404db00452ce21f64e5c/users/8838b3668f844eefa85ab3234c3a10f7/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:24.254895 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70143dfe-8222-4526-a367-668d512f243b admin admin] RBAC: Authorizing `identity:create_grant(project_id=58665b263db6404db00452ce21f64e5c, user_id=8838b3668f844eefa85ab3234c3a10f7, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:24.258715 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70143dfe-8222-4526-a367-668d512f243b admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:24.282224 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1428/2850] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:38:24 2022] PUT /identity/v3/projects/58665b263db6404db00452ce21f64e5c/users/8838b3668f844eefa85ab3234c3a10f7/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:38:24.291903 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-dbdd684c-2663-44a6-88cc-2b68d6a6b6e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'babf3fb68a924e13859565d272125f13', 'request_id': 'req-dbdd684c-2663-44a6-88cc-2b68d6a6b6e4'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:24.295240 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56a255-07c1-4b2d-a041-84f4e484cf99 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:24.295545 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56a255-07c1-4b2d-a041-84f4e484cf99 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:24.295772 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56a255-07c1-4b2d-a041-84f4e484cf99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:24.307845 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-dbdd684c-2663-44a6-88cc-2b68d6a6b6e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'babf3fb68a924e13859565d272125f13', 'request_id': 'req-dbdd684c-2663-44a6-88cc-2b68d6a6b6e4'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:24.323022 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-dbdd684c-2663-44a6-88cc-2b68d6a6b6e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'babf3fb68a924e13859565d272125f13', 'request_id': 'req-dbdd684c-2663-44a6-88cc-2b68d6a6b6e4'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:24.343757 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-dbdd684c-2663-44a6-88cc-2b68d6a6b6e4 admin admin] The token cache is being invalidate because project babf3fb68a924e13859565d272125f13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:38:24.345789 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-3c56a255-07c1-4b2d-a041-84f4e484cf99 None None] MFA Rules not processed for user `8838b3668f844eefa85ab3234c3a10f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:38:24.347955 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-3c56a255-07c1-4b2d-a041-84f4e484cf99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:24.350233 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-dbdd684c-2663-44a6-88cc-2b68d6a6b6e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:24.351375 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-dbdd684c-2663-44a6-88cc-2b68d6a6b6e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:24.354129 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1423/2851] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:38:24 2022] DELETE /identity/v3/projects/babf3fb68a924e13859565d272125f13 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:38:24.367078 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12108db7-49f6-4f78-9899-59b8d98bc3a6 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:24.367425 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12108db7-49f6-4f78-9899-59b8d98bc3a6 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:24.367797 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12108db7-49f6-4f78-9899-59b8d98bc3a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:24.407870 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-12108db7-49f6-4f78-9899-59b8d98bc3a6 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:38:24.410856 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-12108db7-49f6-4f78-9899-59b8d98bc3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:24.478136 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1429/2852] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:38:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:38:24.486265 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:24.496001 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c56a255-07c1-4b2d-a041-84f4e484cf99 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:24.498179 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-3c56a255-07c1-4b2d-a041-84f4e484cf99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:24.560074 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:24.563987 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1424/2853] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:38:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:38:24.580299 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ddfc9-f532-4ea0-b9e5-590c4cb06d07 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:24.580755 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ddfc9-f532-4ea0-b9e5-590c4cb06d07 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:24.581344 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ddfc9-f532-4ea0-b9e5-590c4cb06d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:24.606299 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-6b1ddfc9-f532-4ea0-b9e5-590c4cb06d07 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:38:24.607543 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-6b1ddfc9-f532-4ea0-b9e5-590c4cb06d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:24.618509 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1425/2854] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:38:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:38:24.625088 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ddfc9-f532-4ea0-b9e5-590c4cb06d07 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:24.637995 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c56a255-07c1-4b2d-a041-84f4e484cf99 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:24.642599 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ddfc9-f532-4ea0-b9e5-590c4cb06d07 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:24.642883 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129b8b2-8696-4819-b8a6-2f6c36ae61b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:24.644001 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129b8b2-8696-4819-b8a6-2f6c36ae61b1 service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:24.644374 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129b8b2-8696-4819-b8a6-2f6c36ae61b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:24.645144 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129b8b2-8696-4819-b8a6-2f6c36ae61b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:24.650208 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb371263-775d-4308-94c4-5c81e90ef60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:24.650951 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb371263-775d-4308-94c4-5c81e90ef60a admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:24.651334 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb371263-775d-4308-94c4-5c81e90ef60a admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:24.651705 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb371263-775d-4308-94c4-5c81e90ef60a admin admin] PATH_INFO: `/v3/domains` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:24.653017 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb371263-775d-4308-94c4-5c81e90ef60a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:38:24.653456 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb371263-775d-4308-94c4-5c81e90ef60a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:24.656509 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb371263-775d-4308-94c4-5c81e90ef60a admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:24.658077 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5129b8b2-8696-4819-b8a6-2f6c36ae61b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:24.660132 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5129b8b2-8696-4819-b8a6-2f6c36ae61b1 service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:24.676202 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1426/2855] 10.222.0.91 () {58 vars in 1153 bytes} [Tue Aug 30 04:38:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:38:24.676745 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1430/2856] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:38:24 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:38:24.678854 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb371263-775d-4308-94c4-5c81e90ef60a admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:24.697479 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb371263-775d-4308-94c4-5c81e90ef60a admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:24.704582 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c73056-c142-4cff-983a-e62bd32fcb0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:24.705638 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c73056-c142-4cff-983a-e62bd32fcb0d admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:24.707165 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c73056-c142-4cff-983a-e62bd32fcb0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:24.707680 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c73056-c142-4cff-983a-e62bd32fcb0d admin admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:24.708924 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c73056-c142-4cff-983a-e62bd32fcb0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:24.712473 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c73056-c142-4cff-983a-e62bd32fcb0d admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:24.767165 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1427/2857] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:38:24 2022] POST /identity/v3/projects => generated 385 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:38:24.774108 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129b8b2-8696-4819-b8a6-2f6c36ae61b1 service cinder] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:24.810572 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129b8b2-8696-4819-b8a6-2f6c36ae61b1 service cinder] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:24.943944 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018984e6-5299-4ca9-b438-6b92eb930ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:24.945032 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018984e6-5299-4ca9-b438-6b92eb930ec9 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:24.945414 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018984e6-5299-4ca9-b438-6b92eb930ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:24.947205 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018984e6-5299-4ca9-b438-6b92eb930ec9 admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:24.947205 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018984e6-5299-4ca9-b438-6b92eb930ec9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:24.951493 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018984e6-5299-4ca9-b438-6b92eb930ec9 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:24.991984 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1431/2858] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:38:24 2022] POST /identity/v3/users => generated 293 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:38:24.997414 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c73056-c142-4cff-983a-e62bd32fcb0d admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:25.018443 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c73056-c142-4cff-983a-e62bd32fcb0d admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:25.028086 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5cb05d-5ad8-4fa6-a474-5a959c0d4e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:25.029489 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5cb05d-5ad8-4fa6-a474-5a959c0d4e7c admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:25.029940 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5cb05d-5ad8-4fa6-a474-5a959c0d4e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:25.030393 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5cb05d-5ad8-4fa6-a474-5a959c0d4e7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:25.031523 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5cb05d-5ad8-4fa6-a474-5a959c0d4e7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:25.034737 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5cb05d-5ad8-4fa6-a474-5a959c0d4e7c admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:25.051461 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1428/2859] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:38:25.056211 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018984e6-5299-4ca9-b438-6b92eb930ec9 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:25.068236 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018984e6-5299-4ca9-b438-6b92eb930ec9 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:25.076178 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e8443d-8065-41c9-89ca-251ff8df7515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:25.077489 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8443d-8065-41c9-89ca-251ff8df7515 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:25.077955 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8443d-8065-41c9-89ca-251ff8df7515 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:25.078463 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8443d-8065-41c9-89ca-251ff8df7515 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:25.080151 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e8443d-8065-41c9-89ca-251ff8df7515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:25.083665 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e8443d-8065-41c9-89ca-251ff8df7515 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:25.114719 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1432/2860] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:38:25.123196 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5cb05d-5ad8-4fa6-a474-5a959c0d4e7c admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:25.149711 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5cb05d-5ad8-4fa6-a474-5a959c0d4e7c admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:25.179002 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73749e08-0146-4fc6-aca2-36a80c5c1f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:25.180631 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73749e08-0146-4fc6-aca2-36a80c5c1f65 admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:25.181110 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73749e08-0146-4fc6-aca2-36a80c5c1f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:25.181974 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73749e08-0146-4fc6-aca2-36a80c5c1f65 admin admin] PATH_INFO: `/v3/projects/def7e1c094e84718a81f6542a68ed20e/users/fa01b019e0d341e8a3156f9471e0b512/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:25.221314 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73749e08-0146-4fc6-aca2-36a80c5c1f65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=def7e1c094e84718a81f6542a68ed20e, user_id=fa01b019e0d341e8a3156f9471e0b512, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:25.228456 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73749e08-0146-4fc6-aca2-36a80c5c1f65 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:25.255260 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1429/2861] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:38:25 2022] PUT /identity/v3/projects/def7e1c094e84718a81f6542a68ed20e/users/fa01b019e0d341e8a3156f9471e0b512/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:38:25.271162 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ad4cb-d086-42ef-920d-1a4e5e97ad80 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:25.271397 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ad4cb-d086-42ef-920d-1a4e5e97ad80 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:25.271603 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ad4cb-d086-42ef-920d-1a4e5e97ad80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:25.308552 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-344ad4cb-d086-42ef-920d-1a4e5e97ad80 None None] MFA Rules not processed for user `fa01b019e0d341e8a3156f9471e0b512`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:38:25.309838 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-344ad4cb-d086-42ef-920d-1a4e5e97ad80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:25.402667 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1433/2862] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:38:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:38:25.408496 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73749e08-0146-4fc6-aca2-36a80c5c1f65 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:25.499789 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73749e08-0146-4fc6-aca2-36a80c5c1f65 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:25.505501 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f748687-123c-4fd9-85fd-439a4935d061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:25.506152 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f748687-123c-4fd9-85fd-439a4935d061 admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:25.506423 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f748687-123c-4fd9-85fd-439a4935d061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:25.506688 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f748687-123c-4fd9-85fd-439a4935d061 admin admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:25.507336 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f748687-123c-4fd9-85fd-439a4935d061 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:25.509329 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f748687-123c-4fd9-85fd-439a4935d061 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:25.541893 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1430/2863] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:38:25 2022] POST /identity/v3/projects => generated 383 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:38:25.546405 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ad4cb-d086-42ef-920d-1a4e5e97ad80 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:25.561984 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ad4cb-d086-42ef-920d-1a4e5e97ad80 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:25.610366 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:25.652719 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202df102-7729-465d-bff7-71a98d949d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:25.653592 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202df102-7729-465d-bff7-71a98d949d6d admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:25.653961 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202df102-7729-465d-bff7-71a98d949d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:25.654353 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202df102-7729-465d-bff7-71a98d949d6d admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:25.655328 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202df102-7729-465d-bff7-71a98d949d6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:25.657554 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202df102-7729-465d-bff7-71a98d949d6d admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:25.685023 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1434/2864] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:38:25 2022] POST /identity/v3/users => generated 292 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:38:25.690181 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f748687-123c-4fd9-85fd-439a4935d061 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:25.703116 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f748687-123c-4fd9-85fd-439a4935d061 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:25.709693 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a823567f-05b5-475e-ab97-2a26a3febb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:25.710299 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823567f-05b5-475e-ab97-2a26a3febb6c admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:25.710573 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823567f-05b5-475e-ab97-2a26a3febb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:25.710841 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823567f-05b5-475e-ab97-2a26a3febb6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:25.711495 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a823567f-05b5-475e-ab97-2a26a3febb6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:25.713271 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a823567f-05b5-475e-ab97-2a26a3febb6c admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:25.725803 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1431/2865] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:38:25.732635 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202df102-7729-465d-bff7-71a98d949d6d admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:25.752048 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202df102-7729-465d-bff7-71a98d949d6d admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:25.759159 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ebb58a-ad78-4d79-b0ab-e07a12d82aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:25.759896 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ebb58a-ad78-4d79-b0ab-e07a12d82aab admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:25.760284 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ebb58a-ad78-4d79-b0ab-e07a12d82aab admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:25.760619 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ebb58a-ad78-4d79-b0ab-e07a12d82aab admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:25.761337 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ebb58a-ad78-4d79-b0ab-e07a12d82aab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:25.763947 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ebb58a-ad78-4d79-b0ab-e07a12d82aab admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:25.777071 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1435/2866] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:38:25.781862 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a823567f-05b5-475e-ab97-2a26a3febb6c admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:25.797488 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a823567f-05b5-475e-ab97-2a26a3febb6c admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:25.806045 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d801c8-23da-4f08-b856-74f5cd87d095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:25.807195 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d801c8-23da-4f08-b856-74f5cd87d095 admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:25.807682 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d801c8-23da-4f08-b856-74f5cd87d095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:25.808200 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d801c8-23da-4f08-b856-74f5cd87d095 admin admin] PATH_INFO: `/v3/projects/7dbe6c172fb64015bc28b07c46468dac/users/dd810fd20b6f4ea7a3c4185bc62713bf/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:25.830211 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d801c8-23da-4f08-b856-74f5cd87d095 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dbe6c172fb64015bc28b07c46468dac, user_id=dd810fd20b6f4ea7a3c4185bc62713bf, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:25.834094 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d801c8-23da-4f08-b856-74f5cd87d095 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:25.851839 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1432/2867] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:38:25 2022] PUT /identity/v3/projects/7dbe6c172fb64015bc28b07c46468dac/users/dd810fd20b6f4ea7a3c4185bc62713bf/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:38:25.864362 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db3795-2644-4f33-9e77-dbb01440a9b0 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:25.864673 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db3795-2644-4f33-9e77-dbb01440a9b0 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:25.865084 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db3795-2644-4f33-9e77-dbb01440a9b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:25.902065 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-24db3795-2644-4f33-9e77-dbb01440a9b0 None None] MFA Rules not processed for user `dd810fd20b6f4ea7a3c4185bc62713bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:38:25.903346 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-24db3795-2644-4f33-9e77-dbb01440a9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:26.029870 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1436/2868] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:38:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:38:26.034810 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d801c8-23da-4f08-b856-74f5cd87d095 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:26.050256 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:26.136150 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d801c8-23da-4f08-b856-74f5cd87d095 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:26.141164 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c428576-ca6e-4a72-b499-7c53c4131004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:26.141794 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c428576-ca6e-4a72-b499-7c53c4131004 admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:26.142073 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c428576-ca6e-4a72-b499-7c53c4131004 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:26.142379 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c428576-ca6e-4a72-b499-7c53c4131004 admin admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:26.143602 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c428576-ca6e-4a72-b499-7c53c4131004 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:26.145230 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c428576-ca6e-4a72-b499-7c53c4131004 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:26.186263 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1433/2869] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:38:26 2022] POST /identity/v3/projects => generated 385 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:38:26.193997 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24db3795-2644-4f33-9e77-dbb01440a9b0 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:26.216625 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24db3795-2644-4f33-9e77-dbb01440a9b0 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:26.351280 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62191c91-b313-4e9d-a9ec-eae02feb4430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:26.351980 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62191c91-b313-4e9d-a9ec-eae02feb4430 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:26.352266 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62191c91-b313-4e9d-a9ec-eae02feb4430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:26.352545 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62191c91-b313-4e9d-a9ec-eae02feb4430 admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:26.353207 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62191c91-b313-4e9d-a9ec-eae02feb4430 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:26.355834 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62191c91-b313-4e9d-a9ec-eae02feb4430 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:26.390508 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1437/2870] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:38:26 2022] POST /identity/v3/users => generated 299 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:38:26.391982 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c428576-ca6e-4a72-b499-7c53c4131004 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:26.404220 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c428576-ca6e-4a72-b499-7c53c4131004 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:26.409902 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60470a40-aaba-46d6-b8d5-85a1e4d8dd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:26.410789 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60470a40-aaba-46d6-b8d5-85a1e4d8dd08 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:26.411080 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60470a40-aaba-46d6-b8d5-85a1e4d8dd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:26.411637 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60470a40-aaba-46d6-b8d5-85a1e4d8dd08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:26.412355 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60470a40-aaba-46d6-b8d5-85a1e4d8dd08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:26.414027 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60470a40-aaba-46d6-b8d5-85a1e4d8dd08 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:26.429772 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1434/2871] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:38:26.431030 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62191c91-b313-4e9d-a9ec-eae02feb4430 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:26.443071 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62191c91-b313-4e9d-a9ec-eae02feb4430 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:26.448753 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e5a70e-e97b-44c9-a442-0780c9db941a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:26.449819 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5a70e-e97b-44c9-a442-0780c9db941a admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:26.450257 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5a70e-e97b-44c9-a442-0780c9db941a admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:26.450845 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5a70e-e97b-44c9-a442-0780c9db941a admin admin] PATH_INFO: `/v3/projects/863a1cded3b54b629ed731d63f003ee9/users/118ad71c941549009b7095f940f3291f/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:26.469707 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e5a70e-e97b-44c9-a442-0780c9db941a admin admin] RBAC: Authorizing `identity:create_grant(project_id=863a1cded3b54b629ed731d63f003ee9, user_id=118ad71c941549009b7095f940f3291f, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:26.472653 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e5a70e-e97b-44c9-a442-0780c9db941a admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:26.494420 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1438/2872] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:38:26 2022] PUT /identity/v3/projects/863a1cded3b54b629ed731d63f003ee9/users/118ad71c941549009b7095f940f3291f/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:38:26.495702 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60470a40-aaba-46d6-b8d5-85a1e4d8dd08 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:26.507799 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60470a40-aaba-46d6-b8d5-85a1e4d8dd08 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:26.596216 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72335d8-2bcd-4209-886b-5d161135f540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:26.597490 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72335d8-2bcd-4209-886b-5d161135f540 admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:26.597760 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72335d8-2bcd-4209-886b-5d161135f540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:26.598008 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72335d8-2bcd-4209-886b-5d161135f540 admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:26.599037 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72335d8-2bcd-4209-886b-5d161135f540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:26.602694 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72335d8-2bcd-4209-886b-5d161135f540 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:26.615101 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1435/2873] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:38:26.621145 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e5a70e-e97b-44c9-a442-0780c9db941a admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:26.631290 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:26.636801 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e5a70e-e97b-44c9-a442-0780c9db941a admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:26.648527 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702337b3-6f67-4ec6-a7e7-4bdeba3bbb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:26.649235 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702337b3-6f67-4ec6-a7e7-4bdeba3bbb33 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:26.650067 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702337b3-6f67-4ec6-a7e7-4bdeba3bbb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:26.650847 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702337b3-6f67-4ec6-a7e7-4bdeba3bbb33 admin admin] PATH_INFO: `/v3/projects/863a1cded3b54b629ed731d63f003ee9/users/118ad71c941549009b7095f940f3291f/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:26.654407 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702337b3-6f67-4ec6-a7e7-4bdeba3bbb33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=863a1cded3b54b629ed731d63f003ee9, user_id=118ad71c941549009b7095f940f3291f, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:26.660889 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702337b3-6f67-4ec6-a7e7-4bdeba3bbb33 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:26.691371 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1439/2874] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:38:26 2022] PUT /identity/v3/projects/863a1cded3b54b629ed731d63f003ee9/users/118ad71c941549009b7095f940f3291f/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:38:26.709012 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911eaeee-80ea-4999-a53b-4633f858e0cf None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:26.709879 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911eaeee-80ea-4999-a53b-4633f858e0cf None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:26.710665 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911eaeee-80ea-4999-a53b-4633f858e0cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:26.776894 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-911eaeee-80ea-4999-a53b-4633f858e0cf None None] MFA Rules not processed for user `118ad71c941549009b7095f940f3291f`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:38:26.779220 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-911eaeee-80ea-4999-a53b-4633f858e0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:26.920831 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1436/2875] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:38:26 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:38:26.940736 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702337b3-6f67-4ec6-a7e7-4bdeba3bbb33 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:27.040689 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702337b3-6f67-4ec6-a7e7-4bdeba3bbb33 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:27.046849 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6bce8a-4dc9-429e-96ec-61ffc041288a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:27.048222 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6bce8a-4dc9-429e-96ec-61ffc041288a service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:27.048672 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6bce8a-4dc9-429e-96ec-61ffc041288a service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:27.049118 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6bce8a-4dc9-429e-96ec-61ffc041288a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:27.137339 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6bce8a-4dc9-429e-96ec-61ffc041288a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:27.139054 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6bce8a-4dc9-429e-96ec-61ffc041288a service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:27.150664 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1440/2876] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:38:26 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:38:28.185727 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ada45-319d-41a4-8d4f-ff8f0986700f None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:28.186559 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ada45-319d-41a4-8d4f-ff8f0986700f None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:28.186559 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ada45-319d-41a4-8d4f-ff8f0986700f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:28.196333 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:28.213531 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-6f7ada45-319d-41a4-8d4f-ff8f0986700f None None] MFA Rules not processed for user `1bc12faf48984335a3515dcde85b5cb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:38:28.215497 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-6f7ada45-319d-41a4-8d4f-ff8f0986700f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:28.310465 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1437/2877] 10.222.0.91 () {58 vars in 1009 bytes} [Tue Aug 30 04:38:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:38:28.386692 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6bce8a-4dc9-429e-96ec-61ffc041288a service cinder] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:28.388859 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-1f6bce8a-4dc9-429e-96ec-61ffc041288a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:28.488855 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6bce8a-4dc9-429e-96ec-61ffc041288a service cinder] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:28.494854 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d5aee-289b-47a4-871a-b4556e966890 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b50f9552124b07822ae63c1d553864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:28.495617 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d5aee-289b-47a4-871a-b4556e966890 service swift] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:28.495972 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d5aee-289b-47a4-871a-b4556e966890 service swift] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:28.496363 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d5aee-289b-47a4-871a-b4556e966890 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:28.509286 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d5aee-289b-47a4-871a-b4556e966890 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:28.511241 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d5aee-289b-47a4-871a-b4556e966890 service swift] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:28.522795 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1441/2878] 10.222.0.91 () {60 vars in 1384 bytes} [Tue Aug 30 04:38:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:38:28.571704 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ada45-319d-41a4-8d4f-ff8f0986700f None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:28.576495 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-6f7ada45-319d-41a4-8d4f-ff8f0986700f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:28.728264 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ada45-319d-41a4-8d4f-ff8f0986700f None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:28.735607 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea615c11-ac99-45c4-995a-93c90fae9e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:28.737016 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea615c11-ac99-45c4-995a-93c90fae9e44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:28.738458 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea615c11-ac99-45c4-995a-93c90fae9e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:28.738458 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea615c11-ac99-45c4-995a-93c90fae9e44 admin admin] PATH_INFO: `/v3/users/8838b3668f844eefa85ab3234c3a10f7` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:28.740748 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea615c11-ac99-45c4-995a-93c90fae9e44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8838b3668f844eefa85ab3234c3a10f7)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:28.743829 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea615c11-ac99-45c4-995a-93c90fae9e44 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:28.845100 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-ea615c11-ac99-45c4-995a-93c90fae9e44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8838b3668f844eefa85ab3234c3a10f7'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:28.845761 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-ea615c11-ac99-45c4-995a-93c90fae9e44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8838b3668f844eefa85ab3234c3a10f7'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:28.846479 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-ea615c11-ac99-45c4-995a-93c90fae9e44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8838b3668f844eefa85ab3234c3a10f7'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:28.862406 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-ea615c11-ac99-45c4-995a-93c90fae9e44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8838b3668f844eefa85ab3234c3a10f7'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:28.890455 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-ea615c11-ac99-45c4-995a-93c90fae9e44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8838b3668f844eefa85ab3234c3a10f7'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:28.916347 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1438/2879] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:38:28 2022] DELETE /identity/v3/users/8838b3668f844eefa85ab3234c3a10f7 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:38:28.922546 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acca647-d367-4ba6-8b9b-d04c52a7acc0 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:28.923064 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acca647-d367-4ba6-8b9b-d04c52a7acc0 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:28.923064 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acca647-d367-4ba6-8b9b-d04c52a7acc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:28.954527 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-0acca647-d367-4ba6-8b9b-d04c52a7acc0 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:38:28.956646 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-0acca647-d367-4ba6-8b9b-d04c52a7acc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:29.022267 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:29.087579 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1442/2880] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:38:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:38:29.101691 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea615c11-ac99-45c4-995a-93c90fae9e44 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:29.103381 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-ea615c11-ac99-45c4-995a-93c90fae9e44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:29.137870 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acca647-d367-4ba6-8b9b-d04c52a7acc0 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:29.139638 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-0acca647-d367-4ba6-8b9b-d04c52a7acc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:29.152907 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:29.223292 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea615c11-ac99-45c4-995a-93c90fae9e44 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:29.233056 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec39a4-9729-4bdd-a6f5-c789adf09a7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:29.234028 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec39a4-9729-4bdd-a6f5-c789adf09a7b service neutron] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:29.234475 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec39a4-9729-4bdd-a6f5-c789adf09a7b service neutron] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:29.234919 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec39a4-9729-4bdd-a6f5-c789adf09a7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:29.253077 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec39a4-9729-4bdd-a6f5-c789adf09a7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:29.258215 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec39a4-9729-4bdd-a6f5-c789adf09a7b service neutron] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:29.271953 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acca647-d367-4ba6-8b9b-d04c52a7acc0 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:29.280079 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1439/2881] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:38:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:38:29.281591 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42f1240-b215-4ab6-953a-821f1547684d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:29.282733 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f1240-b215-4ab6-953a-821f1547684d service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:29.283308 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f1240-b215-4ab6-953a-821f1547684d service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:29.283776 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f1240-b215-4ab6-953a-821f1547684d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:29.287714 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-f42f1240-b215-4ab6-953a-821f1547684d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:29.411977 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42f1240-b215-4ab6-953a-821f1547684d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:29.414771 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42f1240-b215-4ab6-953a-821f1547684d service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:29.438510 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1443/2882] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:38:29 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:38:29.918496 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec39a4-9729-4bdd-a6f5-c789adf09a7b service neutron] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:29.921284 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-d6ec39a4-9729-4bdd-a6f5-c789adf09a7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:29.964502 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec39a4-9729-4bdd-a6f5-c789adf09a7b service neutron] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:29.985851 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440ce080-9277-48e3-98bf-d4dc0084bb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:30.003773 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ce080-9277-48e3-98bf-d4dc0084bb5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:30.004754 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ce080-9277-48e3-98bf-d4dc0084bb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:30.006389 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ce080-9277-48e3-98bf-d4dc0084bb5c admin admin] PATH_INFO: `/v3/projects/58665b263db6404db00452ce21f64e5c` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:30.009426 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440ce080-9277-48e3-98bf-d4dc0084bb5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=58665b263db6404db00452ce21f64e5c)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:30.014038 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440ce080-9277-48e3-98bf-d4dc0084bb5c admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:30.231628 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-440ce080-9277-48e3-98bf-d4dc0084bb5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58665b263db6404db00452ce21f64e5c', 'request_id': 'req-440ce080-9277-48e3-98bf-d4dc0084bb5c'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:30.247172 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-440ce080-9277-48e3-98bf-d4dc0084bb5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58665b263db6404db00452ce21f64e5c', 'request_id': 'req-440ce080-9277-48e3-98bf-d4dc0084bb5c'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:30.285649 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-440ce080-9277-48e3-98bf-d4dc0084bb5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58665b263db6404db00452ce21f64e5c', 'request_id': 'req-440ce080-9277-48e3-98bf-d4dc0084bb5c'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:30.316328 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-440ce080-9277-48e3-98bf-d4dc0084bb5c admin admin] The token cache is being invalidate because project 58665b263db6404db00452ce21f64e5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:38:30.317406 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-440ce080-9277-48e3-98bf-d4dc0084bb5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:30.319484 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-440ce080-9277-48e3-98bf-d4dc0084bb5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:30.323794 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1440/2883] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:38:29 2022] DELETE /identity/v3/projects/58665b263db6404db00452ce21f64e5c => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:38:30.330833 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc761427-f584-4432-918b-7bc9e9ed7dbf None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:30.331734 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc761427-f584-4432-918b-7bc9e9ed7dbf None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:30.332052 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc761427-f584-4432-918b-7bc9e9ed7dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:30.366848 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-fc761427-f584-4432-918b-7bc9e9ed7dbf None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:38:30.368246 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-fc761427-f584-4432-918b-7bc9e9ed7dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:30.508580 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1444/2884] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:38:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:38:30.525336 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136503e6-327d-4752-90cc-11d87ab733b6 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:30.526179 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136503e6-327d-4752-90cc-11d87ab733b6 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:30.526620 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136503e6-327d-4752-90cc-11d87ab733b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:30.577378 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-136503e6-327d-4752-90cc-11d87ab733b6 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:38:30.580307 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-136503e6-327d-4752-90cc-11d87ab733b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:30.616663 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1441/2885] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:38:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:38:30.617358 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc761427-f584-4432-918b-7bc9e9ed7dbf None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:30.636284 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc761427-f584-4432-918b-7bc9e9ed7dbf None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:30.645231 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32487d53-b457-4e57-aacd-c25667d66054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:30.646690 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32487d53-b457-4e57-aacd-c25667d66054 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:30.647487 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32487d53-b457-4e57-aacd-c25667d66054 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:30.648398 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32487d53-b457-4e57-aacd-c25667d66054 admin admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:30.649213 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32487d53-b457-4e57-aacd-c25667d66054 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:38:30.649675 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32487d53-b457-4e57-aacd-c25667d66054 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:30.651733 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32487d53-b457-4e57-aacd-c25667d66054 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:30.676270 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136503e6-327d-4752-90cc-11d87ab733b6 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:30.683082 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1445/2886] 10.222.0.91 () {58 vars in 1153 bytes} [Tue Aug 30 04:38:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:38:30.689332 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136503e6-327d-4752-90cc-11d87ab733b6 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:30.695965 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2975b243-96ce-41d0-a8fd-332dc5239140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:30.696906 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2975b243-96ce-41d0-a8fd-332dc5239140 admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:30.697339 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2975b243-96ce-41d0-a8fd-332dc5239140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:30.697759 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2975b243-96ce-41d0-a8fd-332dc5239140 admin admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:30.698559 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2975b243-96ce-41d0-a8fd-332dc5239140 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:30.700942 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2975b243-96ce-41d0-a8fd-332dc5239140 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:30.746249 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1442/2887] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:38:30 2022] POST /identity/v3/projects => generated 385 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:38:30.748322 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32487d53-b457-4e57-aacd-c25667d66054 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:30.762513 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32487d53-b457-4e57-aacd-c25667d66054 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:30.780731 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:30.825379 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2975b243-96ce-41d0-a8fd-332dc5239140 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:30.827695 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-2975b243-96ce-41d0-a8fd-332dc5239140 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:30.895684 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69f58fb-d045-4cbd-98e4-9e608c4df704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:30.896929 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f58fb-d045-4cbd-98e4-9e608c4df704 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:30.897564 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f58fb-d045-4cbd-98e4-9e608c4df704 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:30.898273 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f58fb-d045-4cbd-98e4-9e608c4df704 admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:30.899610 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69f58fb-d045-4cbd-98e4-9e608c4df704 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:30.903142 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69f58fb-d045-4cbd-98e4-9e608c4df704 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:30.929159 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2975b243-96ce-41d0-a8fd-332dc5239140 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:30.939737 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d8bcc-2b5e-4973-822a-c5d01a229a6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:30.941083 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d8bcc-2b5e-4973-822a-c5d01a229a6b service cinder] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:30.941973 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d8bcc-2b5e-4973-822a-c5d01a229a6b service cinder] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:30.942443 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d8bcc-2b5e-4973-822a-c5d01a229a6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:30.953388 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-6d9d8bcc-2b5e-4973-822a-c5d01a229a6b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:30.977155 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1446/2888] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:38:30 2022] POST /identity/v3/users => generated 293 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:38:30.979747 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69f58fb-d045-4cbd-98e4-9e608c4df704 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:30.998526 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69f58fb-d045-4cbd-98e4-9e608c4df704 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:31.006238 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916398a3-08b9-4355-a789-29a3c780e6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:31.008574 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916398a3-08b9-4355-a789-29a3c780e6c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:31.009262 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916398a3-08b9-4355-a789-29a3c780e6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:31.009701 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916398a3-08b9-4355-a789-29a3c780e6c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:31.010559 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916398a3-08b9-4355-a789-29a3c780e6c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:31.014608 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916398a3-08b9-4355-a789-29a3c780e6c6 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:31.034197 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1447/2889] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:38:30 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:38:31.040280 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916398a3-08b9-4355-a789-29a3c780e6c6 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:31.046098 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:31.061329 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916398a3-08b9-4355-a789-29a3c780e6c6 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:31.073281 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe5d412-2f68-4dc0-a0db-f584d9a184eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:31.074456 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5d412-2f68-4dc0-a0db-f584d9a184eb admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:31.074953 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5d412-2f68-4dc0-a0db-f584d9a184eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:31.075800 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5d412-2f68-4dc0-a0db-f584d9a184eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:31.078635 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe5d412-2f68-4dc0-a0db-f584d9a184eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:31.083322 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe5d412-2f68-4dc0-a0db-f584d9a184eb admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:31.099697 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9d8bcc-2b5e-4973-822a-c5d01a229a6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:31.101405 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9d8bcc-2b5e-4973-822a-c5d01a229a6b service cinder] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:31.109371 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1448/2890] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:38:31.114859 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe5d412-2f68-4dc0-a0db-f584d9a184eb admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:31.124500 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1443/2891] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:38:30 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:38:31.126404 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe5d412-2f68-4dc0-a0db-f584d9a184eb admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:31.133421 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764fbdc7-bddd-4e87-92a1-e3eebd0d4f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:31.134129 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764fbdc7-bddd-4e87-92a1-e3eebd0d4f42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:31.134408 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764fbdc7-bddd-4e87-92a1-e3eebd0d4f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:31.134837 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764fbdc7-bddd-4e87-92a1-e3eebd0d4f42 admin admin] PATH_INFO: `/v3/projects/6669f6c544474accb3b96fea5df4078b/users/2a8186264678493fbf7bb7c2234db6b0/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:31.163777 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764fbdc7-bddd-4e87-92a1-e3eebd0d4f42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6669f6c544474accb3b96fea5df4078b, user_id=2a8186264678493fbf7bb7c2234db6b0, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:31.168518 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764fbdc7-bddd-4e87-92a1-e3eebd0d4f42 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:31.202727 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1449/2892] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:38:31 2022] PUT /identity/v3/projects/6669f6c544474accb3b96fea5df4078b/users/2a8186264678493fbf7bb7c2234db6b0/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:38:31.216889 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f209b-d3b0-4dab-a808-dee17246b831 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:31.217265 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f209b-d3b0-4dab-a808-dee17246b831 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:31.217813 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f209b-d3b0-4dab-a808-dee17246b831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:31.275623 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-006f209b-d3b0-4dab-a808-dee17246b831 None None] MFA Rules not processed for user `2a8186264678493fbf7bb7c2234db6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:38:31.277252 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-006f209b-d3b0-4dab-a808-dee17246b831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:31.389860 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1444/2893] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:38:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:38:31.396954 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764fbdc7-bddd-4e87-92a1-e3eebd0d4f42 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:31.500913 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764fbdc7-bddd-4e87-92a1-e3eebd0d4f42 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:31.511063 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720e4134-c49d-4761-8da0-f8a47b9d7f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:31.513380 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e4134-c49d-4761-8da0-f8a47b9d7f2e admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:31.514163 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e4134-c49d-4761-8da0-f8a47b9d7f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:31.514815 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e4134-c49d-4761-8da0-f8a47b9d7f2e admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:31.516155 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720e4134-c49d-4761-8da0-f8a47b9d7f2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:31.520364 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720e4134-c49d-4761-8da0-f8a47b9d7f2e admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:31.583133 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1450/2894] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:38:31 2022] POST /identity/v3/projects => generated 383 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:38:31.591015 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006f209b-d3b0-4dab-a808-dee17246b831 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:31.613816 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006f209b-d3b0-4dab-a808-dee17246b831 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:31.746421 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab7a3e-53fe-45a9-bd93-7258d0624290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:31.747580 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab7a3e-53fe-45a9-bd93-7258d0624290 admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:31.748116 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab7a3e-53fe-45a9-bd93-7258d0624290 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:31.749656 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab7a3e-53fe-45a9-bd93-7258d0624290 admin admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:31.750239 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ab7a3e-53fe-45a9-bd93-7258d0624290 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:31.753987 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ab7a3e-53fe-45a9-bd93-7258d0624290 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:31.801212 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1445/2895] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:38:31 2022] POST /identity/v3/users => generated 292 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:38:31.802099 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720e4134-c49d-4761-8da0-f8a47b9d7f2e admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:31.814510 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720e4134-c49d-4761-8da0-f8a47b9d7f2e admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:31.820925 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea925f-29db-4b36-86c5-da2a40b13ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:31.821674 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea925f-29db-4b36-86c5-da2a40b13ba0 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:31.822028 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea925f-29db-4b36-86c5-da2a40b13ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:31.822373 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea925f-29db-4b36-86c5-da2a40b13ba0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:31.823123 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeea925f-29db-4b36-86c5-da2a40b13ba0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:31.828005 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeea925f-29db-4b36-86c5-da2a40b13ba0 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:31.839386 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1451/2896] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:38:31.846445 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab7a3e-53fe-45a9-bd93-7258d0624290 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:31.866786 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab7a3e-53fe-45a9-bd93-7258d0624290 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:31.874959 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7b1327-accd-4d3f-8b6b-79f2ea948e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:31.876181 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b1327-accd-4d3f-8b6b-79f2ea948e6f admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:31.876744 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b1327-accd-4d3f-8b6b-79f2ea948e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:31.877486 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b1327-accd-4d3f-8b6b-79f2ea948e6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:31.878793 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7b1327-accd-4d3f-8b6b-79f2ea948e6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:31.885112 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7b1327-accd-4d3f-8b6b-79f2ea948e6f admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:31.901612 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1446/2897] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:38:31.910665 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea925f-29db-4b36-86c5-da2a40b13ba0 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:31.931200 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea925f-29db-4b36-86c5-da2a40b13ba0 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:31.938976 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31676ed0-b532-440f-be6b-df3052102041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:31.940917 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31676ed0-b532-440f-be6b-df3052102041 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:31.941448 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31676ed0-b532-440f-be6b-df3052102041 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:31.942020 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31676ed0-b532-440f-be6b-df3052102041 admin admin] PATH_INFO: `/v3/projects/96fc9187bfc64bd48191fabe68dcc236/users/28da60a4057c46fea19e655790250b87/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:31.972040 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31676ed0-b532-440f-be6b-df3052102041 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96fc9187bfc64bd48191fabe68dcc236, user_id=28da60a4057c46fea19e655790250b87, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:31.978400 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31676ed0-b532-440f-be6b-df3052102041 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:31.997895 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1452/2898] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:38:31 2022] PUT /identity/v3/projects/96fc9187bfc64bd48191fabe68dcc236/users/28da60a4057c46fea19e655790250b87/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:38:32.022417 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a4c81-69c8-4cea-8dda-5287daa3636d None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:32.022851 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a4c81-69c8-4cea-8dda-5287daa3636d None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:32.023363 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a4c81-69c8-4cea-8dda-5287daa3636d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:32.077654 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-1c0a4c81-69c8-4cea-8dda-5287daa3636d None None] MFA Rules not processed for user `28da60a4057c46fea19e655790250b87`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:38:32.079222 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-1c0a4c81-69c8-4cea-8dda-5287daa3636d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:32.138010 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:32.206156 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1447/2899] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:38:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:38:32.208201 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31676ed0-b532-440f-be6b-df3052102041 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:32.225510 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:32.302490 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31676ed0-b532-440f-be6b-df3052102041 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:32.308381 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60259a26-2f28-4440-84e8-b5b6651a7cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:32.309035 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60259a26-2f28-4440-84e8-b5b6651a7cbf admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:32.309456 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60259a26-2f28-4440-84e8-b5b6651a7cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:32.309701 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60259a26-2f28-4440-84e8-b5b6651a7cbf admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:32.310264 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60259a26-2f28-4440-84e8-b5b6651a7cbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:32.312222 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60259a26-2f28-4440-84e8-b5b6651a7cbf admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:32.410681 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1453/2900] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:38:32 2022] POST /identity/v3/projects => generated 385 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:38:32.412918 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a4c81-69c8-4cea-8dda-5287daa3636d None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:32.431014 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a4c81-69c8-4cea-8dda-5287daa3636d None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:32.560091 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1eede-060b-43d8-b1af-e202d10d3e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:32.563542 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1eede-060b-43d8-b1af-e202d10d3e6b admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:32.563818 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1eede-060b-43d8-b1af-e202d10d3e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:32.564181 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1eede-060b-43d8-b1af-e202d10d3e6b admin admin] PATH_INFO: `/v3/users` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:32.564869 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf1eede-060b-43d8-b1af-e202d10d3e6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:32.567101 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf1eede-060b-43d8-b1af-e202d10d3e6b admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:32.617973 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1448/2901] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:38:32 2022] POST /identity/v3/users => generated 299 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:38:32.622841 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60259a26-2f28-4440-84e8-b5b6651a7cbf admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:32.645779 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60259a26-2f28-4440-84e8-b5b6651a7cbf admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:32.654840 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ddb185-f3d6-497b-be06-364030be7a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:32.655353 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ddb185-f3d6-497b-be06-364030be7a8d admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:32.655632 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ddb185-f3d6-497b-be06-364030be7a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:32.655956 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ddb185-f3d6-497b-be06-364030be7a8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:32.656768 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ddb185-f3d6-497b-be06-364030be7a8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:32.659799 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ddb185-f3d6-497b-be06-364030be7a8d admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:32.696029 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1454/2902] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:38:32.700947 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1eede-060b-43d8-b1af-e202d10d3e6b admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:32.721030 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1eede-060b-43d8-b1af-e202d10d3e6b admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:32.728898 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d39dad-e835-4063-961d-dea442684e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:32.729868 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d39dad-e835-4063-961d-dea442684e59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:32.730507 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d39dad-e835-4063-961d-dea442684e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:32.730991 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d39dad-e835-4063-961d-dea442684e59 admin admin] PATH_INFO: `/v3/projects/0a6e3c8467bd465895ee99a8bddca387/users/50aa697c3cc340cf8189d0f16fe30a5f/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:32.761543 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d39dad-e835-4063-961d-dea442684e59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a6e3c8467bd465895ee99a8bddca387, user_id=50aa697c3cc340cf8189d0f16fe30a5f, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:32.764410 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d39dad-e835-4063-961d-dea442684e59 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:32.802641 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1449/2903] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:38:32 2022] PUT /identity/v3/projects/0a6e3c8467bd465895ee99a8bddca387/users/50aa697c3cc340cf8189d0f16fe30a5f/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:38:32.808389 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ddb185-f3d6-497b-be06-364030be7a8d admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:32.822874 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ddb185-f3d6-497b-be06-364030be7a8d admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:32.969812 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3648de8-be90-4c92-99c1-334af365a4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:32.971092 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3648de8-be90-4c92-99c1-334af365a4c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:32.971552 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3648de8-be90-4c92-99c1-334af365a4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:32.972474 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3648de8-be90-4c92-99c1-334af365a4c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:32.973323 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3648de8-be90-4c92-99c1-334af365a4c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:32.975106 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3648de8-be90-4c92-99c1-334af365a4c7 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:33.011512 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d39dad-e835-4063-961d-dea442684e59 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:33.016133 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1455/2904] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:38:33.044036 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d39dad-e835-4063-961d-dea442684e59 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:33.052684 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b6d8c8-86a3-42e6-92e3-3903f2d714eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:33.053819 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6d8c8-86a3-42e6-92e3-3903f2d714eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:33.054330 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6d8c8-86a3-42e6-92e3-3903f2d714eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:33.054824 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6d8c8-86a3-42e6-92e3-3903f2d714eb admin admin] PATH_INFO: `/v3/projects/0a6e3c8467bd465895ee99a8bddca387/users/50aa697c3cc340cf8189d0f16fe30a5f/roles/d8f440a82947486ebb20a633ebee736b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:33.061876 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b6d8c8-86a3-42e6-92e3-3903f2d714eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a6e3c8467bd465895ee99a8bddca387, user_id=50aa697c3cc340cf8189d0f16fe30a5f, role_id=d8f440a82947486ebb20a633ebee736b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:33.069177 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b6d8c8-86a3-42e6-92e3-3903f2d714eb admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:33.103968 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1450/2905] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:38:33 2022] PUT /identity/v3/projects/0a6e3c8467bd465895ee99a8bddca387/users/50aa697c3cc340cf8189d0f16fe30a5f/roles/d8f440a82947486ebb20a633ebee736b => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:38:33.115590 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d96fc-bfa2-4845-8aab-2c05ba7847a6 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:33.115955 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d96fc-bfa2-4845-8aab-2c05ba7847a6 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:33.116234 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d96fc-bfa2-4845-8aab-2c05ba7847a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:33.171279 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-f94d96fc-bfa2-4845-8aab-2c05ba7847a6 None None] MFA Rules not processed for user `50aa697c3cc340cf8189d0f16fe30a5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:38:33.173403 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-f94d96fc-bfa2-4845-8aab-2c05ba7847a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:33.283978 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1456/2906] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:38:33 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:38:33.297497 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b6d8c8-86a3-42e6-92e3-3903f2d714eb admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:33.299482 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-80b6d8c8-86a3-42e6-92e3-3903f2d714eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:33.392109 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b6d8c8-86a3-42e6-92e3-3903f2d714eb admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:33.397177 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c53e9-bd72-4583-8560-e44a488469a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:33.397860 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c53e9-bd72-4583-8560-e44a488469a6 service cinder] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:33.398200 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c53e9-bd72-4583-8560-e44a488469a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:33.398519 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c53e9-bd72-4583-8560-e44a488469a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:33.455755 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:33.499237 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5c53e9-bd72-4583-8560-e44a488469a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:33.501276 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5c53e9-bd72-4583-8560-e44a488469a6 service cinder] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:33.515040 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1451/2907] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:38:33 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:38:35.487524 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94d96fc-bfa2-4845-8aab-2c05ba7847a6 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:35.503754 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94d96fc-bfa2-4845-8aab-2c05ba7847a6 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:35.508709 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc76856a-1fa4-4e18-84cd-fb7939482389 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:35.509765 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc76856a-1fa4-4e18-84cd-fb7939482389 service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:35.510101 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc76856a-1fa4-4e18-84cd-fb7939482389 service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:35.510538 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc76856a-1fa4-4e18-84cd-fb7939482389 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:35.517239 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:35.635239 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc76856a-1fa4-4e18-84cd-fb7939482389 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:35.637193 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc76856a-1fa4-4e18-84cd-fb7939482389 service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:35.661405 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1457/2908] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:38:35 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:38:36.073978 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c53e9-bd72-4583-8560-e44a488469a6 service cinder] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:36.076303 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-3e5c53e9-bd72-4583-8560-e44a488469a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:36.272574 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c53e9-bd72-4583-8560-e44a488469a6 service cinder] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:36.278572 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ea25f-4558-4668-b277-b7933b0b3f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:36.279227 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ea25f-4558-4668-b277-b7933b0b3f18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:36.279650 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ea25f-4558-4668-b277-b7933b0b3f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:36.280068 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ea25f-4558-4668-b277-b7933b0b3f18 admin admin] PATH_INFO: `/v3/users/fa01b019e0d341e8a3156f9471e0b512` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:36.282080 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ea25f-4558-4668-b277-b7933b0b3f18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa01b019e0d341e8a3156f9471e0b512)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:36.285750 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ea25f-4558-4668-b277-b7933b0b3f18 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:36.420594 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-208ea25f-4558-4668-b277-b7933b0b3f18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa01b019e0d341e8a3156f9471e0b512'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:36.421500 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-208ea25f-4558-4668-b277-b7933b0b3f18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa01b019e0d341e8a3156f9471e0b512'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:36.422784 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-208ea25f-4558-4668-b277-b7933b0b3f18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa01b019e0d341e8a3156f9471e0b512'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:36.445465 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-208ea25f-4558-4668-b277-b7933b0b3f18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa01b019e0d341e8a3156f9471e0b512'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:36.471855 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-208ea25f-4558-4668-b277-b7933b0b3f18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa01b019e0d341e8a3156f9471e0b512'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:36.491988 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1452/2909] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:38:36 2022] DELETE /identity/v3/users/fa01b019e0d341e8a3156f9471e0b512 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:38:36.500741 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266084a4-d520-43a6-bd77-d5258028ae9b None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:36.501730 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266084a4-d520-43a6-bd77-d5258028ae9b None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:36.501917 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266084a4-d520-43a6-bd77-d5258028ae9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:36.544144 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-266084a4-d520-43a6-bd77-d5258028ae9b None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:38:36.545236 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-266084a4-d520-43a6-bd77-d5258028ae9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:36.696294 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1458/2910] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:38:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:38:36.706841 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ea25f-4558-4668-b277-b7933b0b3f18 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:36.708764 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-208ea25f-4558-4668-b277-b7933b0b3f18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:36.869364 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ea25f-4558-4668-b277-b7933b0b3f18 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:36.876410 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41781538-8222-4de8-b1a0-99a496b375a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:36.878081 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41781538-8222-4de8-b1a0-99a496b375a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:36.878744 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41781538-8222-4de8-b1a0-99a496b375a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:36.879228 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41781538-8222-4de8-b1a0-99a496b375a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:36.899106 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41781538-8222-4de8-b1a0-99a496b375a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:36.903316 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41781538-8222-4de8-b1a0-99a496b375a9 service neutron] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:36.910184 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266084a4-d520-43a6-bd77-d5258028ae9b None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:36.912927 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-266084a4-d520-43a6-bd77-d5258028ae9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:36.914730 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:36.932928 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1453/2911] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:38:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:38:37.065450 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266084a4-d520-43a6-bd77-d5258028ae9b None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:37.075218 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64035154-4dcb-41e5-958e-08a3557940ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812abdd745f149e6a0166cd9040f28e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:37.077897 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64035154-4dcb-41e5-958e-08a3557940ee service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:37.078719 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64035154-4dcb-41e5-958e-08a3557940ee service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:37.079295 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64035154-4dcb-41e5-958e-08a3557940ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:37.088112 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-64035154-4dcb-41e5-958e-08a3557940ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:37.345024 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:37.347866 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64035154-4dcb-41e5-958e-08a3557940ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:37.351405 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64035154-4dcb-41e5-958e-08a3557940ee service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:37.367566 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1459/2912] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:38:36 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:38:37.608068 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41781538-8222-4de8-b1a0-99a496b375a9 service neutron] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:37.608068 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-41781538-8222-4de8-b1a0-99a496b375a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:37.639282 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41781538-8222-4de8-b1a0-99a496b375a9 service neutron] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:37.651228 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e9266-91fc-4fd9-b63f-3e45c328fc13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:37.652328 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e9266-91fc-4fd9-b63f-3e45c328fc13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:37.652812 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e9266-91fc-4fd9-b63f-3e45c328fc13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:37.653319 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e9266-91fc-4fd9-b63f-3e45c328fc13 admin admin] PATH_INFO: `/v3/projects/def7e1c094e84718a81f6542a68ed20e` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:37.656553 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69e9266-91fc-4fd9-b63f-3e45c328fc13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=def7e1c094e84718a81f6542a68ed20e)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:37.676744 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69e9266-91fc-4fd9-b63f-3e45c328fc13 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:37.786347 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-f69e9266-91fc-4fd9-b63f-3e45c328fc13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'def7e1c094e84718a81f6542a68ed20e', 'request_id': 'req-f69e9266-91fc-4fd9-b63f-3e45c328fc13'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:37.794792 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-f69e9266-91fc-4fd9-b63f-3e45c328fc13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'def7e1c094e84718a81f6542a68ed20e', 'request_id': 'req-f69e9266-91fc-4fd9-b63f-3e45c328fc13'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:37.809102 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-f69e9266-91fc-4fd9-b63f-3e45c328fc13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'def7e1c094e84718a81f6542a68ed20e', 'request_id': 'req-f69e9266-91fc-4fd9-b63f-3e45c328fc13'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:37.829207 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-f69e9266-91fc-4fd9-b63f-3e45c328fc13 admin admin] The token cache is being invalidate because project def7e1c094e84718a81f6542a68ed20e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:38:37.829762 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-f69e9266-91fc-4fd9-b63f-3e45c328fc13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:37.830673 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-f69e9266-91fc-4fd9-b63f-3e45c328fc13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:37.843375 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1454/2913] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:38:37 2022] DELETE /identity/v3/projects/def7e1c094e84718a81f6542a68ed20e => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:38:37.849595 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64035154-4dcb-41e5-958e-08a3557940ee service cinder] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:37.871657 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64035154-4dcb-41e5-958e-08a3557940ee service cinder] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:37.989073 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e6dc2-3e87-406b-ab12-73668e67210b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:37.989898 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e6dc2-3e87-406b-ab12-73668e67210b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:37.990281 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e6dc2-3e87-406b-ab12-73668e67210b admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:37.990659 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e6dc2-3e87-406b-ab12-73668e67210b admin admin] PATH_INFO: `/v3/users/dd810fd20b6f4ea7a3c4185bc62713bf` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:37.992415 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3e6dc2-3e87-406b-ab12-73668e67210b admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd810fd20b6f4ea7a3c4185bc62713bf)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:37.994731 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3e6dc2-3e87-406b-ab12-73668e67210b admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:38.070468 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-4c3e6dc2-3e87-406b-ab12-73668e67210b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd810fd20b6f4ea7a3c4185bc62713bf'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:38.080305 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-4c3e6dc2-3e87-406b-ab12-73668e67210b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd810fd20b6f4ea7a3c4185bc62713bf'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:38.091699 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-4c3e6dc2-3e87-406b-ab12-73668e67210b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd810fd20b6f4ea7a3c4185bc62713bf'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:38.097193 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-4c3e6dc2-3e87-406b-ab12-73668e67210b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd810fd20b6f4ea7a3c4185bc62713bf'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:38.119206 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-4c3e6dc2-3e87-406b-ab12-73668e67210b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd810fd20b6f4ea7a3c4185bc62713bf'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:38.129382 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1460/2914] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:38:37 2022] DELETE /identity/v3/users/dd810fd20b6f4ea7a3c4185bc62713bf => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:38:38.776594 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e9266-91fc-4fd9-b63f-3e45c328fc13 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:38.778504 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-f69e9266-91fc-4fd9-b63f-3e45c328fc13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:38.794920 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e9266-91fc-4fd9-b63f-3e45c328fc13 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:38.968200 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca30e58-cdec-419c-81a9-6e58d47d2758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:38.968200 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca30e58-cdec-419c-81a9-6e58d47d2758 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:38.968200 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca30e58-cdec-419c-81a9-6e58d47d2758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:38.968200 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca30e58-cdec-419c-81a9-6e58d47d2758 admin admin] PATH_INFO: `/v3/projects/7dbe6c172fb64015bc28b07c46468dac` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:38.968864 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca30e58-cdec-419c-81a9-6e58d47d2758 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dbe6c172fb64015bc28b07c46468dac)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:38.973780 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca30e58-cdec-419c-81a9-6e58d47d2758 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:39.107155 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-bca30e58-cdec-419c-81a9-6e58d47d2758 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dbe6c172fb64015bc28b07c46468dac', 'request_id': 'req-bca30e58-cdec-419c-81a9-6e58d47d2758'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:39.120362 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-bca30e58-cdec-419c-81a9-6e58d47d2758 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dbe6c172fb64015bc28b07c46468dac', 'request_id': 'req-bca30e58-cdec-419c-81a9-6e58d47d2758'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:39.134916 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-bca30e58-cdec-419c-81a9-6e58d47d2758 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dbe6c172fb64015bc28b07c46468dac', 'request_id': 'req-bca30e58-cdec-419c-81a9-6e58d47d2758'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:39.170302 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-bca30e58-cdec-419c-81a9-6e58d47d2758 admin admin] The token cache is being invalidate because project 7dbe6c172fb64015bc28b07c46468dac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:38:39.170638 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-bca30e58-cdec-419c-81a9-6e58d47d2758 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:39.171457 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-bca30e58-cdec-419c-81a9-6e58d47d2758 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:39.173555 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1455/2915] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:38:38 2022] DELETE /identity/v3/projects/7dbe6c172fb64015bc28b07c46468dac => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:38:39.180418 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e6dc2-3e87-406b-ab12-73668e67210b admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:39.183592 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-4c3e6dc2-3e87-406b-ab12-73668e67210b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:39.201248 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e6dc2-3e87-406b-ab12-73668e67210b admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:39.288364 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb6575-70dd-457b-821d-2b75a3482f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:39.289108 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb6575-70dd-457b-821d-2b75a3482f87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:39.289319 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb6575-70dd-457b-821d-2b75a3482f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:39.299714 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb6575-70dd-457b-821d-2b75a3482f87 admin admin] PATH_INFO: `/v3/users/118ad71c941549009b7095f940f3291f` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:39.303705 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceb6575-70dd-457b-821d-2b75a3482f87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=118ad71c941549009b7095f940f3291f)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:39.305869 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceb6575-70dd-457b-821d-2b75a3482f87 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:39.345675 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:39.455123 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-2ceb6575-70dd-457b-821d-2b75a3482f87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '118ad71c941549009b7095f940f3291f'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:39.483123 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-2ceb6575-70dd-457b-821d-2b75a3482f87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '118ad71c941549009b7095f940f3291f'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:39.499811 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-2ceb6575-70dd-457b-821d-2b75a3482f87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '118ad71c941549009b7095f940f3291f'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:39.500933 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-2ceb6575-70dd-457b-821d-2b75a3482f87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '118ad71c941549009b7095f940f3291f'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:39.528089 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-2ceb6575-70dd-457b-821d-2b75a3482f87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '118ad71c941549009b7095f940f3291f'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:39.543593 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1461/2916] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:38:39 2022] DELETE /identity/v3/users/118ad71c941549009b7095f940f3291f => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:38:40.080787 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca30e58-cdec-419c-81a9-6e58d47d2758 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:40.084276 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-bca30e58-cdec-419c-81a9-6e58d47d2758 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:40.103821 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca30e58-cdec-419c-81a9-6e58d47d2758 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:40.124433 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:40.236917 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff652e7a-46af-473d-9d00-f8a383c661bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:40.237913 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff652e7a-46af-473d-9d00-f8a383c661bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:40.238579 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff652e7a-46af-473d-9d00-f8a383c661bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:40.238992 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff652e7a-46af-473d-9d00-f8a383c661bb admin admin] PATH_INFO: `/v3/projects/863a1cded3b54b629ed731d63f003ee9` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:40.241448 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff652e7a-46af-473d-9d00-f8a383c661bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=863a1cded3b54b629ed731d63f003ee9)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:40.245161 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff652e7a-46af-473d-9d00-f8a383c661bb admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:40.367205 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-ff652e7a-46af-473d-9d00-f8a383c661bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '863a1cded3b54b629ed731d63f003ee9', 'request_id': 'req-ff652e7a-46af-473d-9d00-f8a383c661bb'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:40.381951 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-ff652e7a-46af-473d-9d00-f8a383c661bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '863a1cded3b54b629ed731d63f003ee9', 'request_id': 'req-ff652e7a-46af-473d-9d00-f8a383c661bb'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:40.403041 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-ff652e7a-46af-473d-9d00-f8a383c661bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '863a1cded3b54b629ed731d63f003ee9', 'request_id': 'req-ff652e7a-46af-473d-9d00-f8a383c661bb'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:40.449078 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-ff652e7a-46af-473d-9d00-f8a383c661bb admin admin] The token cache is being invalidate because project 863a1cded3b54b629ed731d63f003ee9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:38:40.449715 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-ff652e7a-46af-473d-9d00-f8a383c661bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:40.450969 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-ff652e7a-46af-473d-9d00-f8a383c661bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:40.460000 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1456/2917] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:38:40 2022] DELETE /identity/v3/projects/863a1cded3b54b629ed731d63f003ee9 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:38:42.443689 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb6575-70dd-457b-821d-2b75a3482f87 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:42.446678 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-2ceb6575-70dd-457b-821d-2b75a3482f87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:42.475213 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb6575-70dd-457b-821d-2b75a3482f87 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:42.595278 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35670504-9158-4238-b2a4-397fc8018cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:42.596573 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35670504-9158-4238-b2a4-397fc8018cec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:42.596962 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35670504-9158-4238-b2a4-397fc8018cec admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:42.597355 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35670504-9158-4238-b2a4-397fc8018cec admin admin] PATH_INFO: `/v3/users/2a8186264678493fbf7bb7c2234db6b0` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:42.599419 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35670504-9158-4238-b2a4-397fc8018cec admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a8186264678493fbf7bb7c2234db6b0)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:42.602402 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35670504-9158-4238-b2a4-397fc8018cec admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:42.692661 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-35670504-9158-4238-b2a4-397fc8018cec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a8186264678493fbf7bb7c2234db6b0'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:42.702419 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-35670504-9158-4238-b2a4-397fc8018cec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a8186264678493fbf7bb7c2234db6b0'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:42.715316 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-35670504-9158-4238-b2a4-397fc8018cec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a8186264678493fbf7bb7c2234db6b0'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:42.716694 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-35670504-9158-4238-b2a4-397fc8018cec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a8186264678493fbf7bb7c2234db6b0'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:42.745166 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-35670504-9158-4238-b2a4-397fc8018cec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a8186264678493fbf7bb7c2234db6b0'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:42.756151 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1462/2918] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:38:42 2022] DELETE /identity/v3/users/2a8186264678493fbf7bb7c2234db6b0 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:38:42.762356 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b610fd-9e6b-4b01-b687-320db7293068 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:42.763006 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b610fd-9e6b-4b01-b687-320db7293068 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:42.763006 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b610fd-9e6b-4b01-b687-320db7293068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:42.789369 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-53b610fd-9e6b-4b01-b687-320db7293068 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:38:42.790728 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-53b610fd-9e6b-4b01-b687-320db7293068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:42.947461 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1457/2919] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:38:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:38:42.976171 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35670504-9158-4238-b2a4-397fc8018cec admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:42.979226 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-35670504-9158-4238-b2a4-397fc8018cec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:43.007864 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:43.099424 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35670504-9158-4238-b2a4-397fc8018cec admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:43.104545 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be0a4f4-f884-474a-b565-38db730a2fb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:43.105607 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0a4f4-f884-474a-b565-38db730a2fb8 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:43.106115 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0a4f4-f884-474a-b565-38db730a2fb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:43.106581 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0a4f4-f884-474a-b565-38db730a2fb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:43.125909 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be0a4f4-f884-474a-b565-38db730a2fb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:43.130054 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be0a4f4-f884-474a-b565-38db730a2fb8 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:43.148531 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1463/2920] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:38:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:38:43.680433 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b610fd-9e6b-4b01-b687-320db7293068 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:43.682799 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-53b610fd-9e6b-4b01-b687-320db7293068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:43.711380 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b610fd-9e6b-4b01-b687-320db7293068 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:43.722208 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a5abfa-f2fb-4a68-a3a4-fce3c8034ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:43.724880 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5abfa-f2fb-4a68-a3a4-fce3c8034ced admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:43.725856 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5abfa-f2fb-4a68-a3a4-fce3c8034ced admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:43.726703 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5abfa-f2fb-4a68-a3a4-fce3c8034ced admin admin] PATH_INFO: `/v3/projects/6669f6c544474accb3b96fea5df4078b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:43.729705 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a5abfa-f2fb-4a68-a3a4-fce3c8034ced admin admin] RBAC: Authorizing `identity:delete_project(project_id=6669f6c544474accb3b96fea5df4078b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:43.734078 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a5abfa-f2fb-4a68-a3a4-fce3c8034ced admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:43.840482 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:43.862634 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-15a5abfa-f2fb-4a68-a3a4-fce3c8034ced admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6669f6c544474accb3b96fea5df4078b', 'request_id': 'req-15a5abfa-f2fb-4a68-a3a4-fce3c8034ced'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:43.889407 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-15a5abfa-f2fb-4a68-a3a4-fce3c8034ced admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6669f6c544474accb3b96fea5df4078b', 'request_id': 'req-15a5abfa-f2fb-4a68-a3a4-fce3c8034ced'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:43.906828 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-15a5abfa-f2fb-4a68-a3a4-fce3c8034ced admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6669f6c544474accb3b96fea5df4078b', 'request_id': 'req-15a5abfa-f2fb-4a68-a3a4-fce3c8034ced'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:43.919861 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-15a5abfa-f2fb-4a68-a3a4-fce3c8034ced admin admin] The token cache is being invalidate because project 6669f6c544474accb3b96fea5df4078b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:38:43.920285 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-15a5abfa-f2fb-4a68-a3a4-fce3c8034ced admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:43.920884 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-15a5abfa-f2fb-4a68-a3a4-fce3c8034ced admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:43.922681 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1458/2921] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:38:43 2022] DELETE /identity/v3/projects/6669f6c544474accb3b96fea5df4078b => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:38:43.928055 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be0a4f4-f884-474a-b565-38db730a2fb8 service neutron] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:43.961141 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be0a4f4-f884-474a-b565-38db730a2fb8 service neutron] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:44.071308 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f61b64c-6c9a-40f2-9b1e-75cbcfe92429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:44.072010 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f61b64c-6c9a-40f2-9b1e-75cbcfe92429 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:44.072293 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f61b64c-6c9a-40f2-9b1e-75cbcfe92429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:44.072565 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f61b64c-6c9a-40f2-9b1e-75cbcfe92429 admin admin] PATH_INFO: `/v3/users/28da60a4057c46fea19e655790250b87` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:44.074003 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f61b64c-6c9a-40f2-9b1e-75cbcfe92429 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28da60a4057c46fea19e655790250b87)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:44.076060 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f61b64c-6c9a-40f2-9b1e-75cbcfe92429 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:44.179903 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-6f61b64c-6c9a-40f2-9b1e-75cbcfe92429 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28da60a4057c46fea19e655790250b87'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:44.195493 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-6f61b64c-6c9a-40f2-9b1e-75cbcfe92429 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28da60a4057c46fea19e655790250b87'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:44.209764 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-6f61b64c-6c9a-40f2-9b1e-75cbcfe92429 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28da60a4057c46fea19e655790250b87'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:44.210933 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-6f61b64c-6c9a-40f2-9b1e-75cbcfe92429 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28da60a4057c46fea19e655790250b87'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:44.236913 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-6f61b64c-6c9a-40f2-9b1e-75cbcfe92429 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28da60a4057c46fea19e655790250b87'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:44.245869 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1464/2922] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:38:43 2022] DELETE /identity/v3/users/28da60a4057c46fea19e655790250b87 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:38:44.785272 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a5abfa-f2fb-4a68-a3a4-fce3c8034ced admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:44.789488 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-15a5abfa-f2fb-4a68-a3a4-fce3c8034ced admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:44.824442 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a5abfa-f2fb-4a68-a3a4-fce3c8034ced admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:44.943273 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc75103-0bde-4f78-a128-d3ffd9bd19c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:44.944324 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc75103-0bde-4f78-a128-d3ffd9bd19c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:44.944640 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc75103-0bde-4f78-a128-d3ffd9bd19c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:44.944944 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc75103-0bde-4f78-a128-d3ffd9bd19c5 admin admin] PATH_INFO: `/v3/projects/96fc9187bfc64bd48191fabe68dcc236` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:44.946748 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc75103-0bde-4f78-a128-d3ffd9bd19c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96fc9187bfc64bd48191fabe68dcc236)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:44.949331 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc75103-0bde-4f78-a128-d3ffd9bd19c5 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:45.059464 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-afc75103-0bde-4f78-a128-d3ffd9bd19c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96fc9187bfc64bd48191fabe68dcc236', 'request_id': 'req-afc75103-0bde-4f78-a128-d3ffd9bd19c5'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:45.070569 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-afc75103-0bde-4f78-a128-d3ffd9bd19c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96fc9187bfc64bd48191fabe68dcc236', 'request_id': 'req-afc75103-0bde-4f78-a128-d3ffd9bd19c5'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:45.087284 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-afc75103-0bde-4f78-a128-d3ffd9bd19c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96fc9187bfc64bd48191fabe68dcc236', 'request_id': 'req-afc75103-0bde-4f78-a128-d3ffd9bd19c5'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:45.106270 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-afc75103-0bde-4f78-a128-d3ffd9bd19c5 admin admin] The token cache is being invalidate because project 96fc9187bfc64bd48191fabe68dcc236 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:38:45.107058 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-afc75103-0bde-4f78-a128-d3ffd9bd19c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:45.108280 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-afc75103-0bde-4f78-a128-d3ffd9bd19c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:45.117543 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1459/2923] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:38:44 2022] DELETE /identity/v3/projects/96fc9187bfc64bd48191fabe68dcc236 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:38:45.118869 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f61b64c-6c9a-40f2-9b1e-75cbcfe92429 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:45.120819 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-6f61b64c-6c9a-40f2-9b1e-75cbcfe92429 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:45.145067 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f61b64c-6c9a-40f2-9b1e-75cbcfe92429 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:45.186416 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:45.247317 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3651890f-38a7-46dc-8df7-d7364a3c107b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:45.248272 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651890f-38a7-46dc-8df7-d7364a3c107b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:45.248931 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651890f-38a7-46dc-8df7-d7364a3c107b admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:45.249478 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651890f-38a7-46dc-8df7-d7364a3c107b admin admin] PATH_INFO: `/v3/users/50aa697c3cc340cf8189d0f16fe30a5f` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:45.252344 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3651890f-38a7-46dc-8df7-d7364a3c107b admin admin] RBAC: Authorizing `identity:delete_user(user_id=50aa697c3cc340cf8189d0f16fe30a5f)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:45.254960 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3651890f-38a7-46dc-8df7-d7364a3c107b admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:45.353104 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-3651890f-38a7-46dc-8df7-d7364a3c107b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50aa697c3cc340cf8189d0f16fe30a5f'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:45.363870 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-3651890f-38a7-46dc-8df7-d7364a3c107b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50aa697c3cc340cf8189d0f16fe30a5f'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:45.376517 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-3651890f-38a7-46dc-8df7-d7364a3c107b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50aa697c3cc340cf8189d0f16fe30a5f'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:45.378277 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-3651890f-38a7-46dc-8df7-d7364a3c107b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50aa697c3cc340cf8189d0f16fe30a5f'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:45.407322 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-3651890f-38a7-46dc-8df7-d7364a3c107b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50aa697c3cc340cf8189d0f16fe30a5f'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:45.423210 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1465/2924] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:38:45 2022] DELETE /identity/v3/users/50aa697c3cc340cf8189d0f16fe30a5f => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:38:45.962202 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc75103-0bde-4f78-a128-d3ffd9bd19c5 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:45.964215 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-afc75103-0bde-4f78-a128-d3ffd9bd19c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:45.978449 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc75103-0bde-4f78-a128-d3ffd9bd19c5 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:46.118410 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:46.130341 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c494aba-c9c5-4cbe-92ba-63bd131d0ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:46.131214 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c494aba-c9c5-4cbe-92ba-63bd131d0ea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:46.131867 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c494aba-c9c5-4cbe-92ba-63bd131d0ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:46.132954 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c494aba-c9c5-4cbe-92ba-63bd131d0ea0 admin admin] PATH_INFO: `/v3/projects/0a6e3c8467bd465895ee99a8bddca387` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:46.136376 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c494aba-c9c5-4cbe-92ba-63bd131d0ea0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a6e3c8467bd465895ee99a8bddca387)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:46.140959 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c494aba-c9c5-4cbe-92ba-63bd131d0ea0 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:46.221258 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-1c494aba-c9c5-4cbe-92ba-63bd131d0ea0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a6e3c8467bd465895ee99a8bddca387', 'request_id': 'req-1c494aba-c9c5-4cbe-92ba-63bd131d0ea0'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:46.231559 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-1c494aba-c9c5-4cbe-92ba-63bd131d0ea0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a6e3c8467bd465895ee99a8bddca387', 'request_id': 'req-1c494aba-c9c5-4cbe-92ba-63bd131d0ea0'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:46.243794 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-1c494aba-c9c5-4cbe-92ba-63bd131d0ea0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a6e3c8467bd465895ee99a8bddca387', 'request_id': 'req-1c494aba-c9c5-4cbe-92ba-63bd131d0ea0'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:46.273541 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-1c494aba-c9c5-4cbe-92ba-63bd131d0ea0 admin admin] The token cache is being invalidate because project 0a6e3c8467bd465895ee99a8bddca387 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:38:46.274143 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-1c494aba-c9c5-4cbe-92ba-63bd131d0ea0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:46.275946 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-1c494aba-c9c5-4cbe-92ba-63bd131d0ea0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:46.279715 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1460/2925] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:38:45 2022] DELETE /identity/v3/projects/0a6e3c8467bd465895ee99a8bddca387 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:38:49.303700 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe06f1-79ab-4398-863e-5a0ec3d3ae34 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:49.304466 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe06f1-79ab-4398-863e-5a0ec3d3ae34 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:49.304466 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe06f1-79ab-4398-863e-5a0ec3d3ae34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:49.326947 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-febe06f1-79ab-4398-863e-5a0ec3d3ae34 None None] MFA Rules not processed for user `1bc12faf48984335a3515dcde85b5cb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:38:49.328236 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-febe06f1-79ab-4398-863e-5a0ec3d3ae34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:49.397046 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1466/2926] 10.222.0.91 () {58 vars in 967 bytes} [Tue Aug 30 04:38:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:38:49.410709 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c494aba-c9c5-4cbe-92ba-63bd131d0ea0 admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:49.412441 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-1c494aba-c9c5-4cbe-92ba-63bd131d0ea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:49.495852 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c494aba-c9c5-4cbe-92ba-63bd131d0ea0 admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:49.502286 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80202af4-1b44-44bc-9d3f-c88e2d7edb0c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b50f9552124b07822ae63c1d553864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:49.502982 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80202af4-1b44-44bc-9d3f-c88e2d7edb0c service swift] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:49.503343 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80202af4-1b44-44bc-9d3f-c88e2d7edb0c service swift] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:49.503737 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80202af4-1b44-44bc-9d3f-c88e2d7edb0c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:49.514609 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80202af4-1b44-44bc-9d3f-c88e2d7edb0c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:49.516359 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80202af4-1b44-44bc-9d3f-c88e2d7edb0c service swift] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:49.526548 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1461/2927] 10.222.0.91 () {60 vars in 1384 bytes} [Tue Aug 30 04:38:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:38:51.741517 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe06f1-79ab-4398-863e-5a0ec3d3ae34 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:51.743188 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-febe06f1-79ab-4398-863e-5a0ec3d3ae34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:51.838219 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe06f1-79ab-4398-863e-5a0ec3d3ae34 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:51.843114 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ff219-81e8-4703-8b16-c9da0683d0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:51.843781 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ff219-81e8-4703-8b16-c9da0683d0d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:51.844096 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ff219-81e8-4703-8b16-c9da0683d0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:51.844372 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ff219-81e8-4703-8b16-c9da0683d0d6 admin admin] PATH_INFO: `/v3/users/ea5b20f6358c471480c78566d44c573d` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:51.846038 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231ff219-81e8-4703-8b16-c9da0683d0d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea5b20f6358c471480c78566d44c573d)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:51.848441 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231ff219-81e8-4703-8b16-c9da0683d0d6 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:51.850538 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:51.913918 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-231ff219-81e8-4703-8b16-c9da0683d0d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea5b20f6358c471480c78566d44c573d'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:51.922168 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-231ff219-81e8-4703-8b16-c9da0683d0d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea5b20f6358c471480c78566d44c573d'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:51.932359 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-231ff219-81e8-4703-8b16-c9da0683d0d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea5b20f6358c471480c78566d44c573d'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:51.933135 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-231ff219-81e8-4703-8b16-c9da0683d0d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea5b20f6358c471480c78566d44c573d'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:51.950739 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-231ff219-81e8-4703-8b16-c9da0683d0d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea5b20f6358c471480c78566d44c573d'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:51.958845 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1467/2928] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:38:51 2022] DELETE /identity/v3/users/ea5b20f6358c471480c78566d44c573d => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:38:52.231306 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80202af4-1b44-44bc-9d3f-c88e2d7edb0c service swift] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:52.258276 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80202af4-1b44-44bc-9d3f-c88e2d7edb0c service swift] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:52.330331 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c4c8f1-7a00-4255-945f-11f057921dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:52.331131 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4c8f1-7a00-4255-945f-11f057921dc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:52.331403 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4c8f1-7a00-4255-945f-11f057921dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:52.331670 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4c8f1-7a00-4255-945f-11f057921dc0 admin admin] PATH_INFO: `/v3/projects/a1c4b71eb1c4418db40f314db4478b51` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:52.333051 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c4c8f1-7a00-4255-945f-11f057921dc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1c4b71eb1c4418db40f314db4478b51)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:52.335096 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c4c8f1-7a00-4255-945f-11f057921dc0 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:52.360931 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:52.394257 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-03c4c8f1-7a00-4255-945f-11f057921dc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1c4b71eb1c4418db40f314db4478b51', 'request_id': 'req-03c4c8f1-7a00-4255-945f-11f057921dc0'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:52.401677 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-03c4c8f1-7a00-4255-945f-11f057921dc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1c4b71eb1c4418db40f314db4478b51', 'request_id': 'req-03c4c8f1-7a00-4255-945f-11f057921dc0'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:52.412573 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-03c4c8f1-7a00-4255-945f-11f057921dc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1c4b71eb1c4418db40f314db4478b51', 'request_id': 'req-03c4c8f1-7a00-4255-945f-11f057921dc0'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:52.428101 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-03c4c8f1-7a00-4255-945f-11f057921dc0 admin admin] The token cache is being invalidate because project a1c4b71eb1c4418db40f314db4478b51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:38:52.428393 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-03c4c8f1-7a00-4255-945f-11f057921dc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:52.429187 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-03c4c8f1-7a00-4255-945f-11f057921dc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:52.430784 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1462/2929] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:38:52 2022] DELETE /identity/v3/projects/a1c4b71eb1c4418db40f314db4478b51 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:38:52.437635 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4e588-e145-4792-8ee8-b6c3997f577c None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:52.437914 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4e588-e145-4792-8ee8-b6c3997f577c None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:52.438169 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4e588-e145-4792-8ee8-b6c3997f577c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:52.461122 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-4ce4e588-e145-4792-8ee8-b6c3997f577c None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:38:52.462362 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-4ce4e588-e145-4792-8ee8-b6c3997f577c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:52.533203 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1468/2930] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:38:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:38:52.547320 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c865e8c6-6d52-45a9-adf3-7d45a0cfe458 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:52.547741 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c865e8c6-6d52-45a9-adf3-7d45a0cfe458 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:52.548138 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c865e8c6-6d52-45a9-adf3-7d45a0cfe458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:52.570656 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-c865e8c6-6d52-45a9-adf3-7d45a0cfe458 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:38:52.571955 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-c865e8c6-6d52-45a9-adf3-7d45a0cfe458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:52.581916 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1463/2931] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:38:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:38:52.586711 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce4e588-e145-4792-8ee8-b6c3997f577c None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:52.597870 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce4e588-e145-4792-8ee8-b6c3997f577c None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:52.603541 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d78a60-1515-4d82-8246-0ba9a9172e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:52.604211 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d78a60-1515-4d82-8246-0ba9a9172e7f admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:52.604481 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d78a60-1515-4d82-8246-0ba9a9172e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:52.604744 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d78a60-1515-4d82-8246-0ba9a9172e7f admin admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:52.605427 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d78a60-1515-4d82-8246-0ba9a9172e7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:38:52.605728 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d78a60-1515-4d82-8246-0ba9a9172e7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:52.607370 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d78a60-1515-4d82-8246-0ba9a9172e7f admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:52.623021 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1469/2932] 10.222.0.91 () {58 vars in 1153 bytes} [Tue Aug 30 04:38:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:38:52.627828 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c865e8c6-6d52-45a9-adf3-7d45a0cfe458 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:52.640225 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c865e8c6-6d52-45a9-adf3-7d45a0cfe458 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:52.646563 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015e64e-8ba0-4494-8438-f33ed671c87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:52.647299 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015e64e-8ba0-4494-8438-f33ed671c87e admin admin] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:52.647615 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015e64e-8ba0-4494-8438-f33ed671c87e admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:52.647952 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015e64e-8ba0-4494-8438-f33ed671c87e admin admin] PATH_INFO: `/v3/projects` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:52.648587 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5015e64e-8ba0-4494-8438-f33ed671c87e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:52.650517 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5015e64e-8ba0-4494-8438-f33ed671c87e admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:52.687750 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1464/2933] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 30 04:38:52 2022] POST /identity/v3/projects => generated 367 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:38:52.693379 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d78a60-1515-4d82-8246-0ba9a9172e7f admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:52.704639 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d78a60-1515-4d82-8246-0ba9a9172e7f admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:52.772189 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35911b70-dcdf-43f1-8a8f-2d339eacf10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:52.773053 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35911b70-dcdf-43f1-8a8f-2d339eacf10f admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:52.773236 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35911b70-dcdf-43f1-8a8f-2d339eacf10f admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:52.773517 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35911b70-dcdf-43f1-8a8f-2d339eacf10f admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:52.774427 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35911b70-dcdf-43f1-8a8f-2d339eacf10f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:52.776564 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35911b70-dcdf-43f1-8a8f-2d339eacf10f admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:52.792000 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:52.807037 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1470/2934] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 30 04:38:52 2022] POST /identity/v3/users => generated 284 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:38:52.811596 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015e64e-8ba0-4494-8438-f33ed671c87e admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:52.824921 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015e64e-8ba0-4494-8438-f33ed671c87e admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:52.829814 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5f16f8-20e5-4e09-b06e-c7d7baa3b7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:52.830545 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f16f8-20e5-4e09-b06e-c7d7baa3b7ee admin admin] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:52.830874 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f16f8-20e5-4e09-b06e-c7d7baa3b7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:52.831194 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f16f8-20e5-4e09-b06e-c7d7baa3b7ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:52.831900 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5f16f8-20e5-4e09-b06e-c7d7baa3b7ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:52.833733 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5f16f8-20e5-4e09-b06e-c7d7baa3b7ee admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:52.848186 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1465/2935] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:38:52 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:38:52.857754 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35911b70-dcdf-43f1-8a8f-2d339eacf10f admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:52.870736 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35911b70-dcdf-43f1-8a8f-2d339eacf10f admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:52.876878 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47c394e-5487-439a-8148-5cf90370741d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:52.878050 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c394e-5487-439a-8148-5cf90370741d admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:52.878465 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c394e-5487-439a-8148-5cf90370741d admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:52.878789 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c394e-5487-439a-8148-5cf90370741d admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:52.879475 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47c394e-5487-439a-8148-5cf90370741d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:52.881154 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47c394e-5487-439a-8148-5cf90370741d admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:52.894673 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1471/2936] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 30 04:38:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:38:52.901687 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5f16f8-20e5-4e09-b06e-c7d7baa3b7ee admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:52.922165 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5f16f8-20e5-4e09-b06e-c7d7baa3b7ee admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:52.940753 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e39b0-e1ca-4222-926b-28f9a12aa9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:52.941864 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e39b0-e1ca-4222-926b-28f9a12aa9ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:52.942345 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e39b0-e1ca-4222-926b-28f9a12aa9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:52.942869 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e39b0-e1ca-4222-926b-28f9a12aa9ba admin admin] PATH_INFO: `/v3/projects/36ba9e871118457c9ac0f4bdfca5f9e8/users/30384b50ca034d19b34b03bb61e59ba3/roles/1aaf128d062240b28b37771b36f6b38b` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:52.961381 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23e39b0-e1ca-4222-926b-28f9a12aa9ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=36ba9e871118457c9ac0f4bdfca5f9e8, user_id=30384b50ca034d19b34b03bb61e59ba3, role_id=1aaf128d062240b28b37771b36f6b38b)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:52.964252 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23e39b0-e1ca-4222-926b-28f9a12aa9ba admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:52.980793 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1466/2937] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 30 04:38:52 2022] PUT /identity/v3/projects/36ba9e871118457c9ac0f4bdfca5f9e8/users/30384b50ca034d19b34b03bb61e59ba3/roles/1aaf128d062240b28b37771b36f6b38b => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:38:52.993639 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dbd245-9e1b-4a2b-b000-fe8862890592 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:52.993949 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dbd245-9e1b-4a2b-b000-fe8862890592 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:52.994230 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dbd245-9e1b-4a2b-b000-fe8862890592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:53.027160 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-b9dbd245-9e1b-4a2b-b000-fe8862890592 None None] MFA Rules not processed for user `30384b50ca034d19b34b03bb61e59ba3`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:38:53.030263 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-b9dbd245-9e1b-4a2b-b000-fe8862890592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:53.108390 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1472/2938] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:38:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:38:53.123876 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e39b0-e1ca-4222-926b-28f9a12aa9ba admin admin] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:53.125971 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-f23e39b0-e1ca-4222-926b-28f9a12aa9ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:53.199527 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e39b0-e1ca-4222-926b-28f9a12aa9ba admin admin] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:53.207487 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56314dc9-3bd2-4e2f-bb2f-e66b47d29e0f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2e1344bc54bf388e5ec025ab94c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:53.211202 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56314dc9-3bd2-4e2f-bb2f-e66b47d29e0f service glance] REQUEST_METHOD: `GET` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:53.211482 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56314dc9-3bd2-4e2f-bb2f-e66b47d29e0f service glance] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:53.211754 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56314dc9-3bd2-4e2f-bb2f-e66b47d29e0f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:53.224742 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56314dc9-3bd2-4e2f-bb2f-e66b47d29e0f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:53.226224 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56314dc9-3bd2-4e2f-bb2f-e66b47d29e0f service glance] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:53.237765 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1467/2939] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:38:53 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:39:03.104623 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=39 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:39:03.232101 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=69,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:39:17.122816 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dbd245-9e1b-4a2b-b000-fe8862890592 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:39:17.212342 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dbd245-9e1b-4a2b-b000-fe8862890592 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:39:17.218007 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db3175b-324a-497a-84c5-ecc9f9c5874d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:39:17.218701 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3175b-324a-497a-84c5-ecc9f9c5874d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:39:17.219144 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3175b-324a-497a-84c5-ecc9f9c5874d admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:39:17.219683 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3175b-324a-497a-84c5-ecc9f9c5874d admin admin] PATH_INFO: `/v3/users/30384b50ca034d19b34b03bb61e59ba3` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:39:17.221711 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db3175b-324a-497a-84c5-ecc9f9c5874d admin admin] RBAC: Authorizing `identity:delete_user(user_id=30384b50ca034d19b34b03bb61e59ba3)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:39:17.223761 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db3175b-324a-497a-84c5-ecc9f9c5874d admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:39:17.290669 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-9db3175b-324a-497a-84c5-ecc9f9c5874d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30384b50ca034d19b34b03bb61e59ba3'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:39:17.299777 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-9db3175b-324a-497a-84c5-ecc9f9c5874d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30384b50ca034d19b34b03bb61e59ba3'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:39:17.309609 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-9db3175b-324a-497a-84c5-ecc9f9c5874d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30384b50ca034d19b34b03bb61e59ba3'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:39:17.310376 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-9db3175b-324a-497a-84c5-ecc9f9c5874d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30384b50ca034d19b34b03bb61e59ba3'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:39:17.326447 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-9db3175b-324a-497a-84c5-ecc9f9c5874d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30384b50ca034d19b34b03bb61e59ba3'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:39:17.334352 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1473/2940] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 30 04:39:17 2022] DELETE /identity/v3/users/30384b50ca034d19b34b03bb61e59ba3 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:39:17.339684 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b2520-35c4-4713-913b-cd6bbc887dc6 None None] REQUEST_METHOD: `POST` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:39:17.340338 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b2520-35c4-4713-913b-cd6bbc887dc6 None None] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:39:17.340338 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b2520-35c4-4713-913b-cd6bbc887dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:39:17.371132 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.auth.core [None req-f68b2520-35c4-4713-913b-cd6bbc887dc6 None None] MFA Rules not processed for user `7a4a4a4d468841a8acfbd6ef778ab3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:39:17.372472 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-f68b2520-35c4-4713-913b-cd6bbc887dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:39:17.454777 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1468/2941] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 30 04:39:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:39:17.466874 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db3175b-324a-497a-84c5-ecc9f9c5874d admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:39:17.468793 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-9db3175b-324a-497a-84c5-ecc9f9c5874d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:39:17.547867 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db3175b-324a-497a-84c5-ecc9f9c5874d admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:39:17.553348 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd52e5-c4d1-4d62-b618-36fd2e702999 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c05f49ae42b4f9583ff10b2cfce52a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:39:17.554091 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd52e5-c4d1-4d62-b618-36fd2e702999 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:39:17.554406 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd52e5-c4d1-4d62-b618-36fd2e702999 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:39:17.554675 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd52e5-c4d1-4d62-b618-36fd2e702999 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:39:17.567805 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd52e5-c4d1-4d62-b618-36fd2e702999 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:39:17.569350 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd52e5-c4d1-4d62-b618-36fd2e702999 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:39:17.583146 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1474/2942] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:39:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:39:17.975776 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b2520-35c4-4713-913b-cd6bbc887dc6 None None] Authenticating user token {{(pid=81547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:39:17.978239 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.fernet_utils [None req-f68b2520-35c4-4713-913b-cd6bbc887dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:39:17.996545 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b2520-35c4-4713-913b-cd6bbc887dc6 None None] Validating token access rules against request {{(pid=81547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:39:18.002809 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a109ac-fa95-43a9-841d-2e0eb5fca629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4a4a4d468841a8acfbd6ef778ab3bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17736c99d5e4774b6a5a802cbcd44ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:39:18.003558 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a109ac-fa95-43a9-841d-2e0eb5fca629 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:39:18.003868 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a109ac-fa95-43a9-841d-2e0eb5fca629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:39:18.004250 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a109ac-fa95-43a9-841d-2e0eb5fca629 admin admin] PATH_INFO: `/v3/projects/36ba9e871118457c9ac0f4bdfca5f9e8` {{(pid=81547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:39:18.005456 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a109ac-fa95-43a9-841d-2e0eb5fca629 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36ba9e871118457c9ac0f4bdfca5f9e8)` {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:39:18.007684 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a109ac-fa95-43a9-841d-2e0eb5fca629 admin admin] RBAC: Authorization granted {{(pid=81547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:39:18.066773 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-b1a109ac-fa95-43a9-841d-2e0eb5fca629 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36ba9e871118457c9ac0f4bdfca5f9e8', 'request_id': 'req-b1a109ac-fa95-43a9-841d-2e0eb5fca629'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:39:18.074264 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-b1a109ac-fa95-43a9-841d-2e0eb5fca629 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36ba9e871118457c9ac0f4bdfca5f9e8', 'request_id': 'req-b1a109ac-fa95-43a9-841d-2e0eb5fca629'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:39:18.084722 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-b1a109ac-fa95-43a9-841d-2e0eb5fca629 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36ba9e871118457c9ac0f4bdfca5f9e8', 'request_id': 'req-b1a109ac-fa95-43a9-841d-2e0eb5fca629'} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:39:18.097732 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-b1a109ac-fa95-43a9-841d-2e0eb5fca629 admin admin] The token cache is being invalidate because project 36ba9e871118457c9ac0f4bdfca5f9e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:39:18.098070 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-b1a109ac-fa95-43a9-841d-2e0eb5fca629 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:39:18.098739 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG keystone.notifications [None req-b1a109ac-fa95-43a9-841d-2e0eb5fca629 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:39:18.100487 dv-cinder-854265-2-smb devstack@keystone.service[81547]: [pid: 81547|app: 0|req: 1469/2943] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 30 04:39:17 2022] DELETE /identity/v3/projects/36ba9e871118457c9ac0f4bdfca5f9e8 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:39:27.576593 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:39:28.094118 dv-cinder-854265-2-smb devstack@keystone.service[81547]: DEBUG dbcounter [-] [81547] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:18.681649 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd52e5-c4d1-4d62-b618-36fd2e702999 service neutron] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:18.683899 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-f8cd52e5-c4d1-4d62-b618-36fd2e702999 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:18.767729 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd52e5-c4d1-4d62-b618-36fd2e702999 service neutron] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:18.856467 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc0a5ea-adab-435b-9a0a-6ffd8a4bbf2d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47a092fbe1334f7e9ae4ba9bdb5e9f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e05769361674c8fa995050150ad4cfa', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:18.857487 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0a5ea-adab-435b-9a0a-6ffd8a4bbf2d service placement] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:18.857887 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0a5ea-adab-435b-9a0a-6ffd8a4bbf2d service placement] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:18.858282 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0a5ea-adab-435b-9a0a-6ffd8a4bbf2d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:18.860823 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-dfc0a5ea-adab-435b-9a0a-6ffd8a4bbf2d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:18.880297 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc0a5ea-adab-435b-9a0a-6ffd8a4bbf2d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:18.883049 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc0a5ea-adab-435b-9a0a-6ffd8a4bbf2d service placement] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:18.902575 dv-cinder-854265-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1475/2944] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 30 04:43:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:43:28.893602 dv-cinder-854265-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=58 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}